Jul 22 03:08:11 devstack cinder-volume[76521]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 22 03:08:11 devstack cinder-volume[76521]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 22 03:08:11 devstack cinder-volume[76521]: we strongly recommend against using it for new projects. Jul 22 03:08:11 devstack cinder-volume[76521]: If you are already using Eventlet, we recommend migrating to a different Jul 22 03:08:11 devstack cinder-volume[76521]: framework. For more detail see Jul 22 03:08:11 devstack cinder-volume[76521]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 22 03:08:11 devstack cinder-volume[76521]: import eventlet # noqa Jul 22 03:08:14 devstack cinder-volume[76521]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76521) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 22 03:08:14 devstack cinder-volume[76521]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76521) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 22 03:08:14 devstack cinder-volume[76521]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76521) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 22 03:08:15 devstack cinder-volume[76521]: INFO dbcounter [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] Registered counter for database cinder Jul 22 03:08:15 devstack cinder-volume[76521]: DEBUG oslo_db.sqlalchemy.engines [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76521) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 22 03:08:15 devstack cinder-volume[76521]: DEBUG dbcounter [-] [76521] Writer thread running {{(pid=76521) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 22 03:08:15 devstack cinder-volume[76521]: INFO cinder.rpc [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 22 03:08:15 devstack cinder-volume[76521]: INFO cinder.rpc [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 22 03:08:15 devstack cinder-volume[76521]: DEBUG oslo_db.sqlalchemy.engines [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76521) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 22 03:08:15 devstack cinder-volume[76521]: INFO cinder.volume.manager [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] Determined volume DB was empty at startup. Jul 22 03:08:15 devstack cinder-volume[76521]: DEBUG cinder.volume.manager [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76521) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 22 03:08:15 devstack cinder-volume[76521]: INFO cinder.volume.manager [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 22 03:08:15 devstack cinder-volume[76521]: WARNING stevedore.named [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 22 03:08:15 devstack cinder-volume[76521]: WARNING castellan.key_manager [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 22 03:08:15 devstack cinder-volume[76521]: WARNING cinder.keymgr.conf_key_mgr [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 22 03:08:15 devstack cinder-volume[76521]: DEBUG cinder.volume.drivers.lvm [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76521) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Jul 22 03:08:15 devstack cinder-volume[76521]: DEBUG oslo_concurrency.processutils [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_concurrency.processutils [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] CMD "cinder-rtstool verify" returned: 0 in 0.436s {{(pid=76521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_db.sqlalchemy.engines [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76521) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 22 03:08:16 devstack cinder-volume[76521]: INFO cinder.rpc [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 22 03:08:16 devstack cinder-volume[76521]: INFO cinder.rpc [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 22 03:08:16 devstack cinder-volume[76521]: WARNING stevedore.named [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 22 03:08:16 devstack cinder-volume[76521]: WARNING castellan.key_manager [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 22 03:08:16 devstack cinder-volume[76521]: INFO cinder.volume.manager [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_db.sqlalchemy.engines [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76521) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 22 03:08:16 devstack cinder-volume[76521]: INFO oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] Starting 1 workers Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] Started child 76676 {{(pid=76521) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] Full set of CONF: {{(pid=76521) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] ******************************************************************************** {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] Configuration options gathered from: {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] ================================================================================ {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] allow_availability_zone_fallback = False {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] allow_compression_on_image_upload = False {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] allowed_direct_url_schemes = [] {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] api_rate_limit = True {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] auth_strategy = keystone {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] az_cache_duration = 3600 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] backend_availability_zone = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] backend_host = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] backend_name = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] backend_stats_polling_interval = 60 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] backup_api_class = cinder.backup.api.API {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] backup_name_template = backup-%s {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] backup_use_same_host = False {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] backup_use_temp_snapshot = False {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] chap_password = **** {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] chap_username = {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] cinder_internal_tenant_project_id = 2da8a2d925a54c61bc1ec889fcf8681e {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] cinder_internal_tenant_user_id = 5888498861234ab183c53d66ce6a929b {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] cloned_volume_same_az = True {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] cluster = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] compression_format = gzip {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] compute_api_class = cinder.compute.nova.API {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] config_dir = [] {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] config_source = [] {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] control_exchange = openstack {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] debug = True {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] default_availability_zone = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] default_group_type = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] default_volume_type = lvmdriver-1 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] disk_geometry = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] driver_client_cert = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] driver_client_cert_key = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] driver_data_namespace = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] driver_ssl_cert_path = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] driver_ssl_cert_verify = False {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] driver_use_ssl = False {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] enable_force_upload = False {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76676]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] enable_new_services = True {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] enable_unsupported_driver = False {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] enabled_backends = ['lvmdriver-1'] {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] enforce_multipath_for_image_xfer = False {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] filter_function = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] glance_api_insecure = False {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] glance_api_servers = ['http://192.168.122.165/image'] {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] glance_api_ssl_compression = False {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] glance_ca_certificates_file = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] glance_catalog_info = image:glance:publicURL {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] glance_certfile = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] glance_keyfile = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] glance_num_retries = 3 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] glance_request_timeout = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] goodness_function = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] graceful_shutdown_timeout = 5 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] group_api_class = cinder.group.api.API {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] host = devstack {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] image_compress_on_upload = True {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] image_conversion_address_space_limit = 1 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] image_conversion_cpu_limit = 60 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] image_conversion_disable = False {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] image_upload_use_cinder_backend = False {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] image_upload_use_internal_tenant = False {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] image_volume_cache_enabled = False {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] image_volume_cache_max_count = 0 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] image_volume_cache_max_size_gb = 0 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] init_host_max_objects_retrieval = 0 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] instance_format = [instance: %(uuid)s] {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] iscsi_target_flags = {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] iscsi_write_cache = on {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] iser_helper = tgtadm {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] iser_ip_address = 192.168.122.165 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] iser_port = 3260 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] log_color = False {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] log_config_append = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] log_dir = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] log_file = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] log_options = True {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] log_rotate_interval = 1 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] log_rotate_interval_type = days {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] log_rotation_type = none {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] max_age = 0 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] max_logfile_count = 30 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] max_logfile_size_mb = 200 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] max_over_subscription_ratio = 20.0 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] message_reap_interval = 86400 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] message_ttl = 2592000 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] migration_create_volume_timeout_secs = 300 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] monkey_patch = False {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] monkey_patch_modules = [] {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] my_ip = 192.168.122.165 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] no_snapshot_gb_quota = False {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] num_iser_scan_tries = 3 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] num_shell_tries = 3 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] num_volume_device_scan_tries = 3 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] nvmeof_conn_info_version = 1 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] nvmet_ns_id = 10 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] nvmet_port_id = 1 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] osapi_max_limit = 1000 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] osapi_volume_ext_list = [] {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] osapi_volume_listen = 0.0.0.0 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] osapi_volume_listen_port = 8776 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] osapi_volume_use_ssl = False {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] osapi_volume_workers = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] per_volume_size_limit = -1 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] periodic_fuzzy_delay = 60 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] periodic_interval = 60 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] project_id_regex = [0-9a-f\-]+ {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] public_endpoint = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] publish_errors = False {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] quota_backup_gigabytes = 1000 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] quota_backups = 10 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] quota_gigabytes = 1000 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] quota_groups = 10 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] quota_snapshots = 10 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] quota_volumes = 10 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] rate_limit_burst = 0 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] rate_limit_except_level = CRITICAL {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] rate_limit_interval = 0 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] reinit_driver_count = 3 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] replication_device = **** {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] report_discard_supported = False {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] report_interval = 120 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] reservation_clean_interval = 86400 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] reservation_expire = 86400 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] reserved_image_namespaces = [] {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] reserved_percentage = 0 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] rpc_response_timeout = 120 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] run_external_periodic_tasks = True {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] scst_target_driver = iscsi {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] scst_target_iqn_name = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] service_down_time = 720 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] shell_completion = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] snapshot_name_template = snapshot-%s {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] snapshot_same_host = True {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] split_loggers = False {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] state_path = /opt/stack/data/cinder {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] storage_availability_zone = nova {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] storage_protocol = iSCSI {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] syslog_log_facility = LOG_USER {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] target_helper = lioadm {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] target_ip_address = 192.168.122.165 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] target_port = 3260 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] target_protocol = iscsi {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] target_secondary_ip_addresses = [] {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] trace_flags = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] transfer_api_class = cinder.transfer.api.API {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] transport_url = **** {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] until_refresh = 0 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] use_chap_auth = False {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] use_default_quota_class = True {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] use_journal = False {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] use_json = False {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] use_multipath_for_image_xfer = False {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] use_stderr = False {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] use_syslog = False {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] verify_glance_signatures = enabled {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] volume_api_class = cinder.volume.api.API {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] volume_backend_name = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] volume_clear = zero {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] volume_clear_ionice = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] volume_clear_size = 0 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] volume_copy_bps_limit = 0 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] volume_dd_blocksize = 1M {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] volume_name_template = volume-%s {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] volume_service_inithost_offload = False {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] volume_usage_audit_period = month {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] zoning_mode = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] oslo_concurrency.disable_process_locking = False {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76676]: INFO cinder.volume.manager [None req-23083423-d6cf-4c4f-b929-6fd61ef431fb None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] keystone_authtoken.auth_section = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] keystone_authtoken.auth_type = password {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] keystone_authtoken.auth_version = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] keystone_authtoken.cache = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-23083423-d6cf-4c4f-b929-6fd61ef431fb None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] keystone_authtoken.certfile = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] keystone_authtoken.delay_auth_decision = False {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] keystone_authtoken.http_connect_timeout = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] keystone_authtoken.include_service_catalog = True {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] keystone_authtoken.insecure = False {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] keystone_authtoken.interface = public {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] keystone_authtoken.keyfile = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] keystone_authtoken.memcache_password = {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] keystone_authtoken.memcache_username = {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] keystone_authtoken.region_name = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] keystone_authtoken.service_token_roles_required = True {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] keystone_authtoken.service_type = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] keystone_authtoken.token_cache_time = 300 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.165/identity {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] cache.backend = dogpile.cache.null {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] cache.backend_argument = **** {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] cache.backend_expiration_time = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] cache.config_prefix = cache.oslo {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] cache.debug_cache_backend = False {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-23083423-d6cf-4c4f-b929-6fd61ef431fb None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=76676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] cache.enable_retry_client = False {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] cache.enable_socket_keepalive = False {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] cache.enabled = False {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-23083423-d6cf-4c4f-b929-6fd61ef431fb None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] cache.expiration_time = 600 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] cache.hashclient_retry_attempts = 2 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] cache.memcache_dead_retry = 300 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] cache.memcache_pool_maxsize = 10 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] cache.memcache_sasl_enabled = False {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] cache.password = **** {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] cache.proxies = [] {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] cache.redis_db = 0 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] cache.redis_sentinel_service_name = mymaster {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] cache.redis_server = localhost:6379 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] cache.retry_attempts = 2 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] cache.retry_delay = 0.0 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] cache.socket_keepalive_count = 1 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] cache.socket_keepalive_idle = 1 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] cache.socket_keepalive_interval = 1 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] cache.socket_timeout = 1.0 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] cache.tls_allowed_ciphers = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] cache.tls_cafile = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] cache.tls_certfile = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-23083423-d6cf-4c4f-b929-6fd61ef431fb None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=76676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:08:16 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-23083423-d6cf-4c4f-b929-6fd61ef431fb None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] cache.tls_enabled = False {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] cache.tls_keyfile = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] cache.username = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] coordination.backend_url = **** {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] database.asyncio_connection = **** {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] database.asyncio_slave_connection = **** {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] database.backend = sqlalchemy {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] database.connection = **** {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] database.connection_debug = 0 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] database.connection_parameters = {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] database.connection_recycle_time = 3600 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] database.connection_trace = False {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] database.db_inc_retry_interval = True {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] database.db_max_retries = 20 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] database.db_max_retry_interval = 10 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] database.db_retry_interval = 1 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] database.max_overflow = 50 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] database.max_pool_size = 5 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] database.max_retries = 10 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] database.mysql_wsrep_sync_wait = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] database.pool_timeout = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] database.retry_interval = 10 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] database.slave_connection = **** {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] database.sqlite_synchronous = True {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] database.synchronous_reader = True {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] database.use_db_reconnect = False {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] profiler.connection_string = messaging:// {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] profiler.enabled = False {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] profiler.es_doc_type = notification {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-23083423-d6cf-4c4f-b929-6fd61ef431fb None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:08:16 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-23083423-d6cf-4c4f-b929-6fd61ef431fb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] profiler.es_scroll_size = 10000 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] profiler.es_scroll_time = 2m {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] profiler.filter_error_trace = False {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] profiler.hmac_keys = **** {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] profiler.sentinel_service_name = mymaster {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] profiler.socket_timeout = 0.1 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] profiler.trace_requests = False {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] profiler.trace_sqlalchemy = False {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] profiler_jaeger.process_tags = {} {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] profiler_jaeger.service_name_prefix = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] profiler_otlp.service_name_prefix = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] oslo_policy.enforce_new_defaults = True {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] oslo_policy.policy_default_rule = default {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] oslo_policy.policy_file = policy.yaml {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] oslo_policy.remote_timeout = 60.0 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] privsep_osbrick.group = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] privsep_osbrick.helper_command = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] privsep_osbrick.user = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] cinder_sys_admin.group = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] cinder_sys_admin.helper_command = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] cinder_sys_admin.user = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] service_user.auth_section = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] service_user.auth_type = password {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] service_user.cafile = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] service_user.certfile = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] service_user.collect_timing = False {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] service_user.insecure = False {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] service_user.keyfile = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] service_user.send_service_user_token = True {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] service_user.split_loggers = False {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] service_user.timeout = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] glance.auth_section = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] glance.auth_type = password {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] glance.certfile = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] glance.collect_timing = False {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] glance.insecure = False {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack sudo[76683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 22 03:08:16 devstack sudo[76683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] glance.keyfile = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] glance.region_name = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] glance.split_loggers = False {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] glance.timeout = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] backend_defaults.backend_availability_zone = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] backend_defaults.chap_password = **** {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] backend_defaults.chap_username = {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] backend_defaults.disk_geometry = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] backend_defaults.driver_client_cert = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] backend_defaults.driver_client_cert_key = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] backend_defaults.driver_data_namespace = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] backend_defaults.driver_use_ssl = False {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] backend_defaults.enable_unsupported_driver = False {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] backend_defaults.extra_capabilities = {} {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] backend_defaults.filter_function = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] backend_defaults.goodness_function = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] backend_defaults.iscsi_target_flags = {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] backend_defaults.iscsi_write_cache = on {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] backend_defaults.iser_helper = tgtadm {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] backend_defaults.iser_ip_address = 192.168.122.165 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] backend_defaults.iser_port = 3260 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] backend_defaults.lvm_mirrors = 0 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] backend_defaults.lvm_share_target = False {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] backend_defaults.lvm_type = auto {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] backend_defaults.num_shell_tries = 3 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] backend_defaults.nvmet_port_id = 1 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] backend_defaults.replication_device = **** {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] backend_defaults.report_discard_supported = False {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] backend_defaults.reserved_percentage = 0 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] backend_defaults.scst_target_driver = iscsi {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] backend_defaults.scst_target_iqn_name = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] backend_defaults.storage_protocol = iSCSI {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] backend_defaults.target_helper = tgtadm {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] backend_defaults.target_ip_address = 192.168.122.165 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] backend_defaults.target_port = 3260 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] backend_defaults.target_protocol = iscsi {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] backend_defaults.trace_flags = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] backend_defaults.unique_fqdn_network = True {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] backend_defaults.use_chap_auth = False {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] backend_defaults.volume_backend_name = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] backend_defaults.volume_clear = zero {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] backend_defaults.volume_clear_ionice = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] backend_defaults.volume_clear_size = 0 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] backend_defaults.volume_group = cinder-volumes {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] oslo_reports.file_event_handler = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] oslo_reports.log_dir = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] lvmdriver-1.backend_availability_zone = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] lvmdriver-1.backend_host = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] lvmdriver-1.chap_password = **** {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] lvmdriver-1.chap_username = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] lvmdriver-1.chiscsi_conf = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] lvmdriver-1.disk_geometry = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] lvmdriver-1.driver_client_cert = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] lvmdriver-1.driver_data_namespace = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] lvmdriver-1.driver_use_ssl = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] lvmdriver-1.extra_capabilities = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] lvmdriver-1.filter_function = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] lvmdriver-1.goodness_function = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] lvmdriver-1.iser_helper = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] lvmdriver-1.iser_ip_address = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] lvmdriver-1.iser_port = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] lvmdriver-1.iser_target_prefix = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] lvmdriver-1.lvm_conf_file = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] lvmdriver-1.lvm_mirrors = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] lvmdriver-1.lvm_share_target = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] lvmdriver-1.lvm_type = auto {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] lvmdriver-1.num_shell_tries = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] lvmdriver-1.nvmet_port_id = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] lvmdriver-1.replication_device = **** {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] lvmdriver-1.report_discard_supported = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] lvmdriver-1.reserved_percentage = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] lvmdriver-1.scst_target_driver = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] lvmdriver-1.storage_protocol = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] lvmdriver-1.target_helper = lioadm {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] lvmdriver-1.target_ip_address = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] lvmdriver-1.target_port = 3260 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] lvmdriver-1.target_protocol = iscsi {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] lvmdriver-1.trace_flags = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] lvmdriver-1.use_chap_auth = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] lvmdriver-1.volume_clear = zero {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] lvmdriver-1.volume_clear_size = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] lvmdriver-1.volumes_dir = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] oslo_messaging_rabbit.ssl = False {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] oslo_messaging_rabbit.ssl_version = {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] oslo_messaging_notifications.driver = [] {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] oslo_messaging_notifications.retry = -1 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] oslo_messaging_notifications.transport_url = **** {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] key_manager.fixed_key = **** {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] barbican.barbican_api_version = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] barbican.barbican_endpoint = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] barbican.barbican_endpoint_type = public {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] barbican.barbican_region_name = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] barbican.cafile = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] barbican.certfile = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] barbican.collect_timing = False {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] barbican.insecure = False {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] barbican.keyfile = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] barbican.number_of_retries = 60 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] barbican.retry_delay = 1 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] barbican.send_service_user_token = False {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] barbican.split_loggers = False {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] barbican.timeout = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] barbican.verify_ssl = True {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] barbican.verify_ssl_path = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] barbican_service_user.auth_section = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] barbican_service_user.auth_type = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] barbican_service_user.cafile = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] barbican_service_user.certfile = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] barbican_service_user.collect_timing = False {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] barbican_service_user.insecure = False {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] barbican_service_user.keyfile = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] barbican_service_user.split_loggers = False {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] barbican_service_user.timeout = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] vault.approle_role_id = **** {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] vault.approle_secret_id = **** {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] vault.auth_method = approle {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] vault.auth_path = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] vault.kv_mountpoint = secret {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] vault.kv_path = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] vault.kv_version = 2 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] vault.namespace = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] vault.root_token_id = **** {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] vault.ssl_ca_crt_file = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] vault.timeout = 60.0 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] vault.token_file = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] vault.token_role = None {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] vault.use_ssl = False {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:08:16 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] ******************************************************************************** {{(pid=76521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 22 03:08:16 devstack sudo[76683]: pam_unix(sudo:session): session closed for user root Jul 22 03:08:16 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-23083423-d6cf-4c4f-b929-6fd61ef431fb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.286s {{(pid=76676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:08:16 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-23083423-d6cf-4c4f-b929-6fd61ef431fb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:08:16 devstack sudo[76776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 22 03:08:16 devstack sudo[76776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:08:17 devstack sudo[76776]: pam_unix(sudo:session): session closed for user root Jul 22 03:08:17 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-23083423-d6cf-4c4f-b929-6fd61ef431fb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.255s {{(pid=76676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:08:17 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-23083423-d6cf-4c4f-b929-6fd61ef431fb None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 22 03:08:17 devstack cinder-volume[76676]: INFO cinder.brick.local_dev.lvm [None req-23083423-d6cf-4c4f-b929-6fd61ef431fb None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 22 03:08:17 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-23083423-d6cf-4c4f-b929-6fd61ef431fb None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:08:17 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-23083423-d6cf-4c4f-b929-6fd61ef431fb None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:08:17 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-23083423-d6cf-4c4f-b929-6fd61ef431fb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:08:17 devstack sudo[76889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 22 03:08:17 devstack sudo[76889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:08:17 devstack sudo[76889]: pam_unix(sudo:session): session closed for user root Jul 22 03:08:17 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-23083423-d6cf-4c4f-b929-6fd61ef431fb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=76676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:08:17 devstack cinder-volume[76676]: DEBUG cinder.brick.local_dev.lvm [None req-23083423-d6cf-4c4f-b929-6fd61ef431fb None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76676) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Jul 22 03:08:17 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-23083423-d6cf-4c4f-b929-6fd61ef431fb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:08:17 devstack sudo[76988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 22 03:08:17 devstack sudo[76988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:08:17 devstack sudo[76988]: pam_unix(sudo:session): session closed for user root Jul 22 03:08:17 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-23083423-d6cf-4c4f-b929-6fd61ef431fb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.483s {{(pid=76676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:08:17 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-23083423-d6cf-4c4f-b929-6fd61ef431fb None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:08:17 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-23083423-d6cf-4c4f-b929-6fd61ef431fb None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=76676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:08:17 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-23083423-d6cf-4c4f-b929-6fd61ef431fb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:08:17 devstack sudo[77169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 22 03:08:17 devstack sudo[77169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:08:18 devstack sudo[77169]: pam_unix(sudo:session): session closed for user root Jul 22 03:08:18 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-23083423-d6cf-4c4f-b929-6fd61ef431fb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.301s {{(pid=76676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:08:18 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-23083423-d6cf-4c4f-b929-6fd61ef431fb None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:08:18 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-23083423-d6cf-4c4f-b929-6fd61ef431fb None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=76676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:08:18 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-23083423-d6cf-4c4f-b929-6fd61ef431fb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:08:18 devstack sudo[77287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 22 03:08:18 devstack sudo[77287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:08:18 devstack sudo[77287]: pam_unix(sudo:session): session closed for user root Jul 22 03:08:18 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-23083423-d6cf-4c4f-b929-6fd61ef431fb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.256s {{(pid=76676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:08:18 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-23083423-d6cf-4c4f-b929-6fd61ef431fb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:08:18 devstack sudo[77290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 22 03:08:18 devstack sudo[77290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:08:18 devstack sudo[77290]: pam_unix(sudo:session): session closed for user root Jul 22 03:08:18 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-23083423-d6cf-4c4f-b929-6fd61ef431fb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.284s {{(pid=76676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:08:18 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-23083423-d6cf-4c4f-b929-6fd61ef431fb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:08:18 devstack sudo[77370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 22 03:08:18 devstack sudo[77370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:08:19 devstack sudo[77370]: pam_unix(sudo:session): session closed for user root Jul 22 03:08:19 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-23083423-d6cf-4c4f-b929-6fd61ef431fb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.294s {{(pid=76676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:08:19 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-23083423-d6cf-4c4f-b929-6fd61ef431fb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:08:19 devstack sudo[77410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 22 03:08:19 devstack sudo[77410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:08:19 devstack sudo[77410]: pam_unix(sudo:session): session closed for user root Jul 22 03:08:19 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-23083423-d6cf-4c4f-b929-6fd61ef431fb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=76676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:08:19 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-23083423-d6cf-4c4f-b929-6fd61ef431fb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:08:19 devstack sudo[77426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 22 03:08:19 devstack sudo[77426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:08:19 devstack sudo[77426]: pam_unix(sudo:session): session closed for user root Jul 22 03:08:19 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-23083423-d6cf-4c4f-b929-6fd61ef431fb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.348s {{(pid=76676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:08:19 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-23083423-d6cf-4c4f-b929-6fd61ef431fb None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:08:19 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-23083423-d6cf-4c4f-b929-6fd61ef431fb None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:08:19 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-23083423-d6cf-4c4f-b929-6fd61ef431fb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:08:19 devstack sudo[77505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 22 03:08:19 devstack sudo[77505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:08:20 devstack sudo[77505]: pam_unix(sudo:session): session closed for user root Jul 22 03:08:20 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-23083423-d6cf-4c4f-b929-6fd61ef431fb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.262s {{(pid=76676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:08:20 devstack cinder-volume[76676]: INFO cinder.volume.drivers.lvm [None req-23083423-d6cf-4c4f-b929-6fd61ef431fb None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 22 03:08:20 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-23083423-d6cf-4c4f-b929-6fd61ef431fb None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:08:20 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-23083423-d6cf-4c4f-b929-6fd61ef431fb None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:08:20 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-23083423-d6cf-4c4f-b929-6fd61ef431fb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:08:20 devstack sudo[77509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 22 03:08:20 devstack sudo[77509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:08:20 devstack sudo[77509]: pam_unix(sudo:session): session closed for user root Jul 22 03:08:20 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-23083423-d6cf-4c4f-b929-6fd61ef431fb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.261s {{(pid=76676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:08:20 devstack cinder-volume[76676]: DEBUG cinder.volume.drivers.lvm [None req-23083423-d6cf-4c4f-b929-6fd61ef431fb None None] Updating volume stats {{(pid=76676) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 22 03:08:20 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-23083423-d6cf-4c4f-b929-6fd61ef431fb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:08:20 devstack sudo[77512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 22 03:08:20 devstack sudo[77512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:08:20 devstack sudo[77512]: pam_unix(sudo:session): session closed for user root Jul 22 03:08:20 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-23083423-d6cf-4c4f-b929-6fd61ef431fb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.247s {{(pid=76676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:08:20 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-23083423-d6cf-4c4f-b929-6fd61ef431fb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:08:20 devstack sudo[77521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 22 03:08:20 devstack sudo[77521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:08:20 devstack sudo[77521]: pam_unix(sudo:session): session closed for user root Jul 22 03:08:20 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-23083423-d6cf-4c4f-b929-6fd61ef431fb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=76676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:08:20 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-23083423-d6cf-4c4f-b929-6fd61ef431fb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:08:20 devstack sudo[77524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 22 03:08:20 devstack sudo[77524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:08:21 devstack sudo[77524]: pam_unix(sudo:session): session closed for user root Jul 22 03:08:21 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-23083423-d6cf-4c4f-b929-6fd61ef431fb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.270s {{(pid=76676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:08:21 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-23083423-d6cf-4c4f-b929-6fd61ef431fb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:08:21 devstack sudo[77527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 22 03:08:21 devstack sudo[77527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:08:21 devstack sudo[77527]: pam_unix(sudo:session): session closed for user root Jul 22 03:08:21 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-23083423-d6cf-4c4f-b929-6fd61ef431fb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=76676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:08:21 devstack cinder-volume[76676]: INFO cinder.volume.driver [None req-23083423-d6cf-4c4f-b929-6fd61ef431fb None None] Driver hasn't implemented _init_vendor_properties() Jul 22 03:08:21 devstack cinder-volume[76676]: DEBUG cinder.volume.driver [None req-23083423-d6cf-4c4f-b929-6fd61ef431fb None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76676) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 22 03:08:21 devstack cinder-volume[76676]: DEBUG oslo_db.sqlalchemy.engines [None req-23083423-d6cf-4c4f-b929-6fd61ef431fb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76676) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 22 03:08:21 devstack cinder-volume[76676]: DEBUG dbcounter [-] [76676] Writer thread running {{(pid=76676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 22 03:08:21 devstack cinder-volume[76676]: DEBUG cinder.db.api [None req-23083423-d6cf-4c4f-b929-6fd61ef431fb None None] Building query based on filter {{(pid=76676) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 22 03:08:21 devstack cinder-volume[76676]: DEBUG cinder.image.image_utils [None req-23083423-d6cf-4c4f-b929-6fd61ef431fb None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76676) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 22 03:08:21 devstack cinder-volume[76676]: INFO cinder.keymgr.migration [None req-e14bc540-1a9b-467b-90e1-d9742a66f131 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 22 03:08:21 devstack cinder-volume[76676]: DEBUG cinder.volume.drivers.lvm [None req-23083423-d6cf-4c4f-b929-6fd61ef431fb None None] Updating volume stats {{(pid=76676) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 22 03:08:21 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-23083423-d6cf-4c4f-b929-6fd61ef431fb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:08:21 devstack sudo[77531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 22 03:08:21 devstack sudo[77531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:08:21 devstack sudo[77531]: pam_unix(sudo:session): session closed for user root Jul 22 03:08:21 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-23083423-d6cf-4c4f-b929-6fd61ef431fb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.293s {{(pid=76676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:08:21 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-23083423-d6cf-4c4f-b929-6fd61ef431fb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:08:21 devstack sudo[77536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 22 03:08:21 devstack sudo[77536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:08:22 devstack sudo[77536]: pam_unix(sudo:session): session closed for user root Jul 22 03:08:22 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-23083423-d6cf-4c4f-b929-6fd61ef431fb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=76676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:08:22 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-23083423-d6cf-4c4f-b929-6fd61ef431fb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:08:22 devstack sudo[77540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 22 03:08:22 devstack sudo[77540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:08:22 devstack sudo[77540]: pam_unix(sudo:session): session closed for user root Jul 22 03:08:22 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-23083423-d6cf-4c4f-b929-6fd61ef431fb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.265s {{(pid=76676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:08:22 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-23083423-d6cf-4c4f-b929-6fd61ef431fb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:08:22 devstack sudo[77543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 22 03:08:22 devstack sudo[77543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:08:22 devstack sudo[77543]: pam_unix(sudo:session): session closed for user root Jul 22 03:08:22 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-23083423-d6cf-4c4f-b929-6fd61ef431fb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=76676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:08:22 devstack cinder-volume[76676]: DEBUG cinder.manager [None req-23083423-d6cf-4c4f-b929-6fd61ef431fb None None] Notifying Schedulers of capabilities ... {{(pid=76676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:08:22 devstack cinder-volume[76676]: INFO cinder.volume.manager [None req-23083423-d6cf-4c4f-b929-6fd61ef431fb None None] Driver initialization completed successfully. Jul 22 03:08:22 devstack cinder-volume[76676]: INFO cinder.manager [None req-23083423-d6cf-4c4f-b929-6fd61ef431fb None None] Initiating service 2 cleanup Jul 22 03:08:22 devstack cinder-volume[76676]: INFO cinder.manager [None req-23083423-d6cf-4c4f-b929-6fd61ef431fb None None] Service 2 cleanup completed. Jul 22 03:08:22 devstack cinder-volume[76676]: DEBUG cinder.service [None req-23083423-d6cf-4c4f-b929-6fd61ef431fb None None] Creating RPC server for service cinder-volume {{(pid=76676) start /opt/stack/cinder/cinder/service.py:231}} Jul 22 03:08:22 devstack cinder-volume[76676]: DEBUG cinder.service [None req-23083423-d6cf-4c4f-b929-6fd61ef431fb None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76676) start /opt/stack/cinder/cinder/service.py:237}} Jul 22 03:08:22 devstack cinder-volume[76676]: INFO cinder.volume.manager [None req-23083423-d6cf-4c4f-b929-6fd61ef431fb None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 22 03:08:22 devstack cinder-volume[76676]: DEBUG cinder.volume.drivers.lvm [None req-23083423-d6cf-4c4f-b929-6fd61ef431fb None None] Updating volume stats {{(pid=76676) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 22 03:08:22 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-23083423-d6cf-4c4f-b929-6fd61ef431fb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:08:22 devstack sudo[77548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 22 03:08:22 devstack sudo[77548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:08:23 devstack sudo[77548]: pam_unix(sudo:session): session closed for user root Jul 22 03:08:23 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-23083423-d6cf-4c4f-b929-6fd61ef431fb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=76676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:08:23 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-23083423-d6cf-4c4f-b929-6fd61ef431fb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:08:23 devstack sudo[77551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 22 03:08:23 devstack sudo[77551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:08:23 devstack sudo[77551]: pam_unix(sudo:session): session closed for user root Jul 22 03:08:23 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-23083423-d6cf-4c4f-b929-6fd61ef431fb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=76676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:08:23 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-23083423-d6cf-4c4f-b929-6fd61ef431fb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:08:23 devstack sudo[77554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 22 03:08:23 devstack sudo[77554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:08:23 devstack sudo[77554]: pam_unix(sudo:session): session closed for user root Jul 22 03:08:23 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-23083423-d6cf-4c4f-b929-6fd61ef431fb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.280s {{(pid=76676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:08:23 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-23083423-d6cf-4c4f-b929-6fd61ef431fb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:08:23 devstack sudo[77557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 22 03:08:23 devstack sudo[77557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:08:23 devstack sudo[77557]: pam_unix(sudo:session): session closed for user root Jul 22 03:08:23 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-23083423-d6cf-4c4f-b929-6fd61ef431fb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=76676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:08:23 devstack cinder-volume[76676]: INFO cinder.volume.manager [None req-23083423-d6cf-4c4f-b929-6fd61ef431fb None None] Driver post RPC initialization completed successfully. Jul 22 03:08:26 devstack cinder-volume[76521]: DEBUG dbcounter [-] [76521] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76521) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 03:08:32 devstack cinder-volume[76676]: DEBUG dbcounter [-] [76676] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 03:08:33 devstack cinder-volume[76676]: DEBUG dbcounter [-] [76676] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=76676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 03:09:04 devstack cinder-volume[76676]: DEBUG oslo_service.periodic_task [None req-5c6e7ad8-c23e-4060-9393-526c41b11ac8 None None] Running periodic task VolumeManager._thread_info {{(pid=76676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 03:09:04 devstack cinder-volume[76676]: DEBUG cinder.volume.manager [None req-5c6e7ad8-c23e-4060-9393-526c41b11ac8 None None] thread count: 6 {{(pid=76676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 22 03:09:04 devstack cinder-volume[76676]: DEBUG cinder.volume.manager [None req-5c6e7ad8-c23e-4060-9393-526c41b11ac8 None None] thread info: [<_MainThread(MainThread, started 128406031360128)>, , , , , ] {{(pid=76676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 22 03:10:04 devstack cinder-volume[76676]: DEBUG oslo_service.periodic_task [None req-5c6e7ad8-c23e-4060-9393-526c41b11ac8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 03:10:04 devstack cinder-volume[76676]: DEBUG cinder.volume.drivers.lvm [None req-5c6e7ad8-c23e-4060-9393-526c41b11ac8 None None] Updating volume stats {{(pid=76676) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 22 03:10:04 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-5c6e7ad8-c23e-4060-9393-526c41b11ac8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:10:04 devstack sudo[82748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 22 03:10:04 devstack sudo[82748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:10:05 devstack sudo[82748]: pam_unix(sudo:session): session closed for user root Jul 22 03:10:05 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-5c6e7ad8-c23e-4060-9393-526c41b11ac8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=76676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:10:05 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-5c6e7ad8-c23e-4060-9393-526c41b11ac8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:10:05 devstack sudo[82751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 22 03:10:05 devstack sudo[82751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:10:05 devstack sudo[82751]: pam_unix(sudo:session): session closed for user root Jul 22 03:10:05 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-5c6e7ad8-c23e-4060-9393-526c41b11ac8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.244s {{(pid=76676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:10:05 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-5c6e7ad8-c23e-4060-9393-526c41b11ac8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:10:05 devstack sudo[82754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 22 03:10:05 devstack sudo[82754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:10:05 devstack sudo[82754]: pam_unix(sudo:session): session closed for user root Jul 22 03:10:05 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-5c6e7ad8-c23e-4060-9393-526c41b11ac8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.258s {{(pid=76676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:10:05 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-5c6e7ad8-c23e-4060-9393-526c41b11ac8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:10:05 devstack sudo[82757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 22 03:10:05 devstack sudo[82757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:10:05 devstack sudo[82757]: pam_unix(sudo:session): session closed for user root Jul 22 03:10:05 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-5c6e7ad8-c23e-4060-9393-526c41b11ac8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=76676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:10:05 devstack cinder-volume[76676]: DEBUG cinder.manager [None req-5c6e7ad8-c23e-4060-9393-526c41b11ac8 None None] Notifying Schedulers of capabilities ... {{(pid=76676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:10:05 devstack cinder-volume[76676]: DEBUG oslo_service.periodic_task [None req-5c6e7ad8-c23e-4060-9393-526c41b11ac8 None None] Running periodic task VolumeManager._thread_info {{(pid=76676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 03:10:05 devstack cinder-volume[76676]: DEBUG cinder.volume.manager [None req-5c6e7ad8-c23e-4060-9393-526c41b11ac8 None None] thread count: 6 {{(pid=76676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 22 03:10:05 devstack cinder-volume[76676]: DEBUG cinder.volume.manager [None req-5c6e7ad8-c23e-4060-9393-526c41b11ac8 None None] thread info: [<_MainThread(MainThread, started 128406031360128)>, , , , , ] {{(pid=76676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 22 03:10:33 devstack cinder-volume[76676]: DEBUG dbcounter [-] [76676] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 03:11:04 devstack cinder-volume[76676]: DEBUG oslo_service.periodic_task [None req-5c6e7ad8-c23e-4060-9393-526c41b11ac8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 03:11:04 devstack cinder-volume[76676]: DEBUG cinder.volume.drivers.lvm [None req-5c6e7ad8-c23e-4060-9393-526c41b11ac8 None None] Updating volume stats {{(pid=76676) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 22 03:11:04 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-5c6e7ad8-c23e-4060-9393-526c41b11ac8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:11:04 devstack sudo[84304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 22 03:11:04 devstack sudo[84304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:11:05 devstack sudo[84304]: pam_unix(sudo:session): session closed for user root Jul 22 03:11:05 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-5c6e7ad8-c23e-4060-9393-526c41b11ac8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.295s {{(pid=76676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:11:05 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-5c6e7ad8-c23e-4060-9393-526c41b11ac8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:11:05 devstack sudo[84319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 22 03:11:05 devstack sudo[84319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:11:05 devstack sudo[84319]: pam_unix(sudo:session): session closed for user root Jul 22 03:11:05 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-5c6e7ad8-c23e-4060-9393-526c41b11ac8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=76676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:11:05 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-5c6e7ad8-c23e-4060-9393-526c41b11ac8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:11:05 devstack sudo[84322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 22 03:11:05 devstack sudo[84322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:11:05 devstack sudo[84322]: pam_unix(sudo:session): session closed for user root Jul 22 03:11:05 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-5c6e7ad8-c23e-4060-9393-526c41b11ac8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.287s {{(pid=76676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:11:05 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-5c6e7ad8-c23e-4060-9393-526c41b11ac8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:11:05 devstack sudo[84361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 22 03:11:05 devstack sudo[84361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:11:06 devstack sudo[84361]: pam_unix(sudo:session): session closed for user root Jul 22 03:11:06 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-5c6e7ad8-c23e-4060-9393-526c41b11ac8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=76676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:11:06 devstack cinder-volume[76676]: DEBUG cinder.manager [None req-5c6e7ad8-c23e-4060-9393-526c41b11ac8 None None] Notifying Schedulers of capabilities ... {{(pid=76676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:11:06 devstack cinder-volume[76676]: DEBUG oslo_service.periodic_task [None req-5c6e7ad8-c23e-4060-9393-526c41b11ac8 None None] Running periodic task VolumeManager._thread_info {{(pid=76676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 03:11:06 devstack cinder-volume[76676]: DEBUG cinder.volume.manager [None req-5c6e7ad8-c23e-4060-9393-526c41b11ac8 None None] thread count: 6 {{(pid=76676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 22 03:11:06 devstack cinder-volume[76676]: DEBUG cinder.volume.manager [None req-5c6e7ad8-c23e-4060-9393-526c41b11ac8 None None] thread info: [<_MainThread(MainThread, started 128406031360128)>, , , , , ] {{(pid=76676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 22 03:12:04 devstack cinder-volume[76676]: DEBUG oslo_service.periodic_task [None req-5c6e7ad8-c23e-4060-9393-526c41b11ac8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 03:12:04 devstack cinder-volume[76676]: DEBUG cinder.volume.drivers.lvm [None req-5c6e7ad8-c23e-4060-9393-526c41b11ac8 None None] Updating volume stats {{(pid=76676) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 22 03:12:04 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-5c6e7ad8-c23e-4060-9393-526c41b11ac8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:12:04 devstack sudo[85756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 22 03:12:04 devstack sudo[85756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:12:05 devstack sudo[85756]: pam_unix(sudo:session): session closed for user root Jul 22 03:12:05 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-5c6e7ad8-c23e-4060-9393-526c41b11ac8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=76676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:12:05 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-5c6e7ad8-c23e-4060-9393-526c41b11ac8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:12:05 devstack sudo[85759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 22 03:12:05 devstack sudo[85759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:12:05 devstack sudo[85759]: pam_unix(sudo:session): session closed for user root Jul 22 03:12:05 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-5c6e7ad8-c23e-4060-9393-526c41b11ac8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=76676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:12:05 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-5c6e7ad8-c23e-4060-9393-526c41b11ac8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:12:05 devstack sudo[85773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 22 03:12:05 devstack sudo[85773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:12:05 devstack sudo[85773]: pam_unix(sudo:session): session closed for user root Jul 22 03:12:05 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-5c6e7ad8-c23e-4060-9393-526c41b11ac8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.258s {{(pid=76676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:12:05 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-5c6e7ad8-c23e-4060-9393-526c41b11ac8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:12:05 devstack sudo[85776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 22 03:12:05 devstack sudo[85776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:12:05 devstack sudo[85776]: pam_unix(sudo:session): session closed for user root Jul 22 03:12:05 devstack cinder-volume[76676]: DEBUG oslo_concurrency.processutils [None req-5c6e7ad8-c23e-4060-9393-526c41b11ac8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=76676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:12:05 devstack cinder-volume[76676]: DEBUG cinder.manager [None req-5c6e7ad8-c23e-4060-9393-526c41b11ac8 None None] Notifying Schedulers of capabilities ... {{(pid=76676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:12:05 devstack cinder-volume[76676]: DEBUG oslo_service.periodic_task [None req-5c6e7ad8-c23e-4060-9393-526c41b11ac8 None None] Running periodic task VolumeManager._thread_info {{(pid=76676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 03:12:05 devstack cinder-volume[76676]: DEBUG cinder.volume.manager [None req-5c6e7ad8-c23e-4060-9393-526c41b11ac8 None None] thread count: 6 {{(pid=76676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 22 03:12:05 devstack cinder-volume[76676]: DEBUG cinder.volume.manager [None req-5c6e7ad8-c23e-4060-9393-526c41b11ac8 None None] thread info: [<_MainThread(MainThread, started 128406031360128)>, , , , , ] {{(pid=76676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 22 03:12:33 devstack cinder-volume[76676]: DEBUG dbcounter [-] [76676] Writing DB stats cinder:SELECT=1 {{(pid=76676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 03:12:33 devstack cinder-volume[76676]: DEBUG dbcounter [-] [76676] Writing DB stats cinder:UPDATE=1 {{(pid=76676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 03:12:49 devstack cinder-volume[76521]: INFO oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] Caught SIGTERM, stopping children Jul 22 03:12:49 devstack cinder-volume[76521]: DEBUG oslo_concurrency.lockutils [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] Acquiring lock "singleton_lock" {{(pid=76521) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 22 03:12:49 devstack cinder-volume[76521]: DEBUG oslo_concurrency.lockutils [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] Acquired lock "singleton_lock" {{(pid=76521) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 22 03:12:49 devstack cinder-volume[76521]: DEBUG oslo_concurrency.lockutils [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] Releasing lock "singleton_lock" {{(pid=76521) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 22 03:12:49 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] Stop services. {{(pid=76521) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 22 03:12:49 devstack cinder-volume[76521]: DEBUG oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] Killing children. {{(pid=76521) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 22 03:12:49 devstack cinder-volume[76521]: INFO oslo_service.backend._eventlet.service [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] Waiting on 1 children to exit Jul 22 03:12:54 devstack cinder-volume[76676]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Jul 22 03:12:55 devstack cinder-volume[86778]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 22 03:12:55 devstack cinder-volume[86778]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 22 03:12:55 devstack cinder-volume[86778]: we strongly recommend against using it for new projects. Jul 22 03:12:55 devstack cinder-volume[86778]: If you are already using Eventlet, we recommend migrating to a different Jul 22 03:12:55 devstack cinder-volume[86778]: framework. For more detail see Jul 22 03:12:55 devstack cinder-volume[86778]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 22 03:12:55 devstack cinder-volume[86778]: import eventlet # noqa Jul 22 03:12:57 devstack cinder-volume[86778]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86778) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 22 03:12:57 devstack cinder-volume[86778]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86778) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 22 03:12:57 devstack cinder-volume[86778]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86778) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 22 03:12:57 devstack cinder-volume[86778]: INFO dbcounter [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] Registered counter for database cinder Jul 22 03:12:57 devstack cinder-volume[76676]: DEBUG oslo_concurrency.lockutils [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] Acquiring lock "singleton_lock" {{(pid=76676) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 22 03:12:57 devstack cinder-volume[76676]: DEBUG oslo_concurrency.lockutils [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] Acquired lock "singleton_lock" {{(pid=76676) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 22 03:12:57 devstack cinder-volume[76676]: DEBUG oslo_concurrency.lockutils [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] Releasing lock "singleton_lock" {{(pid=76676) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 22 03:12:57 devstack cinder-volume[76676]: WARNING amqp [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 22 03:12:57 devstack cinder-volume[76676]: WARNING amqp [None req-8876bbca-5ed7-4d2d-8ff8-9bdb85fad8a6 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 22 03:12:57 devstack cinder-volume[86778]: DEBUG oslo_db.sqlalchemy.engines [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86778) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG dbcounter [-] [86778] Writer thread running {{(pid=86778) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 22 03:12:58 devstack cinder-volume[86778]: INFO cinder.rpc [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 22 03:12:58 devstack cinder-volume[86778]: INFO cinder.rpc [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_db.sqlalchemy.engines [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86778) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 22 03:12:58 devstack cinder-volume[86778]: INFO cinder.volume.manager [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] Determined volume DB was empty at startup. Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG cinder.volume.manager [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86778) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 22 03:12:58 devstack cinder-volume[86778]: INFO cinder.volume.manager [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 22 03:12:58 devstack cinder-volume[86778]: WARNING stevedore.named [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 22 03:12:58 devstack cinder-volume[86778]: WARNING castellan.key_manager [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 22 03:12:58 devstack cinder-volume[86778]: WARNING cinder.keymgr.conf_key_mgr [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 22 03:12:58 devstack cinder-volume[86778]: INFO cinder.volume.manager [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_db.sqlalchemy.engines [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86778) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 22 03:12:58 devstack cinder-volume[86778]: INFO oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] Starting 1 workers Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] Started child 86996 {{(pid=86778) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] Full set of CONF: {{(pid=86778) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] ******************************************************************************** {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] Configuration options gathered from: {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] ================================================================================ {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] allow_availability_zone_fallback = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] allow_compression_on_image_upload = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] allowed_direct_url_schemes = [] {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] api_rate_limit = True {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] auth_strategy = keystone {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] backend_availability_zone = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] backend_host = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] backend_name = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] backend_stats_polling_interval = 60 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] backup_api_class = cinder.backup.api.API {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] backup_name_template = backup-%s {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] backup_use_same_host = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] backup_use_temp_snapshot = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] chap_password = **** {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] chap_username = {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86996]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] cinder_internal_tenant_project_id = 2da8a2d925a54c61bc1ec889fcf8681e {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] cinder_internal_tenant_user_id = 5888498861234ab183c53d66ce6a929b {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] cluster = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] compression_format = gzip {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] compute_api_class = cinder.compute.nova.API {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] config_dir = [] {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] config_source = [] {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] control_exchange = openstack {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] debug = True {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] default_availability_zone = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] default_group_type = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] default_volume_type = QuobyteHD {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] disk_geometry = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] driver_client_cert = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] driver_client_cert_key = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] driver_data_namespace = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] driver_ssl_cert_path = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] driver_ssl_cert_verify = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] driver_use_ssl = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] enable_new_services = True {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] enable_unsupported_driver = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] enabled_backends = ['QuobyteHD'] {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] enforce_multipath_for_image_xfer = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] filter_function = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] glance_api_insecure = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] glance_api_servers = ['http://192.168.122.165/image'] {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] glance_api_ssl_compression = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] glance_ca_certificates_file = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] glance_catalog_info = image:glance:publicURL {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] glance_certfile = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] glance_keyfile = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] glance_num_retries = 3 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] glance_request_timeout = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] goodness_function = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] graceful_shutdown_timeout = 5 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] group_api_class = cinder.group.api.API {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] host = devstack {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] image_compress_on_upload = True {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] image_conversion_address_space_limit = 1 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] image_conversion_cpu_limit = 60 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] image_conversion_disable = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] image_upload_use_cinder_backend = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] image_upload_use_internal_tenant = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] image_volume_cache_enabled = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] image_volume_cache_max_count = 0 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] image_volume_cache_max_size_gb = 0 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] init_host_max_objects_retrieval = 0 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] instance_format = [instance: %(uuid)s] {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] iscsi_target_flags = {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] iscsi_write_cache = on {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] iser_helper = tgtadm {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] iser_ip_address = 192.168.122.165 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] iser_port = 3260 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] log_color = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] log_config_append = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] log_dir = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] log_file = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] log_options = True {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] log_rotate_interval = 1 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] log_rotate_interval_type = days {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] log_rotation_type = none {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] max_age = 0 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] max_logfile_count = 30 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] max_logfile_size_mb = 200 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] max_over_subscription_ratio = 20.0 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] message_reap_interval = 86400 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] message_ttl = 2592000 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] migration_create_volume_timeout_secs = 300 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] monkey_patch = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] monkey_patch_modules = [] {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] my_ip = 192.168.122.165 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] no_snapshot_gb_quota = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] num_iser_scan_tries = 3 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] num_shell_tries = 3 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] num_volume_device_scan_tries = 3 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] nvmeof_conn_info_version = 1 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] nvmet_ns_id = 10 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] nvmet_port_id = 1 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] osapi_max_limit = 1000 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] osapi_volume_ext_list = [] {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] osapi_volume_listen_port = 8776 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] osapi_volume_use_ssl = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] osapi_volume_workers = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] per_volume_size_limit = -1 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] periodic_fuzzy_delay = 60 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] periodic_interval = 60 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] public_endpoint = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] publish_errors = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] quota_backup_gigabytes = 1000 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] quota_backups = 10 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] quota_gigabytes = 1000 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] quota_groups = 10 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] quota_snapshots = 10 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] quota_volumes = 10 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] rate_limit_burst = 0 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] rate_limit_except_level = CRITICAL {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] rate_limit_interval = 0 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] reinit_driver_count = 3 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] replication_device = **** {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] report_discard_supported = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] report_interval = 120 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] reservation_clean_interval = 86400 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] reservation_expire = 86400 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] reserved_image_namespaces = [] {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] reserved_percentage = 0 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] rpc_response_timeout = 120 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] run_external_periodic_tasks = True {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] scst_target_driver = iscsi {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] scst_target_iqn_name = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] service_down_time = 720 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] shell_completion = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] snapshot_name_template = snapshot-%s {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] split_loggers = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] state_path = /opt/stack/data/cinder {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] storage_availability_zone = nova {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] storage_protocol = iSCSI {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] syslog_log_facility = LOG_USER {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] target_helper = lioadm {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] target_ip_address = 192.168.122.165 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] target_port = 3260 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] target_protocol = iscsi {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] target_secondary_ip_addresses = [] {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] trace_flags = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] transport_url = **** {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] until_refresh = 0 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] use_chap_auth = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] use_default_quota_class = True {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] use_journal = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] use_json = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] use_multipath_for_image_xfer = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] use_stderr = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] use_syslog = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] verify_glance_signatures = enabled {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] volume_api_class = cinder.volume.api.API {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] volume_backend_name = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] volume_clear = zero {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] volume_clear_ionice = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] volume_clear_size = 0 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] volume_copy_bps_limit = 0 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] volume_dd_blocksize = 1M {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] volume_name_template = volume-%s {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] volume_service_inithost_offload = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] volume_usage_audit_period = month {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] zoning_mode = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] oslo_concurrency.disable_process_locking = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] keystone_authtoken.auth_section = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] keystone_authtoken.auth_type = password {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] keystone_authtoken.auth_version = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] keystone_authtoken.cache = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] keystone_authtoken.certfile = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] keystone_authtoken.include_service_catalog = True {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] keystone_authtoken.insecure = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] keystone_authtoken.interface = public {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] keystone_authtoken.keyfile = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] keystone_authtoken.memcache_password = {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] keystone_authtoken.memcache_username = {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] keystone_authtoken.region_name = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] keystone_authtoken.service_type = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.165/identity {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] cache.backend = dogpile.cache.null {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] cache.backend_argument = **** {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] cache.backend_expiration_time = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] cache.config_prefix = cache.oslo {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] cache.debug_cache_backend = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] cache.enable_retry_client = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] cache.enable_socket_keepalive = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] cache.enabled = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] cache.expiration_time = 600 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] cache.hashclient_retry_attempts = 2 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] cache.memcache_dead_retry = 300 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] cache.memcache_pool_maxsize = 10 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] cache.memcache_sasl_enabled = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] cache.password = **** {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] cache.proxies = [] {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] cache.redis_db = 0 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] cache.redis_server = localhost:6379 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] cache.retry_attempts = 2 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] cache.retry_delay = 0.0 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] cache.socket_keepalive_count = 1 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] cache.socket_keepalive_idle = 1 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] cache.socket_keepalive_interval = 1 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] cache.socket_timeout = 1.0 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] cache.tls_allowed_ciphers = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] cache.tls_cafile = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] cache.tls_certfile = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] cache.tls_enabled = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] cache.tls_keyfile = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] cache.username = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] coordination.backend_url = **** {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] database.asyncio_connection = **** {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] database.asyncio_slave_connection = **** {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] database.backend = sqlalchemy {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86996]: INFO cinder.volume.manager [None req-eb23c5cd-0c23-4b59-a526-3e589db61676 None None] Starting volume driver QuobyteDriver (1.2) Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] database.connection = **** {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86996]: DEBUG cinder.volume.drivers.remotefs [None req-eb23c5cd-0c23-4b59-a526-3e589db61676 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86996) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] database.connection_debug = 0 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] database.connection_parameters = {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] database.connection_recycle_time = 3600 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] database.connection_trace = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] database.db_inc_retry_interval = True {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] database.db_max_retries = 20 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] database.db_max_retry_interval = 10 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] database.db_retry_interval = 1 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] database.max_overflow = 50 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] database.max_pool_size = 5 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] database.max_retries = 10 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] database.mysql_wsrep_sync_wait = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] database.pool_timeout = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] database.retry_interval = 10 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] database.slave_connection = **** {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] database.sqlite_synchronous = True {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] database.synchronous_reader = True {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] database.use_db_reconnect = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] profiler.connection_string = messaging:// {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] profiler.enabled = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] profiler.es_doc_type = notification {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] profiler.es_scroll_size = 10000 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] profiler.es_scroll_time = 2m {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] profiler.filter_error_trace = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] profiler.hmac_keys = **** {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] profiler.sentinel_service_name = mymaster {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] profiler.socket_timeout = 0.1 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] profiler.trace_requests = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] profiler.trace_sqlalchemy = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] profiler_jaeger.process_tags = {} {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] profiler_jaeger.service_name_prefix = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] profiler_otlp.service_name_prefix = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] oslo_policy.enforce_new_defaults = True {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] oslo_policy.policy_default_rule = default {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] oslo_policy.policy_file = policy.yaml {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] privsep_osbrick.group = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] privsep_osbrick.helper_command = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] privsep_osbrick.user = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] cinder_sys_admin.group = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] cinder_sys_admin.helper_command = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] cinder_sys_admin.user = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] service_user.auth_section = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] service_user.auth_type = password {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] service_user.cafile = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] service_user.certfile = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] service_user.collect_timing = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] service_user.insecure = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] service_user.keyfile = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] service_user.send_service_user_token = True {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] service_user.split_loggers = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] service_user.timeout = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] glance.auth_section = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] glance.auth_type = password {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] glance.certfile = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] glance.collect_timing = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] glance.insecure = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] glance.keyfile = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] glance.region_name = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] glance.split_loggers = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] glance.timeout = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] backend_defaults.backend_availability_zone = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] backend_defaults.chap_password = **** {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] backend_defaults.chap_username = {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] backend_defaults.disk_geometry = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] backend_defaults.driver_client_cert = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] backend_defaults.driver_client_cert_key = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] backend_defaults.driver_data_namespace = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] backend_defaults.driver_use_ssl = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] backend_defaults.extra_capabilities = {} {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] backend_defaults.filter_function = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] backend_defaults.goodness_function = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] backend_defaults.iscsi_target_flags = {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] backend_defaults.iscsi_write_cache = on {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] backend_defaults.iser_helper = tgtadm {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] backend_defaults.iser_ip_address = 192.168.122.165 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] backend_defaults.iser_port = 3260 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] backend_defaults.nas_host = {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] backend_defaults.nas_login = admin {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] backend_defaults.nas_mount_options = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] backend_defaults.nas_password = **** {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] backend_defaults.nas_private_key = {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] backend_defaults.nas_share_path = {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] backend_defaults.num_shell_tries = 3 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] backend_defaults.quobyte_volume_url = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] backend_defaults.replication_device = **** {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] backend_defaults.report_discard_supported = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] backend_defaults.reserved_percentage = 0 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] backend_defaults.target_helper = tgtadm {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] backend_defaults.target_ip_address = 192.168.122.165 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] backend_defaults.target_port = 3260 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] backend_defaults.target_protocol = iscsi {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] backend_defaults.trace_flags = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] backend_defaults.unique_fqdn_network = True {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] backend_defaults.use_chap_auth = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] backend_defaults.volume_backend_name = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] backend_defaults.volume_clear = zero {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] backend_defaults.volume_clear_ionice = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] backend_defaults.volume_clear_size = 0 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] oslo_reports.file_event_handler = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] oslo_reports.log_dir = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] QuobyteHD.backend_availability_zone = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] QuobyteHD.backend_host = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] QuobyteHD.chap_password = **** {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] QuobyteHD.chap_username = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] QuobyteHD.chiscsi_conf = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] QuobyteHD.disk_geometry = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] QuobyteHD.driver_client_cert = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] QuobyteHD.driver_data_namespace = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] QuobyteHD.driver_use_ssl = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] QuobyteHD.extra_capabilities = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] QuobyteHD.filter_function = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] QuobyteHD.goodness_function = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] QuobyteHD.iser_helper = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] QuobyteHD.iser_ip_address = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] QuobyteHD.iser_port = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] QuobyteHD.iser_target_prefix = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] QuobyteHD.nas_host = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] QuobyteHD.nas_login = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] QuobyteHD.nas_mount_options = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] QuobyteHD.nas_password = **** {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] QuobyteHD.nas_private_key = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] QuobyteHD.nas_share_path = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] QuobyteHD.nas_ssh_port = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] QuobyteHD.num_shell_tries = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] QuobyteHD.nvmet_port_id = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] QuobyteHD.replication_device = **** {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] QuobyteHD.report_discard_supported = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] QuobyteHD.reserved_percentage = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] QuobyteHD.scst_target_driver = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] QuobyteHD.storage_protocol = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] QuobyteHD.target_helper = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] QuobyteHD.target_ip_address = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] QuobyteHD.target_port = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] QuobyteHD.target_prefix = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] QuobyteHD.target_protocol = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] QuobyteHD.trace_flags = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] QuobyteHD.use_chap_auth = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] QuobyteHD.volume_clear = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] QuobyteHD.volume_clear_size = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] QuobyteHD.volumes_dir = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] oslo_messaging_rabbit.ssl = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] oslo_messaging_notifications.driver = [] {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] oslo_messaging_notifications.retry = -1 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] key_manager.fixed_key = **** {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86996]: DEBUG cinder.volume.drivers.quobyte [None req-eb23c5cd-0c23-4b59-a526-3e589db61676 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86996) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Jul 22 03:12:58 devstack cinder-volume[86996]: WARNING cinder.volume.drivers.quobyte [None req-eb23c5cd-0c23-4b59-a526-3e589db61676 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 22 03:12:58 devstack cinder-volume[86996]: WARNING cinder.volume.drivers.quobyte [None req-eb23c5cd-0c23-4b59-a526-3e589db61676 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] barbican.barbican_api_version = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] barbican.barbican_endpoint = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] barbican.barbican_endpoint_type = public {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] barbican.barbican_region_name = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86996]: DEBUG oslo_concurrency.processutils [None req-eb23c5cd-0c23-4b59-a526-3e589db61676 None None] Running cmd (subprocess): mount.quobyte {{(pid=86996) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] barbican.cafile = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] barbican.certfile = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] barbican.collect_timing = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] barbican.insecure = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] barbican.keyfile = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] barbican.number_of_retries = 60 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] barbican.retry_delay = 1 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] barbican.send_service_user_token = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] barbican.split_loggers = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] barbican.timeout = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] barbican.verify_ssl = True {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] barbican.verify_ssl_path = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] barbican_service_user.auth_section = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] barbican_service_user.auth_type = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] barbican_service_user.cafile = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] barbican_service_user.certfile = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] barbican_service_user.collect_timing = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] barbican_service_user.insecure = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] barbican_service_user.keyfile = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] barbican_service_user.split_loggers = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] barbican_service_user.timeout = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] vault.approle_role_id = **** {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] vault.approle_secret_id = **** {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] vault.auth_method = approle {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] vault.auth_path = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] vault.kv_mountpoint = secret {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] vault.kv_path = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] vault.kv_version = 2 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] vault.namespace = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] vault.root_token_id = **** {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] vault.ssl_ca_crt_file = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] vault.timeout = 60.0 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] vault.token_file = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] vault.token_role = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] vault.use_ssl = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:12:58 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] ******************************************************************************** {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 22 03:12:58 devstack quobyte-client[87001]: Reading configuration file: /etc/quobyte/client.cfg Jul 22 03:12:58 devstack quobyte-client[87001]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 22 03:12:58 devstack cinder-volume[86996]: DEBUG oslo_concurrency.processutils [None req-eb23c5cd-0c23-4b59-a526-3e589db61676 None None] CMD "mount.quobyte" returned: 1 in 0.069s {{(pid=86996) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:12:58 devstack cinder-volume[86996]: DEBUG oslo_concurrency.lockutils [None req-eb23c5cd-0c23-4b59-a526-3e589db61676 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86996) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:12:58 devstack cinder-volume[86996]: DEBUG oslo_concurrency.lockutils [None req-eb23c5cd-0c23-4b59-a526-3e589db61676 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86996) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:12:58 devstack cinder-volume[86996]: DEBUG cinder.volume.drivers.quobyte [None req-eb23c5cd-0c23-4b59-a526-3e589db61676 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=86996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:12:58 devstack cinder-volume[86996]: INFO cinder.volume.drivers.quobyte [None req-eb23c5cd-0c23-4b59-a526-3e589db61676 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f ... Jul 22 03:12:58 devstack cinder-volume[86996]: DEBUG oslo_concurrency.processutils [None req-eb23c5cd-0c23-4b59-a526-3e589db61676 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a -c /etc/quobyte/client-cinder.cfg {{(pid=86996) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:12:58 devstack sudo[87003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a -c /etc/quobyte/client-cinder.cfg Jul 22 03:12:58 devstack sudo[87003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:12:59 devstack sudo[87003]: pam_unix(sudo:session): session closed for user root Jul 22 03:12:59 devstack cinder-volume[86996]: DEBUG oslo_concurrency.processutils [None req-eb23c5cd-0c23-4b59-a526-3e589db61676 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.369s {{(pid=86996) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:12:59 devstack cinder-volume[86996]: INFO cinder.volume.drivers.quobyte [None req-eb23c5cd-0c23-4b59-a526-3e589db61676 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f succeeded Jul 22 03:12:59 devstack cinder-volume[86996]: DEBUG cinder.volume.drivers.quobyte [None req-eb23c5cd-0c23-4b59-a526-3e589db61676 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=86996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:12:59 devstack cinder-volume[86996]: DEBUG oslo_concurrency.lockutils [None req-eb23c5cd-0c23-4b59-a526-3e589db61676 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.378s {{(pid=86996) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:12:59 devstack cinder-volume[86996]: DEBUG oslo_concurrency.processutils [None req-eb23c5cd-0c23-4b59-a526-3e589db61676 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=86996) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:12:59 devstack sudo[87073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:12:59 devstack sudo[87073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:12:59 devstack sudo[87073]: pam_unix(sudo:session): session closed for user root Jul 22 03:12:59 devstack cinder-volume[86996]: DEBUG oslo_concurrency.processutils [None req-eb23c5cd-0c23-4b59-a526-3e589db61676 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.239s {{(pid=86996) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:12:59 devstack cinder-volume[86996]: INFO cinder.volume.driver [None req-eb23c5cd-0c23-4b59-a526-3e589db61676 None None] Driver hasn't implemented _init_vendor_properties() Jul 22 03:12:59 devstack cinder-volume[86996]: DEBUG cinder.volume.driver [None req-eb23c5cd-0c23-4b59-a526-3e589db61676 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757713317871, 'free_capacity_gb': 1775.757713317871, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86996) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 22 03:12:59 devstack cinder-volume[86996]: DEBUG oslo_db.sqlalchemy.engines [None req-eb23c5cd-0c23-4b59-a526-3e589db61676 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86996) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 22 03:12:59 devstack cinder-volume[86996]: DEBUG dbcounter [-] [86996] Writer thread running {{(pid=86996) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 22 03:12:59 devstack cinder-volume[86996]: DEBUG cinder.db.api [None req-eb23c5cd-0c23-4b59-a526-3e589db61676 None None] Building query based on filter {{(pid=86996) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 22 03:12:59 devstack cinder-volume[86996]: DEBUG cinder.image.image_utils [None req-eb23c5cd-0c23-4b59-a526-3e589db61676 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86996) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 22 03:12:59 devstack cinder-volume[86996]: INFO cinder.keymgr.migration [None req-de972694-4747-4b31-bba5-28c128d75966 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 22 03:12:59 devstack cinder-volume[86996]: DEBUG oslo_concurrency.lockutils [None req-eb23c5cd-0c23-4b59-a526-3e589db61676 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86996) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:12:59 devstack cinder-volume[86996]: DEBUG oslo_concurrency.lockutils [None req-eb23c5cd-0c23-4b59-a526-3e589db61676 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86996) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:12:59 devstack cinder-volume[86996]: DEBUG cinder.volume.drivers.quobyte [None req-eb23c5cd-0c23-4b59-a526-3e589db61676 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=86996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:12:59 devstack cinder-volume[86996]: DEBUG cinder.volume.drivers.quobyte [None req-eb23c5cd-0c23-4b59-a526-3e589db61676 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=86996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:12:59 devstack cinder-volume[86996]: DEBUG oslo_concurrency.lockutils [None req-eb23c5cd-0c23-4b59-a526-3e589db61676 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86996) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:12:59 devstack cinder-volume[86996]: DEBUG oslo_concurrency.processutils [None req-eb23c5cd-0c23-4b59-a526-3e589db61676 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=86996) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:12:59 devstack sudo[87076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:12:59 devstack sudo[87076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:12:59 devstack sudo[87076]: pam_unix(sudo:session): session closed for user root Jul 22 03:12:59 devstack cinder-volume[86996]: DEBUG oslo_concurrency.processutils [None req-eb23c5cd-0c23-4b59-a526-3e589db61676 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.243s {{(pid=86996) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:12:59 devstack cinder-volume[86996]: DEBUG cinder.manager [None req-eb23c5cd-0c23-4b59-a526-3e589db61676 None None] Notifying Schedulers of capabilities ... {{(pid=86996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:12:59 devstack cinder-volume[86996]: INFO cinder.volume.manager [None req-eb23c5cd-0c23-4b59-a526-3e589db61676 None None] Driver initialization completed successfully. Jul 22 03:12:59 devstack cinder-volume[86996]: INFO cinder.manager [None req-eb23c5cd-0c23-4b59-a526-3e589db61676 None None] Initiating service 3 cleanup Jul 22 03:12:59 devstack cinder-volume[86996]: INFO cinder.manager [None req-eb23c5cd-0c23-4b59-a526-3e589db61676 None None] Service 3 cleanup completed. Jul 22 03:12:59 devstack cinder-volume[86996]: DEBUG cinder.service [None req-eb23c5cd-0c23-4b59-a526-3e589db61676 None None] Creating RPC server for service cinder-volume {{(pid=86996) start /opt/stack/cinder/cinder/service.py:231}} Jul 22 03:12:59 devstack cinder-volume[86996]: DEBUG cinder.service [None req-eb23c5cd-0c23-4b59-a526-3e589db61676 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86996) start /opt/stack/cinder/cinder/service.py:237}} Jul 22 03:12:59 devstack cinder-volume[86996]: INFO cinder.volume.manager [None req-eb23c5cd-0c23-4b59-a526-3e589db61676 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Jul 22 03:12:59 devstack cinder-volume[86996]: DEBUG oslo_concurrency.lockutils [None req-eb23c5cd-0c23-4b59-a526-3e589db61676 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86996) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:12:59 devstack cinder-volume[86996]: DEBUG oslo_concurrency.lockutils [None req-eb23c5cd-0c23-4b59-a526-3e589db61676 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86996) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:12:59 devstack cinder-volume[86996]: DEBUG cinder.volume.drivers.quobyte [None req-eb23c5cd-0c23-4b59-a526-3e589db61676 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=86996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:13:00 devstack cinder-volume[86996]: DEBUG cinder.volume.drivers.quobyte [None req-eb23c5cd-0c23-4b59-a526-3e589db61676 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=86996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:13:00 devstack cinder-volume[86996]: DEBUG oslo_concurrency.lockutils [None req-eb23c5cd-0c23-4b59-a526-3e589db61676 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86996) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:13:00 devstack cinder-volume[86996]: DEBUG oslo_concurrency.processutils [None req-eb23c5cd-0c23-4b59-a526-3e589db61676 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=86996) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:13:00 devstack sudo[87079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:13:00 devstack sudo[87079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:13:00 devstack sudo[87079]: pam_unix(sudo:session): session closed for user root Jul 22 03:13:00 devstack cinder-volume[86996]: DEBUG oslo_concurrency.processutils [None req-eb23c5cd-0c23-4b59-a526-3e589db61676 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.251s {{(pid=86996) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:13:00 devstack cinder-volume[86996]: INFO cinder.volume.manager [None req-eb23c5cd-0c23-4b59-a526-3e589db61676 None None] Driver post RPC initialization completed successfully. Jul 22 03:13:05 devstack cinder-volume[86996]: DEBUG oslo_concurrency.lockutils [None req-3f322ec3-19b5-4d54-a8db-dcae760af200 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86996) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:13:05 devstack cinder-volume[86996]: DEBUG oslo_concurrency.lockutils [None req-3f322ec3-19b5-4d54-a8db-dcae760af200 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86996) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:13:05 devstack cinder-volume[86996]: DEBUG cinder.volume.drivers.quobyte [None req-3f322ec3-19b5-4d54-a8db-dcae760af200 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=86996) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:13:05 devstack cinder-volume[86996]: DEBUG cinder.volume.drivers.quobyte [None req-3f322ec3-19b5-4d54-a8db-dcae760af200 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=86996) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:13:05 devstack cinder-volume[86996]: DEBUG oslo_concurrency.lockutils [None req-3f322ec3-19b5-4d54-a8db-dcae760af200 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86996) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:13:05 devstack cinder-volume[86996]: DEBUG oslo_concurrency.processutils [None req-3f322ec3-19b5-4d54-a8db-dcae760af200 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=86996) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:13:05 devstack sudo[87259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:13:05 devstack sudo[87259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:13:05 devstack sudo[87259]: pam_unix(sudo:session): session closed for user root Jul 22 03:13:05 devstack cinder-volume[86996]: DEBUG oslo_concurrency.processutils [None req-3f322ec3-19b5-4d54-a8db-dcae760af200 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.240s {{(pid=86996) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:13:05 devstack cinder-volume[86996]: DEBUG cinder.manager [None req-3f322ec3-19b5-4d54-a8db-dcae760af200 None None] Notifying Schedulers of capabilities ... {{(pid=86996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:13:07 devstack cinder-volume[86778]: INFO oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] Caught SIGTERM, stopping children Jul 22 03:13:07 devstack cinder-volume[86778]: DEBUG oslo_concurrency.lockutils [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] Acquiring lock "singleton_lock" {{(pid=86778) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 22 03:13:07 devstack cinder-volume[86778]: DEBUG oslo_concurrency.lockutils [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] Acquired lock "singleton_lock" {{(pid=86778) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 22 03:13:07 devstack cinder-volume[86778]: DEBUG oslo_concurrency.lockutils [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] Releasing lock "singleton_lock" {{(pid=86778) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 22 03:13:07 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] Stop services. {{(pid=86778) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 22 03:13:07 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] Killing children. {{(pid=86778) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 22 03:13:07 devstack cinder-volume[86778]: INFO oslo_service.backend._eventlet.service [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] Waiting on 1 children to exit Jul 22 03:13:09 devstack cinder-volume[86996]: DEBUG dbcounter [-] [86996] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=86996) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 03:13:10 devstack cinder-volume[86996]: DEBUG dbcounter [-] [86996] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=86996) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 03:13:12 devstack cinder-volume[86996]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Jul 22 03:13:13 devstack cinder-volume[87480]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 22 03:13:13 devstack cinder-volume[87480]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 22 03:13:13 devstack cinder-volume[87480]: we strongly recommend against using it for new projects. Jul 22 03:13:13 devstack cinder-volume[87480]: If you are already using Eventlet, we recommend migrating to a different Jul 22 03:13:13 devstack cinder-volume[87480]: framework. For more detail see Jul 22 03:13:13 devstack cinder-volume[87480]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 22 03:13:13 devstack cinder-volume[87480]: import eventlet # noqa Jul 22 03:13:13 devstack cinder-volume[86996]: DEBUG oslo_concurrency.lockutils [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] Acquiring lock "singleton_lock" {{(pid=86996) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 22 03:13:13 devstack cinder-volume[86996]: DEBUG oslo_concurrency.lockutils [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] Acquired lock "singleton_lock" {{(pid=86996) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 22 03:13:13 devstack cinder-volume[86996]: DEBUG oslo_concurrency.lockutils [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] Releasing lock "singleton_lock" {{(pid=86996) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 22 03:13:13 devstack cinder-volume[86996]: WARNING amqp [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 22 03:13:13 devstack cinder-volume[86996]: WARNING amqp [None req-6b396945-7471-4f58-9de8-de5b81a23182 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 22 03:13:16 devstack cinder-volume[87480]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87480) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 22 03:13:16 devstack cinder-volume[87480]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87480) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 22 03:13:16 devstack cinder-volume[87480]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87480) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 22 03:13:16 devstack cinder-volume[87480]: INFO dbcounter [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] Registered counter for database cinder Jul 22 03:13:16 devstack cinder-volume[87480]: DEBUG oslo_db.sqlalchemy.engines [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87480) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG dbcounter [-] [87480] Writer thread running {{(pid=87480) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 22 03:13:17 devstack cinder-volume[87480]: INFO cinder.rpc [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 22 03:13:17 devstack cinder-volume[87480]: INFO cinder.rpc [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_db.sqlalchemy.engines [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87480) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 22 03:13:17 devstack cinder-volume[87480]: INFO cinder.volume.manager [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] Determined volume DB was empty at startup. Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG cinder.volume.manager [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87480) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 22 03:13:17 devstack cinder-volume[87480]: WARNING stevedore.named [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 22 03:13:17 devstack cinder-volume[87480]: WARNING castellan.key_manager [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 22 03:13:17 devstack cinder-volume[87480]: WARNING cinder.keymgr.conf_key_mgr [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 22 03:13:17 devstack cinder-volume[87480]: INFO cinder.volume.manager [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_db.sqlalchemy.engines [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87480) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 22 03:13:17 devstack cinder-volume[87480]: INFO oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] Starting 1 workers Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] Started child 87747 {{(pid=87480) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] Full set of CONF: {{(pid=87480) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] ******************************************************************************** {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] Configuration options gathered from: {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] ================================================================================ {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] allow_availability_zone_fallback = False {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] allow_compression_on_image_upload = False {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] allowed_direct_url_schemes = [] {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87747]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] api_rate_limit = True {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] auth_strategy = keystone {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] backend_availability_zone = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] backend_host = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] backend_name = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] backend_stats_polling_interval = 60 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] backup_api_class = cinder.backup.api.API {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] backup_name_template = backup-%s {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] backup_use_same_host = False {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] backup_use_temp_snapshot = False {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] chap_password = **** {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] chap_username = {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] cinder_internal_tenant_project_id = 2da8a2d925a54c61bc1ec889fcf8681e {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] cinder_internal_tenant_user_id = 5888498861234ab183c53d66ce6a929b {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] cluster = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] compression_format = gzip {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] compute_api_class = cinder.compute.nova.API {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] config_dir = [] {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] config_source = [] {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] control_exchange = openstack {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] debug = True {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] default_availability_zone = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] default_group_type = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] default_volume_type = QuobyteHD {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] disk_geometry = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] driver_client_cert = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] driver_client_cert_key = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] driver_data_namespace = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] driver_ssl_cert_path = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] driver_ssl_cert_verify = False {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] driver_use_ssl = False {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] enable_new_services = True {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] enable_unsupported_driver = False {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] enabled_backends = ['QuobyteHD'] {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] enforce_multipath_for_image_xfer = False {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] filter_function = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] glance_api_insecure = False {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] glance_api_servers = ['http://192.168.122.165/image'] {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] glance_api_ssl_compression = False {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] glance_ca_certificates_file = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] glance_catalog_info = image:glance:publicURL {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] glance_certfile = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] glance_keyfile = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] glance_num_retries = 3 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] glance_request_timeout = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] goodness_function = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] graceful_shutdown_timeout = 5 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] group_api_class = cinder.group.api.API {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] host = devstack {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] image_compress_on_upload = True {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] image_conversion_address_space_limit = 1 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] image_conversion_cpu_limit = 60 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] image_conversion_disable = False {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] image_upload_use_cinder_backend = False {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] image_upload_use_internal_tenant = False {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] image_volume_cache_enabled = False {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] image_volume_cache_max_count = 0 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] image_volume_cache_max_size_gb = 0 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] init_host_max_objects_retrieval = 0 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] instance_format = [instance: %(uuid)s] {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] iscsi_target_flags = {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] iscsi_write_cache = on {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] iser_helper = tgtadm {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] iser_ip_address = 192.168.122.165 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] iser_port = 3260 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] log_color = False {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] log_config_append = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] log_dir = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] log_file = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] log_options = True {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] log_rotate_interval = 1 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] log_rotate_interval_type = days {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] log_rotation_type = none {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] max_age = 0 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] max_logfile_count = 30 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] max_logfile_size_mb = 200 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] max_over_subscription_ratio = 20.0 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] message_reap_interval = 86400 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] message_ttl = 2592000 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-85a6e492-02f0-4264-9743-58b16cb3b7b9 None None] Starting volume driver QuobyteDriver (1.2) Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] migration_create_volume_timeout_secs = 300 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-85a6e492-02f0-4264-9743-58b16cb3b7b9 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87747) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] monkey_patch = False {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] monkey_patch_modules = [] {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] my_ip = 192.168.122.165 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] no_snapshot_gb_quota = False {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] num_iser_scan_tries = 3 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] num_shell_tries = 3 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] num_volume_device_scan_tries = 3 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] nvmeof_conn_info_version = 1 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] nvmet_ns_id = 10 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] nvmet_port_id = 1 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] osapi_max_limit = 1000 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] osapi_volume_ext_list = [] {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] osapi_volume_listen = 0.0.0.0 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] osapi_volume_listen_port = 8776 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] osapi_volume_use_ssl = False {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] osapi_volume_workers = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] per_volume_size_limit = -1 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] periodic_fuzzy_delay = 60 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] periodic_interval = 60 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] project_id_regex = [0-9a-f\-]+ {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] public_endpoint = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] publish_errors = False {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] quota_backup_gigabytes = 1000 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] quota_backups = 10 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] quota_gigabytes = 1000 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] quota_groups = 10 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] quota_snapshots = 10 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] quota_volumes = 10 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] rate_limit_burst = 0 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] rate_limit_except_level = CRITICAL {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] rate_limit_interval = 0 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] reinit_driver_count = 3 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] replication_device = **** {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] report_discard_supported = False {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] report_interval = 120 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] reservation_clean_interval = 86400 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] reservation_expire = 86400 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] reserved_image_namespaces = [] {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] reserved_percentage = 0 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] rpc_response_timeout = 120 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] run_external_periodic_tasks = True {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] scst_target_driver = iscsi {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] scst_target_iqn_name = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] service_down_time = 720 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] shell_completion = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] snapshot_name_template = snapshot-%s {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] split_loggers = False {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] state_path = /opt/stack/data/cinder {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] storage_availability_zone = nova {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] storage_protocol = iSCSI {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] syslog_log_facility = LOG_USER {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] target_helper = lioadm {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] target_ip_address = 192.168.122.165 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] target_port = 3260 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] target_protocol = iscsi {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] target_secondary_ip_addresses = [] {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] trace_flags = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] transfer_api_class = cinder.transfer.api.API {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] transport_url = **** {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] until_refresh = 0 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] use_chap_auth = False {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] use_default_quota_class = True {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] use_journal = False {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] use_json = False {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] use_multipath_for_image_xfer = False {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] use_stderr = False {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] use_syslog = False {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] verify_glance_signatures = enabled {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] volume_api_class = cinder.volume.api.API {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] volume_backend_name = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] volume_clear = zero {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] volume_clear_ionice = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] volume_clear_size = 0 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] volume_copy_bps_limit = 0 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] volume_dd_blocksize = 1M {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] volume_name_template = volume-%s {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] volume_service_inithost_offload = False {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] volume_usage_audit_period = month {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] zoning_mode = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] oslo_concurrency.disable_process_locking = False {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] keystone_authtoken.auth_section = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] keystone_authtoken.auth_type = password {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] keystone_authtoken.auth_version = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] keystone_authtoken.cache = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] keystone_authtoken.certfile = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] keystone_authtoken.delay_auth_decision = False {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] keystone_authtoken.http_connect_timeout = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] keystone_authtoken.include_service_catalog = True {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] keystone_authtoken.insecure = False {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] keystone_authtoken.interface = public {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] keystone_authtoken.keyfile = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] keystone_authtoken.memcache_password = {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] keystone_authtoken.memcache_username = {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] keystone_authtoken.region_name = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] keystone_authtoken.service_token_roles_required = True {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] keystone_authtoken.service_type = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] keystone_authtoken.token_cache_time = 300 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.165/identity {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] cache.backend = dogpile.cache.null {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] cache.backend_argument = **** {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] cache.backend_expiration_time = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] cache.config_prefix = cache.oslo {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] cache.debug_cache_backend = False {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] cache.enable_retry_client = False {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] cache.enable_socket_keepalive = False {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] cache.enabled = False {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] cache.expiration_time = 600 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] cache.hashclient_retry_attempts = 2 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] cache.memcache_dead_retry = 300 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] cache.memcache_pool_maxsize = 10 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] cache.memcache_sasl_enabled = False {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] cache.password = **** {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] cache.proxies = [] {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] cache.redis_db = 0 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] cache.redis_sentinel_service_name = mymaster {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] cache.redis_server = localhost:6379 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-85a6e492-02f0-4264-9743-58b16cb3b7b9 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87747) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Jul 22 03:13:17 devstack cinder-volume[87747]: WARNING cinder.volume.drivers.quobyte [None req-85a6e492-02f0-4264-9743-58b16cb3b7b9 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] cache.retry_attempts = 2 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] cache.retry_delay = 0.0 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] cache.socket_keepalive_count = 1 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] cache.socket_keepalive_idle = 1 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] cache.socket_keepalive_interval = 1 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] cache.socket_timeout = 1.0 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] cache.tls_allowed_ciphers = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87747]: WARNING cinder.volume.drivers.quobyte [None req-85a6e492-02f0-4264-9743-58b16cb3b7b9 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] cache.tls_cafile = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] cache.tls_certfile = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] cache.tls_enabled = False {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] cache.tls_keyfile = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] cache.username = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-85a6e492-02f0-4264-9743-58b16cb3b7b9 None None] Running cmd (subprocess): mount.quobyte {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] coordination.backend_url = **** {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] database.asyncio_connection = **** {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] database.asyncio_slave_connection = **** {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] database.backend = sqlalchemy {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] database.connection = **** {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] database.connection_debug = 0 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] database.connection_parameters = {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] database.connection_recycle_time = 3600 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] database.connection_trace = False {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] database.db_inc_retry_interval = True {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] database.db_max_retries = 20 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] database.db_max_retry_interval = 10 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] database.db_retry_interval = 1 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] database.max_overflow = 50 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] database.max_pool_size = 5 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] database.max_retries = 10 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] database.mysql_wsrep_sync_wait = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] database.pool_timeout = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] database.retry_interval = 10 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] database.slave_connection = **** {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] database.sqlite_synchronous = True {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] database.synchronous_reader = True {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] database.use_db_reconnect = False {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] profiler.connection_string = messaging:// {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] profiler.enabled = False {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] profiler.es_doc_type = notification {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] profiler.es_scroll_size = 10000 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] profiler.es_scroll_time = 2m {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] profiler.filter_error_trace = False {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] profiler.hmac_keys = **** {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] profiler.sentinel_service_name = mymaster {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] profiler.socket_timeout = 0.1 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] profiler.trace_requests = False {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] profiler.trace_sqlalchemy = False {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] profiler_jaeger.process_tags = {} {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] profiler_jaeger.service_name_prefix = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] profiler_otlp.service_name_prefix = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] oslo_policy.enforce_new_defaults = True {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] oslo_policy.policy_default_rule = default {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] oslo_policy.policy_file = policy.yaml {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] oslo_policy.remote_timeout = 60.0 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] privsep_osbrick.group = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] privsep_osbrick.helper_command = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] privsep_osbrick.user = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] cinder_sys_admin.group = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] cinder_sys_admin.helper_command = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] cinder_sys_admin.user = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] service_user.auth_section = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] service_user.auth_type = password {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] service_user.cafile = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] service_user.certfile = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] service_user.collect_timing = False {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] service_user.insecure = False {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] service_user.keyfile = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] service_user.send_service_user_token = True {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] service_user.split_loggers = False {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] service_user.timeout = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] glance.auth_section = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] glance.auth_type = password {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] glance.certfile = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] glance.collect_timing = False {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] glance.insecure = False {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] glance.keyfile = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] glance.region_name = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] glance.split_loggers = False {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] glance.timeout = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] backend_defaults.backend_availability_zone = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] backend_defaults.chap_password = **** {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] backend_defaults.chap_username = {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] backend_defaults.disk_geometry = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] backend_defaults.driver_client_cert = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] backend_defaults.driver_client_cert_key = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] backend_defaults.driver_data_namespace = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] backend_defaults.driver_use_ssl = False {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] backend_defaults.enable_unsupported_driver = False {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] backend_defaults.extra_capabilities = {} {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] backend_defaults.filter_function = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] backend_defaults.goodness_function = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] backend_defaults.iscsi_target_flags = {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] backend_defaults.iscsi_write_cache = on {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] backend_defaults.iser_helper = tgtadm {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] backend_defaults.iser_ip_address = 192.168.122.165 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] backend_defaults.iser_port = 3260 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] backend_defaults.nas_host = {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] backend_defaults.nas_login = admin {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] backend_defaults.nas_mount_options = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] backend_defaults.nas_password = **** {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] backend_defaults.nas_private_key = {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] backend_defaults.nas_share_path = {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] backend_defaults.nas_ssh_port = 22 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] backend_defaults.num_shell_tries = 3 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] backend_defaults.nvmet_port_id = 1 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] backend_defaults.quobyte_client_cfg = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] backend_defaults.quobyte_volume_url = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] backend_defaults.replication_device = **** {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] backend_defaults.report_discard_supported = False {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] backend_defaults.reserved_percentage = 0 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] backend_defaults.scst_target_driver = iscsi {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] backend_defaults.scst_target_iqn_name = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] backend_defaults.storage_protocol = iSCSI {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] backend_defaults.target_helper = tgtadm {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] backend_defaults.target_ip_address = 192.168.122.165 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] backend_defaults.target_port = 3260 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] backend_defaults.target_protocol = iscsi {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] backend_defaults.trace_flags = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] backend_defaults.unique_fqdn_network = True {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] backend_defaults.use_chap_auth = False {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] backend_defaults.volume_backend_name = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] backend_defaults.volume_clear = zero {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] backend_defaults.volume_clear_ionice = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] backend_defaults.volume_clear_size = 0 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack quobyte-client[87748]: Reading configuration file: /etc/quobyte/client.cfg Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack quobyte-client[87748]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] oslo_reports.file_event_handler = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] oslo_reports.log_dir = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] QuobyteHD.backend_availability_zone = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] QuobyteHD.backend_host = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] QuobyteHD.chap_password = **** {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-85a6e492-02f0-4264-9743-58b16cb3b7b9 None None] CMD "mount.quobyte" returned: 1 in 0.066s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] QuobyteHD.chap_username = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] QuobyteHD.chiscsi_conf = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-85a6e492-02f0-4264-9743-58b16cb3b7b9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] QuobyteHD.disk_geometry = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-85a6e492-02f0-4264-9743-58b16cb3b7b9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] QuobyteHD.driver_client_cert = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-85a6e492-02f0-4264-9743-58b16cb3b7b9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] QuobyteHD.driver_client_cert_key = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] QuobyteHD.driver_data_namespace = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] QuobyteHD.driver_use_ssl = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] QuobyteHD.extra_capabilities = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] QuobyteHD.filter_function = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] QuobyteHD.goodness_function = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] QuobyteHD.iscsi_target_flags = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] QuobyteHD.iscsi_write_cache = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] QuobyteHD.iser_helper = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] QuobyteHD.iser_ip_address = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] QuobyteHD.iser_port = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] QuobyteHD.iser_target_prefix = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-85a6e492-02f0-4264-9743-58b16cb3b7b9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] QuobyteHD.nas_host = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-85a6e492-02f0-4264-9743-58b16cb3b7b9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] QuobyteHD.nas_login = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] QuobyteHD.nas_mount_options = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-85a6e492-02f0-4264-9743-58b16cb3b7b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] QuobyteHD.nas_password = **** {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] QuobyteHD.nas_private_key = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] QuobyteHD.nas_share_path = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] QuobyteHD.nas_ssh_port = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] QuobyteHD.num_shell_tries = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] QuobyteHD.nvmet_ns_id = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] QuobyteHD.nvmet_port_id = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] QuobyteHD.replication_device = **** {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] QuobyteHD.report_discard_supported = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] QuobyteHD.reserved_percentage = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] QuobyteHD.scst_target_driver = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] QuobyteHD.storage_protocol = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] QuobyteHD.target_helper = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] QuobyteHD.target_ip_address = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] QuobyteHD.target_port = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] QuobyteHD.target_prefix = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] QuobyteHD.target_protocol = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] QuobyteHD.trace_flags = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] QuobyteHD.unique_fqdn_network = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] QuobyteHD.use_chap_auth = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] QuobyteHD.volume_clear = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] QuobyteHD.volume_clear_ionice = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] QuobyteHD.volume_clear_size = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] QuobyteHD.volumes_dir = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack sudo[87749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack sudo[87749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] oslo_messaging_rabbit.ssl = False {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] oslo_messaging_rabbit.ssl_version = {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] oslo_messaging_notifications.driver = [] {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] oslo_messaging_notifications.retry = -1 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] oslo_messaging_notifications.transport_url = **** {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] key_manager.fixed_key = **** {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] barbican.barbican_api_version = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] barbican.barbican_endpoint = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] barbican.barbican_endpoint_type = public {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] barbican.barbican_region_name = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] barbican.cafile = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] barbican.certfile = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] barbican.collect_timing = False {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] barbican.insecure = False {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] barbican.keyfile = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] barbican.number_of_retries = 60 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] barbican.retry_delay = 1 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] barbican.send_service_user_token = False {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] barbican.split_loggers = False {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] barbican.timeout = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] barbican.verify_ssl = True {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] barbican.verify_ssl_path = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] barbican_service_user.auth_section = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] barbican_service_user.auth_type = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] barbican_service_user.cafile = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] barbican_service_user.certfile = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] barbican_service_user.collect_timing = False {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] barbican_service_user.insecure = False {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] barbican_service_user.keyfile = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] barbican_service_user.split_loggers = False {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] barbican_service_user.timeout = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] vault.approle_role_id = **** {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] vault.approle_secret_id = **** {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] vault.auth_method = approle {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] vault.auth_path = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] vault.kv_mountpoint = secret {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] vault.kv_path = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] vault.kv_version = 2 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] vault.namespace = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] vault.root_token_id = **** {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] vault.ssl_ca_crt_file = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] vault.timeout = 60.0 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] vault.token_file = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] vault.token_role = None {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] vault.use_ssl = False {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 03:13:17 devstack cinder-volume[87480]: DEBUG oslo_service.backend._eventlet.service [None req-2986b772-ca72-473f-bc46-c1927e05f454 None None] ******************************************************************************** {{(pid=87480) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 22 03:13:17 devstack sudo[87749]: pam_unix(sudo:session): session closed for user root Jul 22 03:13:17 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-85a6e492-02f0-4264-9743-58b16cb3b7b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.233s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:13:17 devstack cinder-volume[87747]: INFO cinder.volume.driver [None req-85a6e492-02f0-4264-9743-58b16cb3b7b9 None None] Driver hasn't implemented _init_vendor_properties() Jul 22 03:13:17 devstack cinder-volume[87747]: DEBUG cinder.volume.driver [None req-85a6e492-02f0-4264-9743-58b16cb3b7b9 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757713317871, 'free_capacity_gb': 1775.757713317871, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87747) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 22 03:13:17 devstack cinder-volume[87747]: DEBUG oslo_db.sqlalchemy.engines [None req-85a6e492-02f0-4264-9743-58b16cb3b7b9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87747) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 22 03:13:17 devstack cinder-volume[87747]: DEBUG dbcounter [-] [87747] Writer thread running {{(pid=87747) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 22 03:13:17 devstack cinder-volume[87747]: DEBUG cinder.db.api [None req-85a6e492-02f0-4264-9743-58b16cb3b7b9 None None] Building query based on filter {{(pid=87747) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 22 03:13:17 devstack cinder-volume[87747]: DEBUG cinder.image.image_utils [None req-85a6e492-02f0-4264-9743-58b16cb3b7b9 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87747) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 22 03:13:17 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-85a6e492-02f0-4264-9743-58b16cb3b7b9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:13:17 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-85a6e492-02f0-4264-9743-58b16cb3b7b9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:13:17 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-85a6e492-02f0-4264-9743-58b16cb3b7b9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:13:17 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-85a6e492-02f0-4264-9743-58b16cb3b7b9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:13:17 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-85a6e492-02f0-4264-9743-58b16cb3b7b9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:13:17 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-85a6e492-02f0-4264-9743-58b16cb3b7b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:13:17 devstack cinder-volume[87747]: INFO cinder.keymgr.migration [None req-50e2264e-ab0d-4a4e-bc83-e2cb9f9a737f None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 22 03:13:17 devstack sudo[87752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:13:17 devstack sudo[87752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:13:18 devstack sudo[87752]: pam_unix(sudo:session): session closed for user root Jul 22 03:13:18 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-85a6e492-02f0-4264-9743-58b16cb3b7b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.228s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:13:18 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-85a6e492-02f0-4264-9743-58b16cb3b7b9 None None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:13:18 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-85a6e492-02f0-4264-9743-58b16cb3b7b9 None None] Driver initialization completed successfully. Jul 22 03:13:18 devstack cinder-volume[87747]: INFO cinder.manager [None req-85a6e492-02f0-4264-9743-58b16cb3b7b9 None None] Initiating service 3 cleanup Jul 22 03:13:18 devstack cinder-volume[87747]: INFO cinder.manager [None req-85a6e492-02f0-4264-9743-58b16cb3b7b9 None None] Service 3 cleanup completed. Jul 22 03:13:18 devstack cinder-volume[87747]: DEBUG cinder.service [None req-85a6e492-02f0-4264-9743-58b16cb3b7b9 None None] Creating RPC server for service cinder-volume {{(pid=87747) start /opt/stack/cinder/cinder/service.py:231}} Jul 22 03:13:18 devstack cinder-volume[87747]: DEBUG cinder.service [None req-85a6e492-02f0-4264-9743-58b16cb3b7b9 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87747) start /opt/stack/cinder/cinder/service.py:237}} Jul 22 03:13:18 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-85a6e492-02f0-4264-9743-58b16cb3b7b9 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Jul 22 03:13:18 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-85a6e492-02f0-4264-9743-58b16cb3b7b9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:13:18 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-85a6e492-02f0-4264-9743-58b16cb3b7b9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:13:18 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-85a6e492-02f0-4264-9743-58b16cb3b7b9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:13:18 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-85a6e492-02f0-4264-9743-58b16cb3b7b9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:13:18 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-85a6e492-02f0-4264-9743-58b16cb3b7b9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:13:18 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-85a6e492-02f0-4264-9743-58b16cb3b7b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:13:18 devstack sudo[87757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:13:18 devstack sudo[87757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:13:18 devstack sudo[87757]: pam_unix(sudo:session): session closed for user root Jul 22 03:13:18 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-85a6e492-02f0-4264-9743-58b16cb3b7b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.225s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:13:18 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-85a6e492-02f0-4264-9743-58b16cb3b7b9 None None] Driver post RPC initialization completed successfully. Jul 22 03:13:22 devstack cinder-volume[87747]: DEBUG oslo_service.periodic_task [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Running periodic task VolumeManager._thread_info {{(pid=87747) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 03:13:22 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] thread count: 6 {{(pid=87747) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 22 03:13:22 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] thread info: [<_MainThread(MainThread, started 132775275860096)>, , , , , ] {{(pid=87747) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 22 03:13:27 devstack cinder-volume[87480]: DEBUG dbcounter [-] [87480] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87480) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 03:13:28 devstack cinder-volume[87747]: DEBUG dbcounter [-] [87747] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=87747) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 03:13:28 devstack cinder-volume[87747]: DEBUG dbcounter [-] [87747] Writing DB stats cinder:SELECT=2 {{(pid=87747) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 03:14:22 devstack cinder-volume[87747]: DEBUG oslo_service.periodic_task [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87747) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 03:14:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:14:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:14:22 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:14:22 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:14:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:14:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:14:22 devstack sudo[87976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:14:22 devstack sudo[87976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:14:22 devstack sudo[87976]: pam_unix(sudo:session): session closed for user root Jul 22 03:14:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.427s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:14:22 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:14:22 devstack cinder-volume[87747]: DEBUG oslo_service.periodic_task [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Running periodic task VolumeManager._thread_info {{(pid=87747) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 03:14:22 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] thread count: 6 {{(pid=87747) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 22 03:14:22 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] thread info: [<_MainThread(MainThread, started 132775275860096)>, , , , , ] {{(pid=87747) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 22 03:14:23 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-d63a02f9-40a2-4350-9292-fb72ffb6eee5 tempest-TaggedAttachmentsTest-601058941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:14:23 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-d63a02f9-40a2-4350-9292-fb72ffb6eee5 tempest-TaggedAttachmentsTest-601058941 None] Flow 'volume_create_manager' (3a2a914c-fe64-414e-9fe1-50cdeaa43f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:14:23 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-d63a02f9-40a2-4350-9292-fb72ffb6eee5 tempest-TaggedAttachmentsTest-601058941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cfa070c-dfa3-48b1-b057-5f2b5601dbc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:14:24 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-d63a02f9-40a2-4350-9292-fb72ffb6eee5 tempest-TaggedAttachmentsTest-601058941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cfa070c-dfa3-48b1-b057-5f2b5601dbc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:14:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1232256650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f04fe48c-f2a2-4078-9a0a-5b2be0d98bde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1094252857e14030bbd5f43b367cdb05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:14:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:14:24Z,use_quota=True,user_id='7ca93eb2a1af4046adfa4add3820616b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:14:24 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-d63a02f9-40a2-4350-9292-fb72ffb6eee5 tempest-TaggedAttachmentsTest-601058941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (206ba9ef-7267-4501-82cc-a34a04dc44df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:14:24 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-d63a02f9-40a2-4350-9292-fb72ffb6eee5 tempest-TaggedAttachmentsTest-601058941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (206ba9ef-7267-4501-82cc-a34a04dc44df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:14:24 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-d63a02f9-40a2-4350-9292-fb72ffb6eee5 tempest-TaggedAttachmentsTest-601058941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0e09c98-b024-4135-bb15-e0f28f52e7a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:14:24 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-d63a02f9-40a2-4350-9292-fb72ffb6eee5 tempest-TaggedAttachmentsTest-601058941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0e09c98-b024-4135-bb15-e0f28f52e7a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f04fe48c-f2a2-4078-9a0a-5b2be0d98bde', 'volume_name': 'volume-f04fe48c-f2a2-4078-9a0a-5b2be0d98bde', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:14:24 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-d63a02f9-40a2-4350-9292-fb72ffb6eee5 tempest-TaggedAttachmentsTest-601058941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9d59957-47b7-4102-8c9b-609cb8176be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:14:24 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-d63a02f9-40a2-4350-9292-fb72ffb6eee5 tempest-TaggedAttachmentsTest-601058941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9d59957-47b7-4102-8c9b-609cb8176be8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:14:24 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-d63a02f9-40a2-4350-9292-fb72ffb6eee5 tempest-TaggedAttachmentsTest-601058941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (934ecfd7-da79-4d63-bf1c-45ff5b833ec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:14:24 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-d63a02f9-40a2-4350-9292-fb72ffb6eee5 tempest-TaggedAttachmentsTest-601058941 None] Volume f04fe48c-f2a2-4078-9a0a-5b2be0d98bde: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f04fe48c-f2a2-4078-9a0a-5b2be0d98bde', 'volume_size': 1} Jul 22 03:14:24 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-d63a02f9-40a2-4350-9292-fb72ffb6eee5 tempest-TaggedAttachmentsTest-601058941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:14:24 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-d63a02f9-40a2-4350-9292-fb72ffb6eee5 tempest-TaggedAttachmentsTest-601058941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:14:24 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-d63a02f9-40a2-4350-9292-fb72ffb6eee5 tempest-TaggedAttachmentsTest-601058941 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:14:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1232256650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f04fe48c-f2a2-4078-9a0a-5b2be0d98bde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1094252857e14030bbd5f43b367cdb05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:14:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:14:24Z,use_quota=True,user_id='7ca93eb2a1af4046adfa4add3820616b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:14:24 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-d63a02f9-40a2-4350-9292-fb72ffb6eee5 tempest-TaggedAttachmentsTest-601058941 None] Creating volume f04fe48c-f2a2-4078-9a0a-5b2be0d98bde {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:14:24 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-d63a02f9-40a2-4350-9292-fb72ffb6eee5 tempest-TaggedAttachmentsTest-601058941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:14:24 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-d63a02f9-40a2-4350-9292-fb72ffb6eee5 tempest-TaggedAttachmentsTest-601058941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:14:24 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-d63a02f9-40a2-4350-9292-fb72ffb6eee5 tempest-TaggedAttachmentsTest-601058941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:14:24 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-d63a02f9-40a2-4350-9292-fb72ffb6eee5 tempest-TaggedAttachmentsTest-601058941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:14:24 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-d63a02f9-40a2-4350-9292-fb72ffb6eee5 tempest-TaggedAttachmentsTest-601058941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:14:24 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-d63a02f9-40a2-4350-9292-fb72ffb6eee5 tempest-TaggedAttachmentsTest-601058941 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:14:24 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-d63a02f9-40a2-4350-9292-fb72ffb6eee5 tempest-TaggedAttachmentsTest-601058941 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:14:24 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d63a02f9-40a2-4350-9292-fb72ffb6eee5 tempest-TaggedAttachmentsTest-601058941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-f04fe48c-f2a2-4078-9a0a-5b2be0d98bde 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:14:24 devstack sudo[88003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-f04fe48c-f2a2-4078-9a0a-5b2be0d98bde 1073741824 Jul 22 03:14:24 devstack sudo[88003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:14:24 devstack sudo[88003]: pam_unix(sudo:session): session closed for user root Jul 22 03:14:24 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d63a02f9-40a2-4350-9292-fb72ffb6eee5 tempest-TaggedAttachmentsTest-601058941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-f04fe48c-f2a2-4078-9a0a-5b2be0d98bde 1073741824" returned: 0 in 0.739s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:14:24 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d63a02f9-40a2-4350-9292-fb72ffb6eee5 tempest-TaggedAttachmentsTest-601058941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-f04fe48c-f2a2-4078-9a0a-5b2be0d98bde {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:14:24 devstack sudo[88331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-f04fe48c-f2a2-4078-9a0a-5b2be0d98bde Jul 22 03:14:24 devstack sudo[88331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:14:25 devstack sudo[88331]: pam_unix(sudo:session): session closed for user root Jul 22 03:14:25 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d63a02f9-40a2-4350-9292-fb72ffb6eee5 tempest-TaggedAttachmentsTest-601058941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-f04fe48c-f2a2-4078-9a0a-5b2be0d98bde" returned: 0 in 0.395s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:14:25 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-d63a02f9-40a2-4350-9292-fb72ffb6eee5 tempest-TaggedAttachmentsTest-601058941 None] <== create_volume: return (1241ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:14:25 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-d63a02f9-40a2-4350-9292-fb72ffb6eee5 tempest-TaggedAttachmentsTest-601058941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.243s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:14:25 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-d63a02f9-40a2-4350-9292-fb72ffb6eee5 tempest-TaggedAttachmentsTest-601058941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (934ecfd7-da79-4d63-bf1c-45ff5b833ec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f04fe48c-f2a2-4078-9a0a-5b2be0d98bde', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:14:25 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-d63a02f9-40a2-4350-9292-fb72ffb6eee5 tempest-TaggedAttachmentsTest-601058941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5b2d153-c209-4569-b4b7-99671f9db53a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:14:25 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-d63a02f9-40a2-4350-9292-fb72ffb6eee5 tempest-TaggedAttachmentsTest-601058941 None] Volume volume-f04fe48c-f2a2-4078-9a0a-5b2be0d98bde (f04fe48c-f2a2-4078-9a0a-5b2be0d98bde): created successfully Jul 22 03:14:25 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-d63a02f9-40a2-4350-9292-fb72ffb6eee5 tempest-TaggedAttachmentsTest-601058941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5b2d153-c209-4569-b4b7-99671f9db53a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:14:25 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-d63a02f9-40a2-4350-9292-fb72ffb6eee5 tempest-TaggedAttachmentsTest-601058941 None] Flow 'volume_create_manager' (3a2a914c-fe64-414e-9fe1-50cdeaa43f5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:14:25 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-d63a02f9-40a2-4350-9292-fb72ffb6eee5 tempest-TaggedAttachmentsTest-601058941 None] Created volume successfully. Jul 22 03:14:35 devstack cinder-volume[87747]: DEBUG dbcounter [-] [87747] Writing DB stats cinder:SELECT=1,cinder:UPDATE=4,cinder:INSERT=1 {{(pid=87747) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 03:14:35 devstack cinder-volume[87747]: DEBUG dbcounter [-] [87747] Writing DB stats cinder:UPDATE=2,cinder:SELECT=3,cinder:DELETE=1 {{(pid=87747) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 03:14:41 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-819e494c-9aa0-4095-b834-79d23d29420a tempest-VolumesAdminNegativeTest-1213518815 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:14:41 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-819e494c-9aa0-4095-b834-79d23d29420a tempest-VolumesAdminNegativeTest-1213518815 None] Flow 'volume_create_manager' (96d23c56-8eab-4020-a833-1779303abd73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:14:41 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-819e494c-9aa0-4095-b834-79d23d29420a tempest-VolumesAdminNegativeTest-1213518815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff2df9d2-ee75-4459-8c1e-579e95cc1a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:14:41 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-819e494c-9aa0-4095-b834-79d23d29420a tempest-VolumesAdminNegativeTest-1213518815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff2df9d2-ee75-4459-8c1e-579e95cc1a87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:14:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-849767359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b75b7a1a-101f-452f-b155-5d8db98da380,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72e9eb5126a74d99a033c220b66339f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:14:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:14:41Z,use_quota=True,user_id='580427c382e74ea29f733a52b37e543a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:14:41 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-819e494c-9aa0-4095-b834-79d23d29420a tempest-VolumesAdminNegativeTest-1213518815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa26e56b-a80e-4f31-96f0-e195b0883a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:14:41 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-819e494c-9aa0-4095-b834-79d23d29420a tempest-VolumesAdminNegativeTest-1213518815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa26e56b-a80e-4f31-96f0-e195b0883a54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:14:41 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-819e494c-9aa0-4095-b834-79d23d29420a tempest-VolumesAdminNegativeTest-1213518815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c710401-75c4-4f69-9179-9ff9a4c57206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:14:41 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-819e494c-9aa0-4095-b834-79d23d29420a tempest-VolumesAdminNegativeTest-1213518815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c710401-75c4-4f69-9179-9ff9a4c57206) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b75b7a1a-101f-452f-b155-5d8db98da380', 'volume_name': 'volume-b75b7a1a-101f-452f-b155-5d8db98da380', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:14:41 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-819e494c-9aa0-4095-b834-79d23d29420a tempest-VolumesAdminNegativeTest-1213518815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa5adb40-4cd6-40c8-8b43-84e7194ff626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:14:41 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-819e494c-9aa0-4095-b834-79d23d29420a tempest-VolumesAdminNegativeTest-1213518815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa5adb40-4cd6-40c8-8b43-84e7194ff626) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:14:41 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-819e494c-9aa0-4095-b834-79d23d29420a tempest-VolumesAdminNegativeTest-1213518815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b8423e4-4823-4ce8-b69e-1a645943b2c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:14:41 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-819e494c-9aa0-4095-b834-79d23d29420a tempest-VolumesAdminNegativeTest-1213518815 None] Volume b75b7a1a-101f-452f-b155-5d8db98da380: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b75b7a1a-101f-452f-b155-5d8db98da380', 'volume_size': 1} Jul 22 03:14:41 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-819e494c-9aa0-4095-b834-79d23d29420a tempest-VolumesAdminNegativeTest-1213518815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:14:41 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-819e494c-9aa0-4095-b834-79d23d29420a tempest-VolumesAdminNegativeTest-1213518815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:14:41 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-819e494c-9aa0-4095-b834-79d23d29420a tempest-VolumesAdminNegativeTest-1213518815 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:14:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-849767359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b75b7a1a-101f-452f-b155-5d8db98da380,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72e9eb5126a74d99a033c220b66339f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:14:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:14:41Z,use_quota=True,user_id='580427c382e74ea29f733a52b37e543a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:14:41 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-819e494c-9aa0-4095-b834-79d23d29420a tempest-VolumesAdminNegativeTest-1213518815 None] Creating volume b75b7a1a-101f-452f-b155-5d8db98da380 {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:14:41 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-819e494c-9aa0-4095-b834-79d23d29420a tempest-VolumesAdminNegativeTest-1213518815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:14:41 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-819e494c-9aa0-4095-b834-79d23d29420a tempest-VolumesAdminNegativeTest-1213518815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:14:41 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-819e494c-9aa0-4095-b834-79d23d29420a tempest-VolumesAdminNegativeTest-1213518815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:14:41 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-819e494c-9aa0-4095-b834-79d23d29420a tempest-VolumesAdminNegativeTest-1213518815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:14:41 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-819e494c-9aa0-4095-b834-79d23d29420a tempest-VolumesAdminNegativeTest-1213518815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:14:41 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-819e494c-9aa0-4095-b834-79d23d29420a tempest-VolumesAdminNegativeTest-1213518815 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:14:41 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-819e494c-9aa0-4095-b834-79d23d29420a tempest-VolumesAdminNegativeTest-1213518815 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:14:41 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-819e494c-9aa0-4095-b834-79d23d29420a tempest-VolumesAdminNegativeTest-1213518815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b75b7a1a-101f-452f-b155-5d8db98da380 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:14:41 devstack sudo[88556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b75b7a1a-101f-452f-b155-5d8db98da380 1073741824 Jul 22 03:14:41 devstack sudo[88556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:14:42 devstack sudo[88556]: pam_unix(sudo:session): session closed for user root Jul 22 03:14:42 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-819e494c-9aa0-4095-b834-79d23d29420a tempest-VolumesAdminNegativeTest-1213518815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b75b7a1a-101f-452f-b155-5d8db98da380 1073741824" returned: 0 in 1.148s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:14:42 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-819e494c-9aa0-4095-b834-79d23d29420a tempest-VolumesAdminNegativeTest-1213518815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b75b7a1a-101f-452f-b155-5d8db98da380 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:14:42 devstack sudo[88563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b75b7a1a-101f-452f-b155-5d8db98da380 Jul 22 03:14:42 devstack sudo[88563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:14:43 devstack sudo[88563]: pam_unix(sudo:session): session closed for user root Jul 22 03:14:43 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-819e494c-9aa0-4095-b834-79d23d29420a tempest-VolumesAdminNegativeTest-1213518815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b75b7a1a-101f-452f-b155-5d8db98da380" returned: 0 in 0.638s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:14:43 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-819e494c-9aa0-4095-b834-79d23d29420a tempest-VolumesAdminNegativeTest-1213518815 None] <== create_volume: return (1859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:14:43 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-819e494c-9aa0-4095-b834-79d23d29420a tempest-VolumesAdminNegativeTest-1213518815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.865s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:14:43 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-819e494c-9aa0-4095-b834-79d23d29420a tempest-VolumesAdminNegativeTest-1213518815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b8423e4-4823-4ce8-b69e-1a645943b2c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b75b7a1a-101f-452f-b155-5d8db98da380', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:14:43 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-819e494c-9aa0-4095-b834-79d23d29420a tempest-VolumesAdminNegativeTest-1213518815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e818accb-8bfb-4aac-9f9f-23db0940f4ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:14:43 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-819e494c-9aa0-4095-b834-79d23d29420a tempest-VolumesAdminNegativeTest-1213518815 None] Volume volume-b75b7a1a-101f-452f-b155-5d8db98da380 (b75b7a1a-101f-452f-b155-5d8db98da380): created successfully Jul 22 03:14:43 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-819e494c-9aa0-4095-b834-79d23d29420a tempest-VolumesAdminNegativeTest-1213518815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e818accb-8bfb-4aac-9f9f-23db0940f4ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:14:43 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-819e494c-9aa0-4095-b834-79d23d29420a tempest-VolumesAdminNegativeTest-1213518815 None] Flow 'volume_create_manager' (96d23c56-8eab-4020-a833-1779303abd73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:14:43 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-819e494c-9aa0-4095-b834-79d23d29420a tempest-VolumesAdminNegativeTest-1213518815 None] Created volume successfully. Jul 22 03:14:46 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-b424211b-6149-450b-b47d-606f767871cc tempest-VolumesAdminNegativeTest-1213518815 None] Acquiring lock "cinder-b75b7a1a-101f-452f-b155-5d8db98da380-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:14:46 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-b424211b-6149-450b-b47d-606f767871cc tempest-VolumesAdminNegativeTest-1213518815 None] Lock "cinder-b75b7a1a-101f-452f-b155-5d8db98da380-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:14:46 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-b424211b-6149-450b-b47d-606f767871cc tempest-VolumesAdminNegativeTest-1213518815 None] Acquiring lock "cinder-quobyte-b75b7a1a-101f-452f-b155-5d8db98da380" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:14:47 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-b424211b-6149-450b-b47d-606f767871cc tempest-VolumesAdminNegativeTest-1213518815 None] Lock "cinder-quobyte-b75b7a1a-101f-452f-b155-5d8db98da380" acquired by "delete_volume" :: waited 0.035s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:14:47 devstack cinder-volume[87747]: INFO oslo.privsep.daemon [None req-b424211b-6149-450b-b47d-606f767871cc tempest-VolumesAdminNegativeTest-1213518815 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp5oticy08/privsep.sock'] Jul 22 03:14:47 devstack sudo[88675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp5oticy08/privsep.sock Jul 22 03:14:47 devstack sudo[88675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:14:48 devstack cinder-volume[87747]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Jul 22 03:14:48 devstack cinder-volume[87747]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 22 03:14:48 devstack cinder-volume[87747]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 22 03:14:48 devstack cinder-volume[87747]: WARNING oslo.privsep.daemon [-] privsep log: Jul 22 03:14:48 devstack cinder-volume[87747]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 22 03:14:48 devstack cinder-volume[87747]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 22 03:14:48 devstack cinder-volume[87747]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 22 03:14:48 devstack cinder-volume[87747]: WARNING oslo.privsep.daemon [-] privsep log: Jul 22 03:14:48 devstack cinder-volume[87747]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Jul 22 03:14:49 devstack sudo[88675]: pam_unix(sudo:session): session closed for user root Jul 22 03:14:49 devstack cinder-volume[87747]: INFO oslo.privsep.daemon [None req-b424211b-6149-450b-b47d-606f767871cc tempest-VolumesAdminNegativeTest-1213518815 None] Spawned new privsep daemon via rootwrap Jul 22 03:14:49 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [None req-b424211b-6149-450b-b47d-606f767871cc tempest-VolumesAdminNegativeTest-1213518815 None] Accepted privsep connection to /tmp/tmp5oticy08/privsep.sock {{(pid=87747) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 22 03:14:49 devstack cinder-volume[87747]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 22 03:14:49 devstack cinder-volume[87747]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 22 03:14:49 devstack cinder-volume[87747]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 22 03:14:49 devstack cinder-volume[87747]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88699 Jul 22 03:14:49 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a02b552-88fc-46c5-b139-6cdcaf0b996b]: (2,) {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:14:49 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[7098a29a-c7ee-4ebe-95c9-43298922798c]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:14:49 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b424211b-6149-450b-b47d-606f767871cc tempest-VolumesAdminNegativeTest-1213518815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b75b7a1a-101f-452f-b155-5d8db98da380 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:14:49 devstack sudo[88716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b75b7a1a-101f-452f-b155-5d8db98da380 Jul 22 03:14:49 devstack sudo[88716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:14:50 devstack sudo[88716]: pam_unix(sudo:session): session closed for user root Jul 22 03:14:50 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b424211b-6149-450b-b47d-606f767871cc tempest-VolumesAdminNegativeTest-1213518815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b75b7a1a-101f-452f-b155-5d8db98da380" returned: 0 in 0.562s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:14:50 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b424211b-6149-450b-b47d-606f767871cc tempest-VolumesAdminNegativeTest-1213518815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b75b7a1a-101f-452f-b155-5d8db98da380 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:14:50 devstack sudo[88728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b75b7a1a-101f-452f-b155-5d8db98da380 Jul 22 03:14:50 devstack sudo[88728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:14:50 devstack sudo[88728]: pam_unix(sudo:session): session closed for user root Jul 22 03:14:50 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b424211b-6149-450b-b47d-606f767871cc tempest-VolumesAdminNegativeTest-1213518815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b75b7a1a-101f-452f-b155-5d8db98da380" returned: 0 in 0.642s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:14:50 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-b424211b-6149-450b-b47d-606f767871cc tempest-VolumesAdminNegativeTest-1213518815 None] Lock "cinder-quobyte-b75b7a1a-101f-452f-b155-5d8db98da380" released by "delete_volume" :: held 3.771s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:14:50 devstack cinder-volume[87747]: WARNING cinder.quota [None req-b424211b-6149-450b-b47d-606f767871cc tempest-VolumesAdminNegativeTest-1213518815 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 22 03:14:50 devstack cinder-volume[87747]: WARNING cinder.quota [None req-b424211b-6149-450b-b47d-606f767871cc tempest-VolumesAdminNegativeTest-1213518815 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 22 03:14:50 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-b424211b-6149-450b-b47d-606f767871cc tempest-VolumesAdminNegativeTest-1213518815 None] Created reservations ['6ec541cf-5639-4b49-b81d-36f52ad27823', '8804d7e8-63d9-4a0f-aba1-8453bd3245cb', '162f8cd2-64e1-410c-afda-fe8c825889e5', '2dd67e91-70b0-41a0-b846-76d91c817bfd'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:14:51 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b424211b-6149-450b-b47d-606f767871cc tempest-VolumesAdminNegativeTest-1213518815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:14:51 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b424211b-6149-450b-b47d-606f767871cc tempest-VolumesAdminNegativeTest-1213518815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:14:51 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-b424211b-6149-450b-b47d-606f767871cc tempest-VolumesAdminNegativeTest-1213518815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:14:51 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-b424211b-6149-450b-b47d-606f767871cc tempest-VolumesAdminNegativeTest-1213518815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:14:51 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b424211b-6149-450b-b47d-606f767871cc tempest-VolumesAdminNegativeTest-1213518815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:14:51 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b424211b-6149-450b-b47d-606f767871cc tempest-VolumesAdminNegativeTest-1213518815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:14:51 devstack sudo[88734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:14:51 devstack sudo[88734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:14:51 devstack sudo[88734]: pam_unix(sudo:session): session closed for user root Jul 22 03:14:51 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b424211b-6149-450b-b47d-606f767871cc tempest-VolumesAdminNegativeTest-1213518815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.656s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:14:51 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-b424211b-6149-450b-b47d-606f767871cc tempest-VolumesAdminNegativeTest-1213518815 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:14:51 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-b424211b-6149-450b-b47d-606f767871cc tempest-VolumesAdminNegativeTest-1213518815 None] Deleted volume successfully. Jul 22 03:14:51 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-b424211b-6149-450b-b47d-606f767871cc tempest-VolumesAdminNegativeTest-1213518815 None] Lock "cinder-b75b7a1a-101f-452f-b155-5d8db98da380-delete_volume" released by "delete_volume" :: held 5.042s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:15:01 devstack cinder-volume[87747]: DEBUG dbcounter [-] [87747] Writing DB stats cinder:SELECT=7,cinder:UPDATE=12,cinder:INSERT=2 {{(pid=87747) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 03:15:01 devstack cinder-volume[87747]: DEBUG dbcounter [-] [87747] Writing DB stats cinder:SELECT=7,cinder:INSERT=3,cinder:UPDATE=10,cinder:DELETE=2 {{(pid=87747) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 03:15:04 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-720df194-55c0-4b5c-85ba-115212b0cb2b tempest-AttachVolumeTestJSON-158955983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:15:04 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-720df194-55c0-4b5c-85ba-115212b0cb2b tempest-AttachVolumeTestJSON-158955983 None] Flow 'volume_create_manager' (ab9c1fc7-c160-412e-a446-b64b20525515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:15:04 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-720df194-55c0-4b5c-85ba-115212b0cb2b tempest-AttachVolumeTestJSON-158955983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de2e87fc-b609-405e-b63a-bcbb4e6401a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:15:04 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-720df194-55c0-4b5c-85ba-115212b0cb2b tempest-AttachVolumeTestJSON-158955983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de2e87fc-b609-405e-b63a-bcbb4e6401a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:15:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-711192335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54f5ce18-50ff-4191-9173-a0aad302f59c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='867b2b7c0ce34c16b16c490a61e37294',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:15:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:15:05Z,use_quota=True,user_id='bde86b239dfe4cb89bf2162ee5fe5293',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:15:04 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-720df194-55c0-4b5c-85ba-115212b0cb2b tempest-AttachVolumeTestJSON-158955983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e44ab81e-4437-4146-8858-39c707e5a221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:15:04 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-720df194-55c0-4b5c-85ba-115212b0cb2b tempest-AttachVolumeTestJSON-158955983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e44ab81e-4437-4146-8858-39c707e5a221) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:15:04 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-720df194-55c0-4b5c-85ba-115212b0cb2b tempest-AttachVolumeTestJSON-158955983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e19d84ee-6e92-4bd1-b6b2-c6a54b56c55d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:15:04 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-720df194-55c0-4b5c-85ba-115212b0cb2b tempest-AttachVolumeTestJSON-158955983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e19d84ee-6e92-4bd1-b6b2-c6a54b56c55d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54f5ce18-50ff-4191-9173-a0aad302f59c', 'volume_name': 'volume-54f5ce18-50ff-4191-9173-a0aad302f59c', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:15:04 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-720df194-55c0-4b5c-85ba-115212b0cb2b tempest-AttachVolumeTestJSON-158955983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a34edc4-abce-48de-b4e2-074ed255ecd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:15:04 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-720df194-55c0-4b5c-85ba-115212b0cb2b tempest-AttachVolumeTestJSON-158955983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a34edc4-abce-48de-b4e2-074ed255ecd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:15:04 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-720df194-55c0-4b5c-85ba-115212b0cb2b tempest-AttachVolumeTestJSON-158955983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99459361-d482-48e5-a276-f0ce0400eb1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:15:04 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-720df194-55c0-4b5c-85ba-115212b0cb2b tempest-AttachVolumeTestJSON-158955983 None] Volume 54f5ce18-50ff-4191-9173-a0aad302f59c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54f5ce18-50ff-4191-9173-a0aad302f59c', 'volume_size': 1} Jul 22 03:15:04 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-720df194-55c0-4b5c-85ba-115212b0cb2b tempest-AttachVolumeTestJSON-158955983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:15:04 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-720df194-55c0-4b5c-85ba-115212b0cb2b tempest-AttachVolumeTestJSON-158955983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:15:04 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-720df194-55c0-4b5c-85ba-115212b0cb2b tempest-AttachVolumeTestJSON-158955983 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:15:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-711192335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54f5ce18-50ff-4191-9173-a0aad302f59c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='867b2b7c0ce34c16b16c490a61e37294',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:15:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:15:05Z,use_quota=True,user_id='bde86b239dfe4cb89bf2162ee5fe5293',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:15:04 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-720df194-55c0-4b5c-85ba-115212b0cb2b tempest-AttachVolumeTestJSON-158955983 None] Creating volume 54f5ce18-50ff-4191-9173-a0aad302f59c {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:15:04 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-720df194-55c0-4b5c-85ba-115212b0cb2b tempest-AttachVolumeTestJSON-158955983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:15:04 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-720df194-55c0-4b5c-85ba-115212b0cb2b tempest-AttachVolumeTestJSON-158955983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:15:04 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-720df194-55c0-4b5c-85ba-115212b0cb2b tempest-AttachVolumeTestJSON-158955983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:15:04 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-720df194-55c0-4b5c-85ba-115212b0cb2b tempest-AttachVolumeTestJSON-158955983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:15:04 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-720df194-55c0-4b5c-85ba-115212b0cb2b tempest-AttachVolumeTestJSON-158955983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:15:04 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-720df194-55c0-4b5c-85ba-115212b0cb2b tempest-AttachVolumeTestJSON-158955983 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:15:04 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-720df194-55c0-4b5c-85ba-115212b0cb2b tempest-AttachVolumeTestJSON-158955983 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:15:04 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-720df194-55c0-4b5c-85ba-115212b0cb2b tempest-AttachVolumeTestJSON-158955983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-54f5ce18-50ff-4191-9173-a0aad302f59c 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:15:04 devstack sudo[88819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-54f5ce18-50ff-4191-9173-a0aad302f59c 1073741824 Jul 22 03:15:04 devstack sudo[88819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:15:05 devstack sudo[88819]: pam_unix(sudo:session): session closed for user root Jul 22 03:15:05 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-720df194-55c0-4b5c-85ba-115212b0cb2b tempest-AttachVolumeTestJSON-158955983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-54f5ce18-50ff-4191-9173-a0aad302f59c 1073741824" returned: 0 in 0.524s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:15:05 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-720df194-55c0-4b5c-85ba-115212b0cb2b tempest-AttachVolumeTestJSON-158955983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-54f5ce18-50ff-4191-9173-a0aad302f59c {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:15:05 devstack sudo[88828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-54f5ce18-50ff-4191-9173-a0aad302f59c Jul 22 03:15:05 devstack sudo[88828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:15:05 devstack sudo[88828]: pam_unix(sudo:session): session closed for user root Jul 22 03:15:05 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-720df194-55c0-4b5c-85ba-115212b0cb2b tempest-AttachVolumeTestJSON-158955983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-54f5ce18-50ff-4191-9173-a0aad302f59c" returned: 0 in 0.401s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:15:05 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-720df194-55c0-4b5c-85ba-115212b0cb2b tempest-AttachVolumeTestJSON-158955983 None] <== create_volume: return (993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:15:05 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-720df194-55c0-4b5c-85ba-115212b0cb2b tempest-AttachVolumeTestJSON-158955983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.997s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:15:05 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-720df194-55c0-4b5c-85ba-115212b0cb2b tempest-AttachVolumeTestJSON-158955983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99459361-d482-48e5-a276-f0ce0400eb1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54f5ce18-50ff-4191-9173-a0aad302f59c', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:15:05 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-720df194-55c0-4b5c-85ba-115212b0cb2b tempest-AttachVolumeTestJSON-158955983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d0d4a68-2eee-4fc6-b9d1-a301a9efd79b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:15:05 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-720df194-55c0-4b5c-85ba-115212b0cb2b tempest-AttachVolumeTestJSON-158955983 None] Volume volume-54f5ce18-50ff-4191-9173-a0aad302f59c (54f5ce18-50ff-4191-9173-a0aad302f59c): created successfully Jul 22 03:15:05 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-720df194-55c0-4b5c-85ba-115212b0cb2b tempest-AttachVolumeTestJSON-158955983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d0d4a68-2eee-4fc6-b9d1-a301a9efd79b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:15:05 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-720df194-55c0-4b5c-85ba-115212b0cb2b tempest-AttachVolumeTestJSON-158955983 None] Flow 'volume_create_manager' (ab9c1fc7-c160-412e-a446-b64b20525515) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:15:05 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-720df194-55c0-4b5c-85ba-115212b0cb2b tempest-AttachVolumeTestJSON-158955983 None] Created volume successfully. Jul 22 03:15:09 devstack cinder-volume[87747]: WARNING py.warnings [req-d8137c85-f4df-4bbe-8bc2-bd4f04ae6963 req-2763d548-7b85-4910-b65a-9fbef10701c9 tempest-AttachVolumeTestJSON-158955983 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Jul 22 03:15:09 devstack cinder-volume[87747]: .first() Jul 22 03:15:09 devstack cinder-volume[87747]: Jul 22 03:15:09 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [req-d8137c85-f4df-4bbe-8bc2-bd4f04ae6963 req-2763d548-7b85-4910-b65a-9fbef10701c9 tempest-AttachVolumeTestJSON-158955983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:15:09 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [req-d8137c85-f4df-4bbe-8bc2-bd4f04ae6963 req-2763d548-7b85-4910-b65a-9fbef10701c9 tempest-AttachVolumeTestJSON-158955983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:15:09 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [req-d8137c85-f4df-4bbe-8bc2-bd4f04ae6963 req-2763d548-7b85-4910-b65a-9fbef10701c9 tempest-AttachVolumeTestJSON-158955983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:15:09 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [req-d8137c85-f4df-4bbe-8bc2-bd4f04ae6963 req-2763d548-7b85-4910-b65a-9fbef10701c9 tempest-AttachVolumeTestJSON-158955983 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f', 'name': 'volume-54f5ce18-50ff-4191-9173-a0aad302f59c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '348e8a2a-dc99-469d-a7bb-bb19c0122956', 'enforce_multipath': True} {{(pid=87747) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 22 03:15:09 devstack cinder-volume[87747]: INFO cinder.volume.manager [req-d8137c85-f4df-4bbe-8bc2-bd4f04ae6963 req-2763d548-7b85-4910-b65a-9fbef10701c9 tempest-AttachVolumeTestJSON-158955983 None] attachment_update completed successfully. Jul 22 03:15:19 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d167edc-e9be-47be-9e18-d58afbd6dd19 tempest-DeleteServersTestJSON-483064884 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:15:19 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-9d167edc-e9be-47be-9e18-d58afbd6dd19 tempest-DeleteServersTestJSON-483064884 None] Flow 'volume_create_manager' (44e67f7b-4e2b-4a9f-bfa8-fc57b5930b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:15:20 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-9d167edc-e9be-47be-9e18-d58afbd6dd19 tempest-DeleteServersTestJSON-483064884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bf587f5-4e40-4d37-a962-94be7d8a5634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:15:20 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-9d167edc-e9be-47be-9e18-d58afbd6dd19 tempest-DeleteServersTestJSON-483064884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bf587f5-4e40-4d37-a962-94be7d8a5634) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:15:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1752740501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=419deed2-6f14-45c7-ab54-67822eb5d4b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecf8d3dc94924842b4228e0a131bccd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:15:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:15:20Z,use_quota=True,user_id='4438d06079ef42788d371f62124fbdbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:15:20 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-9d167edc-e9be-47be-9e18-d58afbd6dd19 tempest-DeleteServersTestJSON-483064884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63049042-9200-454e-b6c4-ba33ae4c3aa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:15:20 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-9d167edc-e9be-47be-9e18-d58afbd6dd19 tempest-DeleteServersTestJSON-483064884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63049042-9200-454e-b6c4-ba33ae4c3aa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:15:20 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-9d167edc-e9be-47be-9e18-d58afbd6dd19 tempest-DeleteServersTestJSON-483064884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6858c913-15e0-4b7c-84f8-16d23d51fc3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:15:20 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-9d167edc-e9be-47be-9e18-d58afbd6dd19 tempest-DeleteServersTestJSON-483064884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6858c913-15e0-4b7c-84f8-16d23d51fc3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '419deed2-6f14-45c7-ab54-67822eb5d4b5', 'volume_name': 'volume-419deed2-6f14-45c7-ab54-67822eb5d4b5', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:15:20 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-9d167edc-e9be-47be-9e18-d58afbd6dd19 tempest-DeleteServersTestJSON-483064884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73472018-abd6-4442-ad50-a1d5cfd999e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:15:20 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-9d167edc-e9be-47be-9e18-d58afbd6dd19 tempest-DeleteServersTestJSON-483064884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73472018-abd6-4442-ad50-a1d5cfd999e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:15:20 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-9d167edc-e9be-47be-9e18-d58afbd6dd19 tempest-DeleteServersTestJSON-483064884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (018b13eb-2e3e-4f40-8f06-f4323d4032db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:15:20 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-9d167edc-e9be-47be-9e18-d58afbd6dd19 tempest-DeleteServersTestJSON-483064884 None] Volume 419deed2-6f14-45c7-ab54-67822eb5d4b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-419deed2-6f14-45c7-ab54-67822eb5d4b5', 'volume_size': 1} Jul 22 03:15:20 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-9d167edc-e9be-47be-9e18-d58afbd6dd19 tempest-DeleteServersTestJSON-483064884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:15:20 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-9d167edc-e9be-47be-9e18-d58afbd6dd19 tempest-DeleteServersTestJSON-483064884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:15:20 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-9d167edc-e9be-47be-9e18-d58afbd6dd19 tempest-DeleteServersTestJSON-483064884 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:15:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1752740501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=419deed2-6f14-45c7-ab54-67822eb5d4b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecf8d3dc94924842b4228e0a131bccd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:15:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:15:20Z,use_quota=True,user_id='4438d06079ef42788d371f62124fbdbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:15:20 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-9d167edc-e9be-47be-9e18-d58afbd6dd19 tempest-DeleteServersTestJSON-483064884 None] Creating volume 419deed2-6f14-45c7-ab54-67822eb5d4b5 {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:15:20 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-9d167edc-e9be-47be-9e18-d58afbd6dd19 tempest-DeleteServersTestJSON-483064884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:15:20 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-9d167edc-e9be-47be-9e18-d58afbd6dd19 tempest-DeleteServersTestJSON-483064884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:15:20 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-9d167edc-e9be-47be-9e18-d58afbd6dd19 tempest-DeleteServersTestJSON-483064884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:15:20 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-9d167edc-e9be-47be-9e18-d58afbd6dd19 tempest-DeleteServersTestJSON-483064884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:15:20 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-9d167edc-e9be-47be-9e18-d58afbd6dd19 tempest-DeleteServersTestJSON-483064884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:15:20 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-9d167edc-e9be-47be-9e18-d58afbd6dd19 tempest-DeleteServersTestJSON-483064884 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:15:20 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-9d167edc-e9be-47be-9e18-d58afbd6dd19 tempest-DeleteServersTestJSON-483064884 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:15:20 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-9d167edc-e9be-47be-9e18-d58afbd6dd19 tempest-DeleteServersTestJSON-483064884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-419deed2-6f14-45c7-ab54-67822eb5d4b5 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:15:20 devstack sudo[89857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-419deed2-6f14-45c7-ab54-67822eb5d4b5 1073741824 Jul 22 03:15:20 devstack sudo[89857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:15:20 devstack sudo[89857]: pam_unix(sudo:session): session closed for user root Jul 22 03:15:20 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-9d167edc-e9be-47be-9e18-d58afbd6dd19 tempest-DeleteServersTestJSON-483064884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-419deed2-6f14-45c7-ab54-67822eb5d4b5 1073741824" returned: 0 in 0.768s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:15:20 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-9d167edc-e9be-47be-9e18-d58afbd6dd19 tempest-DeleteServersTestJSON-483064884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-419deed2-6f14-45c7-ab54-67822eb5d4b5 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:15:21 devstack sudo[89865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-419deed2-6f14-45c7-ab54-67822eb5d4b5 Jul 22 03:15:21 devstack sudo[89865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:15:21 devstack sudo[89865]: pam_unix(sudo:session): session closed for user root Jul 22 03:15:21 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-9d167edc-e9be-47be-9e18-d58afbd6dd19 tempest-DeleteServersTestJSON-483064884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-419deed2-6f14-45c7-ab54-67822eb5d4b5" returned: 0 in 0.581s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:15:21 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-9d167edc-e9be-47be-9e18-d58afbd6dd19 tempest-DeleteServersTestJSON-483064884 None] <== create_volume: return (1440ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:15:21 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-9d167edc-e9be-47be-9e18-d58afbd6dd19 tempest-DeleteServersTestJSON-483064884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.443s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:15:21 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-9d167edc-e9be-47be-9e18-d58afbd6dd19 tempest-DeleteServersTestJSON-483064884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (018b13eb-2e3e-4f40-8f06-f4323d4032db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-419deed2-6f14-45c7-ab54-67822eb5d4b5', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:15:21 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-9d167edc-e9be-47be-9e18-d58afbd6dd19 tempest-DeleteServersTestJSON-483064884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08b1e444-394b-4920-b181-61c6009c4024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:15:21 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-9d167edc-e9be-47be-9e18-d58afbd6dd19 tempest-DeleteServersTestJSON-483064884 None] Volume volume-419deed2-6f14-45c7-ab54-67822eb5d4b5 (419deed2-6f14-45c7-ab54-67822eb5d4b5): created successfully Jul 22 03:15:21 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-9d167edc-e9be-47be-9e18-d58afbd6dd19 tempest-DeleteServersTestJSON-483064884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08b1e444-394b-4920-b181-61c6009c4024) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:15:21 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-9d167edc-e9be-47be-9e18-d58afbd6dd19 tempest-DeleteServersTestJSON-483064884 None] Flow 'volume_create_manager' (44e67f7b-4e2b-4a9f-bfa8-fc57b5930b97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:15:21 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-9d167edc-e9be-47be-9e18-d58afbd6dd19 tempest-DeleteServersTestJSON-483064884 None] Created volume successfully. Jul 22 03:15:22 devstack cinder-volume[87747]: DEBUG oslo_service.periodic_task [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87747) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 03:15:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:15:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:15:22 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:15:22 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:15:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:15:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:15:22 devstack sudo[89912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:15:22 devstack sudo[89912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:15:22 devstack sudo[89912]: pam_unix(sudo:session): session closed for user root Jul 22 03:15:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.557s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:15:23 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:15:24 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [req-4dce4231-4129-4136-a77b-71f762b44d4a req-73d964ab-a4b6-4d17-be5d-3a490dca12de tempest-DeleteServersTestJSON-483064884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:15:24 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [req-4dce4231-4129-4136-a77b-71f762b44d4a req-73d964ab-a4b6-4d17-be5d-3a490dca12de tempest-DeleteServersTestJSON-483064884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:15:24 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [req-4dce4231-4129-4136-a77b-71f762b44d4a req-73d964ab-a4b6-4d17-be5d-3a490dca12de tempest-DeleteServersTestJSON-483064884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.036s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:15:24 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [req-4dce4231-4129-4136-a77b-71f762b44d4a req-73d964ab-a4b6-4d17-be5d-3a490dca12de tempest-DeleteServersTestJSON-483064884 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f', 'name': 'volume-419deed2-6f14-45c7-ab54-67822eb5d4b5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a5acc307-d7eb-4923-b744-7fd72b4208aa', 'enforce_multipath': True} {{(pid=87747) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 22 03:15:25 devstack cinder-volume[87747]: INFO cinder.volume.manager [req-4dce4231-4129-4136-a77b-71f762b44d4a req-73d964ab-a4b6-4d17-be5d-3a490dca12de tempest-DeleteServersTestJSON-483064884 None] attachment_update completed successfully. Jul 22 03:15:29 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [req-291956d1-d2dd-4e13-9db7-0ee6f3457a61 req-298181d9-8497-4e9e-b6a8-d6a390b630f7 tempest-TaggedAttachmentsTest-601058941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:15:29 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [req-291956d1-d2dd-4e13-9db7-0ee6f3457a61 req-298181d9-8497-4e9e-b6a8-d6a390b630f7 tempest-TaggedAttachmentsTest-601058941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:15:29 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [req-291956d1-d2dd-4e13-9db7-0ee6f3457a61 req-298181d9-8497-4e9e-b6a8-d6a390b630f7 tempest-TaggedAttachmentsTest-601058941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.044s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:15:29 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [req-291956d1-d2dd-4e13-9db7-0ee6f3457a61 req-298181d9-8497-4e9e-b6a8-d6a390b630f7 tempest-TaggedAttachmentsTest-601058941 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f', 'name': 'volume-f04fe48c-f2a2-4078-9a0a-5b2be0d98bde', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ea830cb6-5d32-4f4f-9d9a-f4967754dbd9', 'enforce_multipath': True} {{(pid=87747) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 22 03:15:29 devstack cinder-volume[87747]: INFO cinder.volume.manager [req-291956d1-d2dd-4e13-9db7-0ee6f3457a61 req-298181d9-8497-4e9e-b6a8-d6a390b630f7 tempest-TaggedAttachmentsTest-601058941 None] attachment_update completed successfully. Jul 22 03:15:29 devstack cinder-volume[87747]: INFO cinder.volume.manager [req-213ad57c-34a5-42be-8998-12455ada6635 req-530538a8-9b6b-4d32-9959-ea858e76300f tempest-DeleteServersTestJSON-483064884 None] Terminate volume connection completed successfully. Jul 22 03:15:29 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [req-213ad57c-34a5-42be-8998-12455ada6635 req-530538a8-9b6b-4d32-9959-ea858e76300f tempest-DeleteServersTestJSON-483064884 None] Deleting attachment a5acc307-d7eb-4923-b744-7fd72b4208aa. {{(pid=87747) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 22 03:15:30 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-b920daa1-c18c-41fe-9890-96e16e81d85a tempest-DeleteServersTestJSON-483064884 None] Acquiring lock "cinder-419deed2-6f14-45c7-ab54-67822eb5d4b5-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:15:30 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-b920daa1-c18c-41fe-9890-96e16e81d85a tempest-DeleteServersTestJSON-483064884 None] Lock "cinder-419deed2-6f14-45c7-ab54-67822eb5d4b5-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:15:31 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-b920daa1-c18c-41fe-9890-96e16e81d85a tempest-DeleteServersTestJSON-483064884 None] Acquiring lock "cinder-quobyte-419deed2-6f14-45c7-ab54-67822eb5d4b5" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:15:31 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-b920daa1-c18c-41fe-9890-96e16e81d85a tempest-DeleteServersTestJSON-483064884 None] Lock "cinder-quobyte-419deed2-6f14-45c7-ab54-67822eb5d4b5" acquired by "delete_volume" :: waited 0.024s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:15:31 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2e98ca7-8e28-4c98-a692-d4a2d1db63bb]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:15:31 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b920daa1-c18c-41fe-9890-96e16e81d85a tempest-DeleteServersTestJSON-483064884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-419deed2-6f14-45c7-ab54-67822eb5d4b5 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:15:31 devstack sudo[90031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-419deed2-6f14-45c7-ab54-67822eb5d4b5 Jul 22 03:15:31 devstack sudo[90031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:15:31 devstack sudo[90031]: pam_unix(sudo:session): session closed for user root Jul 22 03:15:31 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b920daa1-c18c-41fe-9890-96e16e81d85a tempest-DeleteServersTestJSON-483064884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-419deed2-6f14-45c7-ab54-67822eb5d4b5" returned: 0 in 0.537s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:15:31 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b920daa1-c18c-41fe-9890-96e16e81d85a tempest-DeleteServersTestJSON-483064884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-419deed2-6f14-45c7-ab54-67822eb5d4b5 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:15:31 devstack sudo[90038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-419deed2-6f14-45c7-ab54-67822eb5d4b5 Jul 22 03:15:31 devstack sudo[90038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:15:31 devstack sudo[90038]: pam_unix(sudo:session): session closed for user root Jul 22 03:15:31 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b920daa1-c18c-41fe-9890-96e16e81d85a tempest-DeleteServersTestJSON-483064884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-419deed2-6f14-45c7-ab54-67822eb5d4b5" returned: 0 in 0.326s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:15:31 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-b920daa1-c18c-41fe-9890-96e16e81d85a tempest-DeleteServersTestJSON-483064884 None] Lock "cinder-quobyte-419deed2-6f14-45c7-ab54-67822eb5d4b5" released by "delete_volume" :: held 0.925s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:15:32 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-b920daa1-c18c-41fe-9890-96e16e81d85a tempest-DeleteServersTestJSON-483064884 None] Created reservations ['be6953a7-6d13-4199-b8ca-b72e7c5ea640', '854bb354-0c8d-4439-877a-b9f45c56dc6f', '11171d90-dba8-47fe-802d-38eaa96fe08c', '49b11c4a-e8c5-49c1-874b-e99793904a30'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:15:32 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b920daa1-c18c-41fe-9890-96e16e81d85a tempest-DeleteServersTestJSON-483064884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:15:32 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b920daa1-c18c-41fe-9890-96e16e81d85a tempest-DeleteServersTestJSON-483064884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:15:32 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-b920daa1-c18c-41fe-9890-96e16e81d85a tempest-DeleteServersTestJSON-483064884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:15:32 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-b920daa1-c18c-41fe-9890-96e16e81d85a tempest-DeleteServersTestJSON-483064884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:15:32 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b920daa1-c18c-41fe-9890-96e16e81d85a tempest-DeleteServersTestJSON-483064884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:15:32 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b920daa1-c18c-41fe-9890-96e16e81d85a tempest-DeleteServersTestJSON-483064884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:15:32 devstack sudo[90043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:15:32 devstack sudo[90043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:15:32 devstack sudo[90043]: pam_unix(sudo:session): session closed for user root Jul 22 03:15:32 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b920daa1-c18c-41fe-9890-96e16e81d85a tempest-DeleteServersTestJSON-483064884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.278s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:15:32 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-b920daa1-c18c-41fe-9890-96e16e81d85a tempest-DeleteServersTestJSON-483064884 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:15:32 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-b920daa1-c18c-41fe-9890-96e16e81d85a tempest-DeleteServersTestJSON-483064884 None] Deleted volume successfully. Jul 22 03:15:32 devstack cinder-volume[87747]: INFO cinder.volume.manager [req-9e3eeb3d-224e-44cc-b3c7-1949e3764cef req-bfbd1fb9-18ac-4fe2-894e-8244f0e54fdc tempest-TaggedAttachmentsTest-601058941 None] Terminate volume connection completed successfully. Jul 22 03:15:32 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [req-9e3eeb3d-224e-44cc-b3c7-1949e3764cef req-bfbd1fb9-18ac-4fe2-894e-8244f0e54fdc tempest-TaggedAttachmentsTest-601058941 None] Deleting attachment ea830cb6-5d32-4f4f-9d9a-f4967754dbd9. {{(pid=87747) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 22 03:15:32 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-b920daa1-c18c-41fe-9890-96e16e81d85a tempest-DeleteServersTestJSON-483064884 None] Lock "cinder-419deed2-6f14-45c7-ab54-67822eb5d4b5-delete_volume" released by "delete_volume" :: held 1.823s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:15:42 devstack cinder-volume[87747]: DEBUG dbcounter [-] [87747] Writing DB stats cinder:SELECT=28,cinder:INSERT=3,cinder:UPDATE=21 {{(pid=87747) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 03:15:42 devstack cinder-volume[87747]: DEBUG dbcounter [-] [87747] Writing DB stats cinder:SELECT=34,cinder:UPDATE=17,cinder:DELETE=3,cinder:INSERT=3 {{(pid=87747) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 03:15:44 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-ad69223e-90ae-45ad-a0f8-4d86c6f9929a tempest-TaggedAttachmentsTest-601058941 None] Acquiring lock "cinder-f04fe48c-f2a2-4078-9a0a-5b2be0d98bde-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:15:45 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-ad69223e-90ae-45ad-a0f8-4d86c6f9929a tempest-TaggedAttachmentsTest-601058941 None] Lock "cinder-f04fe48c-f2a2-4078-9a0a-5b2be0d98bde-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:15:45 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-ad69223e-90ae-45ad-a0f8-4d86c6f9929a tempest-TaggedAttachmentsTest-601058941 None] Acquiring lock "cinder-quobyte-f04fe48c-f2a2-4078-9a0a-5b2be0d98bde" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:15:45 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-ad69223e-90ae-45ad-a0f8-4d86c6f9929a tempest-TaggedAttachmentsTest-601058941 None] Lock "cinder-quobyte-f04fe48c-f2a2-4078-9a0a-5b2be0d98bde" acquired by "delete_volume" :: waited 0.022s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:15:45 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc891412-78f1-40e6-9c92-6a71a0299df7]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:15:45 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ad69223e-90ae-45ad-a0f8-4d86c6f9929a tempest-TaggedAttachmentsTest-601058941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-f04fe48c-f2a2-4078-9a0a-5b2be0d98bde {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:15:45 devstack sudo[90166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-f04fe48c-f2a2-4078-9a0a-5b2be0d98bde Jul 22 03:15:45 devstack sudo[90166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:15:45 devstack sudo[90166]: pam_unix(sudo:session): session closed for user root Jul 22 03:15:45 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ad69223e-90ae-45ad-a0f8-4d86c6f9929a tempest-TaggedAttachmentsTest-601058941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-f04fe48c-f2a2-4078-9a0a-5b2be0d98bde" returned: 0 in 0.378s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:15:45 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ad69223e-90ae-45ad-a0f8-4d86c6f9929a tempest-TaggedAttachmentsTest-601058941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-f04fe48c-f2a2-4078-9a0a-5b2be0d98bde {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:15:45 devstack sudo[90171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-f04fe48c-f2a2-4078-9a0a-5b2be0d98bde Jul 22 03:15:45 devstack sudo[90171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:15:45 devstack sudo[90171]: pam_unix(sudo:session): session closed for user root Jul 22 03:15:45 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ad69223e-90ae-45ad-a0f8-4d86c6f9929a tempest-TaggedAttachmentsTest-601058941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-f04fe48c-f2a2-4078-9a0a-5b2be0d98bde" returned: 0 in 0.315s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:15:45 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-ad69223e-90ae-45ad-a0f8-4d86c6f9929a tempest-TaggedAttachmentsTest-601058941 None] Lock "cinder-quobyte-f04fe48c-f2a2-4078-9a0a-5b2be0d98bde" released by "delete_volume" :: held 0.753s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:15:45 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-ad69223e-90ae-45ad-a0f8-4d86c6f9929a tempest-TaggedAttachmentsTest-601058941 None] Created reservations ['d39b966f-df19-4a3c-8ac5-83fcfa5345e8', '9d92b606-8e08-475e-8d70-23433f80042e', '5189e0f9-854b-4992-828f-467f5c7da38b', 'be7b376c-fd48-422f-ac2b-8812a58aa82c'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:15:45 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-ad69223e-90ae-45ad-a0f8-4d86c6f9929a tempest-TaggedAttachmentsTest-601058941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:15:45 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-ad69223e-90ae-45ad-a0f8-4d86c6f9929a tempest-TaggedAttachmentsTest-601058941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:15:45 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-ad69223e-90ae-45ad-a0f8-4d86c6f9929a tempest-TaggedAttachmentsTest-601058941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:15:45 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-ad69223e-90ae-45ad-a0f8-4d86c6f9929a tempest-TaggedAttachmentsTest-601058941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:15:45 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-ad69223e-90ae-45ad-a0f8-4d86c6f9929a tempest-TaggedAttachmentsTest-601058941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:15:45 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ad69223e-90ae-45ad-a0f8-4d86c6f9929a tempest-TaggedAttachmentsTest-601058941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:15:46 devstack sudo[90174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:15:46 devstack sudo[90174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:15:46 devstack sudo[90174]: pam_unix(sudo:session): session closed for user root Jul 22 03:15:46 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ad69223e-90ae-45ad-a0f8-4d86c6f9929a tempest-TaggedAttachmentsTest-601058941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.288s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:15:46 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-ad69223e-90ae-45ad-a0f8-4d86c6f9929a tempest-TaggedAttachmentsTest-601058941 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:15:46 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-ad69223e-90ae-45ad-a0f8-4d86c6f9929a tempest-TaggedAttachmentsTest-601058941 None] Deleted volume successfully. Jul 22 03:15:46 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-ad69223e-90ae-45ad-a0f8-4d86c6f9929a tempest-TaggedAttachmentsTest-601058941 None] Lock "cinder-f04fe48c-f2a2-4078-9a0a-5b2be0d98bde-delete_volume" released by "delete_volume" :: held 1.332s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:15:49 devstack cinder-volume[87747]: INFO cinder.volume.manager [req-271d690f-3604-4a6a-981e-d8df1c65c5c7 req-2a7c7b7c-ddc9-420e-aa04-c2255c5599fd tempest-AttachVolumeTestJSON-158955983 None] Terminate volume connection completed successfully. Jul 22 03:15:49 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [req-271d690f-3604-4a6a-981e-d8df1c65c5c7 req-2a7c7b7c-ddc9-420e-aa04-c2255c5599fd tempest-AttachVolumeTestJSON-158955983 None] Deleting attachment 348e8a2a-dc99-469d-a7bb-bb19c0122956. {{(pid=87747) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 22 03:15:56 devstack cinder-volume[87747]: DEBUG dbcounter [-] [87747] Writing DB stats cinder:SELECT=5,cinder:INSERT=2,cinder:UPDATE=9,cinder:DELETE=1 {{(pid=87747) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 03:15:59 devstack cinder-volume[87747]: DEBUG dbcounter [-] [87747] Writing DB stats cinder:SELECT=7,cinder:UPDATE=7,cinder:INSERT=2 {{(pid=87747) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 03:16:21 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-374f53d4-ad8f-4cad-a8e6-16645ee0aa05 tempest-ServerActionsTestOtherA-1302037554 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:16:21 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-374f53d4-ad8f-4cad-a8e6-16645ee0aa05 tempest-ServerActionsTestOtherA-1302037554 None] Flow 'volume_create_manager' (b1842c94-2bcf-45e8-8cbc-a42eb97ac85f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:16:21 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-374f53d4-ad8f-4cad-a8e6-16645ee0aa05 tempest-ServerActionsTestOtherA-1302037554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b1dc776-930d-4c3c-88aa-1bb3ea455631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:16:21 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-374f53d4-ad8f-4cad-a8e6-16645ee0aa05 tempest-ServerActionsTestOtherA-1302037554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b1dc776-930d-4c3c-88aa-1bb3ea455631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:16:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-460890003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a50b8bc6-d68e-41fb-a2f4-2645492d16eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2cbe74b71c7435ca60e596dd1f26b38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:16:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:16:21Z,use_quota=True,user_id='0d2f3008569646399e66c3358ee73f84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:16:21 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-374f53d4-ad8f-4cad-a8e6-16645ee0aa05 tempest-ServerActionsTestOtherA-1302037554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed71f6dd-3bfc-4e7a-a6d6-ef6947e7b780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:16:21 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-374f53d4-ad8f-4cad-a8e6-16645ee0aa05 tempest-ServerActionsTestOtherA-1302037554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed71f6dd-3bfc-4e7a-a6d6-ef6947e7b780) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:16:21 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-374f53d4-ad8f-4cad-a8e6-16645ee0aa05 tempest-ServerActionsTestOtherA-1302037554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc7bb250-0ae6-4d2c-8f12-4af5e02c1404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:16:21 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-374f53d4-ad8f-4cad-a8e6-16645ee0aa05 tempest-ServerActionsTestOtherA-1302037554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc7bb250-0ae6-4d2c-8f12-4af5e02c1404) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a50b8bc6-d68e-41fb-a2f4-2645492d16eb', 'volume_name': 'volume-a50b8bc6-d68e-41fb-a2f4-2645492d16eb', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:16:21 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-374f53d4-ad8f-4cad-a8e6-16645ee0aa05 tempest-ServerActionsTestOtherA-1302037554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b8e7dd8-a5b7-4a3f-b405-fd32d67dd603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:16:21 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-374f53d4-ad8f-4cad-a8e6-16645ee0aa05 tempest-ServerActionsTestOtherA-1302037554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b8e7dd8-a5b7-4a3f-b405-fd32d67dd603) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:16:21 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-374f53d4-ad8f-4cad-a8e6-16645ee0aa05 tempest-ServerActionsTestOtherA-1302037554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c83c7fb8-52e3-4990-bad6-f7d9925ee955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:16:21 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-374f53d4-ad8f-4cad-a8e6-16645ee0aa05 tempest-ServerActionsTestOtherA-1302037554 None] Volume a50b8bc6-d68e-41fb-a2f4-2645492d16eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a50b8bc6-d68e-41fb-a2f4-2645492d16eb', 'volume_size': 1} Jul 22 03:16:21 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-374f53d4-ad8f-4cad-a8e6-16645ee0aa05 tempest-ServerActionsTestOtherA-1302037554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:16:21 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-374f53d4-ad8f-4cad-a8e6-16645ee0aa05 tempest-ServerActionsTestOtherA-1302037554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:16:21 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-374f53d4-ad8f-4cad-a8e6-16645ee0aa05 tempest-ServerActionsTestOtherA-1302037554 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:16:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-460890003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a50b8bc6-d68e-41fb-a2f4-2645492d16eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2cbe74b71c7435ca60e596dd1f26b38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:16:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:16:21Z,use_quota=True,user_id='0d2f3008569646399e66c3358ee73f84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:16:21 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-374f53d4-ad8f-4cad-a8e6-16645ee0aa05 tempest-ServerActionsTestOtherA-1302037554 None] Creating volume a50b8bc6-d68e-41fb-a2f4-2645492d16eb {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:16:21 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-374f53d4-ad8f-4cad-a8e6-16645ee0aa05 tempest-ServerActionsTestOtherA-1302037554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:16:21 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-374f53d4-ad8f-4cad-a8e6-16645ee0aa05 tempest-ServerActionsTestOtherA-1302037554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:16:21 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-374f53d4-ad8f-4cad-a8e6-16645ee0aa05 tempest-ServerActionsTestOtherA-1302037554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:16:21 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-374f53d4-ad8f-4cad-a8e6-16645ee0aa05 tempest-ServerActionsTestOtherA-1302037554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:16:21 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-374f53d4-ad8f-4cad-a8e6-16645ee0aa05 tempest-ServerActionsTestOtherA-1302037554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:16:21 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-374f53d4-ad8f-4cad-a8e6-16645ee0aa05 tempest-ServerActionsTestOtherA-1302037554 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:16:21 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-374f53d4-ad8f-4cad-a8e6-16645ee0aa05 tempest-ServerActionsTestOtherA-1302037554 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:16:21 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-374f53d4-ad8f-4cad-a8e6-16645ee0aa05 tempest-ServerActionsTestOtherA-1302037554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a50b8bc6-d68e-41fb-a2f4-2645492d16eb 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:16:21 devstack sudo[90599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a50b8bc6-d68e-41fb-a2f4-2645492d16eb 1073741824 Jul 22 03:16:21 devstack sudo[90599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:16:22 devstack cinder-volume[87747]: DEBUG oslo_service.periodic_task [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87747) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 03:16:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:16:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:16:22 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:16:22 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:16:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:16:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:16:22 devstack sudo[90599]: pam_unix(sudo:session): session closed for user root Jul 22 03:16:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-374f53d4-ad8f-4cad-a8e6-16645ee0aa05 tempest-ServerActionsTestOtherA-1302037554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a50b8bc6-d68e-41fb-a2f4-2645492d16eb 1073741824" returned: 0 in 0.844s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:16:22 devstack sudo[90612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:16:22 devstack sudo[90612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:16:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-374f53d4-ad8f-4cad-a8e6-16645ee0aa05 tempest-ServerActionsTestOtherA-1302037554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a50b8bc6-d68e-41fb-a2f4-2645492d16eb {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:16:22 devstack sudo[90615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a50b8bc6-d68e-41fb-a2f4-2645492d16eb Jul 22 03:16:22 devstack sudo[90615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:16:23 devstack sudo[90612]: pam_unix(sudo:session): session closed for user root Jul 22 03:16:23 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.643s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:16:23 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:16:23 devstack sudo[90615]: pam_unix(sudo:session): session closed for user root Jul 22 03:16:23 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-374f53d4-ad8f-4cad-a8e6-16645ee0aa05 tempest-ServerActionsTestOtherA-1302037554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a50b8bc6-d68e-41fb-a2f4-2645492d16eb" returned: 0 in 0.547s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:16:23 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-374f53d4-ad8f-4cad-a8e6-16645ee0aa05 tempest-ServerActionsTestOtherA-1302037554 None] <== create_volume: return (1513ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:16:23 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-374f53d4-ad8f-4cad-a8e6-16645ee0aa05 tempest-ServerActionsTestOtherA-1302037554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.517s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:16:23 devstack cinder-volume[87747]: DEBUG oslo_service.periodic_task [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Running periodic task VolumeManager._thread_info {{(pid=87747) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 03:16:23 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] thread count: 8 {{(pid=87747) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 22 03:16:23 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] thread info: [<_MainThread(MainThread, started 132775275860096)>, , , , , , , ] {{(pid=87747) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 22 03:16:23 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-374f53d4-ad8f-4cad-a8e6-16645ee0aa05 tempest-ServerActionsTestOtherA-1302037554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c83c7fb8-52e3-4990-bad6-f7d9925ee955) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a50b8bc6-d68e-41fb-a2f4-2645492d16eb', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:16:23 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-374f53d4-ad8f-4cad-a8e6-16645ee0aa05 tempest-ServerActionsTestOtherA-1302037554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (817b19b3-7056-4ce1-a7b5-23e326e0e46d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:16:23 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-374f53d4-ad8f-4cad-a8e6-16645ee0aa05 tempest-ServerActionsTestOtherA-1302037554 None] Volume volume-a50b8bc6-d68e-41fb-a2f4-2645492d16eb (a50b8bc6-d68e-41fb-a2f4-2645492d16eb): created successfully Jul 22 03:16:23 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-374f53d4-ad8f-4cad-a8e6-16645ee0aa05 tempest-ServerActionsTestOtherA-1302037554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (817b19b3-7056-4ce1-a7b5-23e326e0e46d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:16:23 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-374f53d4-ad8f-4cad-a8e6-16645ee0aa05 tempest-ServerActionsTestOtherA-1302037554 None] Flow 'volume_create_manager' (b1842c94-2bcf-45e8-8cbc-a42eb97ac85f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:16:23 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-374f53d4-ad8f-4cad-a8e6-16645ee0aa05 tempest-ServerActionsTestOtherA-1302037554 None] Created volume successfully. Jul 22 03:16:27 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-f01c89fd-883f-4b59-9f80-63d6d0c91914 tempest-ServerRescueNegativeTestJSON-564949156 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:16:27 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f01c89fd-883f-4b59-9f80-63d6d0c91914 tempest-ServerRescueNegativeTestJSON-564949156 None] Flow 'volume_create_manager' (75e37f96-5fcb-4392-8b5f-cfea02125069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:16:27 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f01c89fd-883f-4b59-9f80-63d6d0c91914 tempest-ServerRescueNegativeTestJSON-564949156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (740aab22-ab73-43e6-bbb0-c009e1e1f0a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:16:27 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f01c89fd-883f-4b59-9f80-63d6d0c91914 tempest-ServerRescueNegativeTestJSON-564949156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (740aab22-ab73-43e6-bbb0-c009e1e1f0a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:16:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-77834720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=798b3f76-f0a0-47ac-9bb6-21fd7f2be7f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0cba50a36c44f579f5fde7622a0b807',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:16:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:16:28Z,use_quota=True,user_id='5e1c60813ad744daa94b91f0d651c5a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:16:27 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f01c89fd-883f-4b59-9f80-63d6d0c91914 tempest-ServerRescueNegativeTestJSON-564949156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55ad67f8-b23f-4153-9214-64d4e7c65cd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:16:27 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f01c89fd-883f-4b59-9f80-63d6d0c91914 tempest-ServerRescueNegativeTestJSON-564949156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55ad67f8-b23f-4153-9214-64d4e7c65cd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:16:27 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f01c89fd-883f-4b59-9f80-63d6d0c91914 tempest-ServerRescueNegativeTestJSON-564949156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3c3cb39-0058-427e-8eea-b356e47b5977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:16:27 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f01c89fd-883f-4b59-9f80-63d6d0c91914 tempest-ServerRescueNegativeTestJSON-564949156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3c3cb39-0058-427e-8eea-b356e47b5977) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '798b3f76-f0a0-47ac-9bb6-21fd7f2be7f9', 'volume_name': 'volume-798b3f76-f0a0-47ac-9bb6-21fd7f2be7f9', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:16:27 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f01c89fd-883f-4b59-9f80-63d6d0c91914 tempest-ServerRescueNegativeTestJSON-564949156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cff5437-79fb-4010-9505-f65e286fe4c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:16:27 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f01c89fd-883f-4b59-9f80-63d6d0c91914 tempest-ServerRescueNegativeTestJSON-564949156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cff5437-79fb-4010-9505-f65e286fe4c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:16:27 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f01c89fd-883f-4b59-9f80-63d6d0c91914 tempest-ServerRescueNegativeTestJSON-564949156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c81af666-ab24-477c-a74c-a7297e746f40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:16:27 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-f01c89fd-883f-4b59-9f80-63d6d0c91914 tempest-ServerRescueNegativeTestJSON-564949156 None] Volume 798b3f76-f0a0-47ac-9bb6-21fd7f2be7f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-798b3f76-f0a0-47ac-9bb6-21fd7f2be7f9', 'volume_size': 1} Jul 22 03:16:27 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-f01c89fd-883f-4b59-9f80-63d6d0c91914 tempest-ServerRescueNegativeTestJSON-564949156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:16:27 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-f01c89fd-883f-4b59-9f80-63d6d0c91914 tempest-ServerRescueNegativeTestJSON-564949156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:16:27 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-f01c89fd-883f-4b59-9f80-63d6d0c91914 tempest-ServerRescueNegativeTestJSON-564949156 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:16:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-77834720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=798b3f76-f0a0-47ac-9bb6-21fd7f2be7f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0cba50a36c44f579f5fde7622a0b807',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:16:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:16:28Z,use_quota=True,user_id='5e1c60813ad744daa94b91f0d651c5a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:16:27 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-f01c89fd-883f-4b59-9f80-63d6d0c91914 tempest-ServerRescueNegativeTestJSON-564949156 None] Creating volume 798b3f76-f0a0-47ac-9bb6-21fd7f2be7f9 {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:16:27 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-f01c89fd-883f-4b59-9f80-63d6d0c91914 tempest-ServerRescueNegativeTestJSON-564949156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:16:27 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-f01c89fd-883f-4b59-9f80-63d6d0c91914 tempest-ServerRescueNegativeTestJSON-564949156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:16:27 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-f01c89fd-883f-4b59-9f80-63d6d0c91914 tempest-ServerRescueNegativeTestJSON-564949156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:16:27 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-f01c89fd-883f-4b59-9f80-63d6d0c91914 tempest-ServerRescueNegativeTestJSON-564949156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:16:27 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-f01c89fd-883f-4b59-9f80-63d6d0c91914 tempest-ServerRescueNegativeTestJSON-564949156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:16:27 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-f01c89fd-883f-4b59-9f80-63d6d0c91914 tempest-ServerRescueNegativeTestJSON-564949156 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:16:27 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-f01c89fd-883f-4b59-9f80-63d6d0c91914 tempest-ServerRescueNegativeTestJSON-564949156 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:16:27 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f01c89fd-883f-4b59-9f80-63d6d0c91914 tempest-ServerRescueNegativeTestJSON-564949156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-798b3f76-f0a0-47ac-9bb6-21fd7f2be7f9 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:16:27 devstack sudo[90683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-798b3f76-f0a0-47ac-9bb6-21fd7f2be7f9 1073741824 Jul 22 03:16:27 devstack sudo[90683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:16:28 devstack sudo[90683]: pam_unix(sudo:session): session closed for user root Jul 22 03:16:28 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f01c89fd-883f-4b59-9f80-63d6d0c91914 tempest-ServerRescueNegativeTestJSON-564949156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-798b3f76-f0a0-47ac-9bb6-21fd7f2be7f9 1073741824" returned: 0 in 1.160s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:16:29 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f01c89fd-883f-4b59-9f80-63d6d0c91914 tempest-ServerRescueNegativeTestJSON-564949156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-798b3f76-f0a0-47ac-9bb6-21fd7f2be7f9 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:16:29 devstack sudo[90698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-798b3f76-f0a0-47ac-9bb6-21fd7f2be7f9 Jul 22 03:16:29 devstack sudo[90698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:16:29 devstack sudo[90698]: pam_unix(sudo:session): session closed for user root Jul 22 03:16:29 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f01c89fd-883f-4b59-9f80-63d6d0c91914 tempest-ServerRescueNegativeTestJSON-564949156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-798b3f76-f0a0-47ac-9bb6-21fd7f2be7f9" returned: 0 in 0.360s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:16:29 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-f01c89fd-883f-4b59-9f80-63d6d0c91914 tempest-ServerRescueNegativeTestJSON-564949156 None] <== create_volume: return (1719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:16:29 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-f01c89fd-883f-4b59-9f80-63d6d0c91914 tempest-ServerRescueNegativeTestJSON-564949156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.725s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:16:29 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f01c89fd-883f-4b59-9f80-63d6d0c91914 tempest-ServerRescueNegativeTestJSON-564949156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c81af666-ab24-477c-a74c-a7297e746f40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-798b3f76-f0a0-47ac-9bb6-21fd7f2be7f9', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:16:29 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f01c89fd-883f-4b59-9f80-63d6d0c91914 tempest-ServerRescueNegativeTestJSON-564949156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d428f39e-7fef-4210-a3e2-5b751f76ab53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:16:29 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-f01c89fd-883f-4b59-9f80-63d6d0c91914 tempest-ServerRescueNegativeTestJSON-564949156 None] Volume volume-798b3f76-f0a0-47ac-9bb6-21fd7f2be7f9 (798b3f76-f0a0-47ac-9bb6-21fd7f2be7f9): created successfully Jul 22 03:16:29 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f01c89fd-883f-4b59-9f80-63d6d0c91914 tempest-ServerRescueNegativeTestJSON-564949156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d428f39e-7fef-4210-a3e2-5b751f76ab53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:16:29 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f01c89fd-883f-4b59-9f80-63d6d0c91914 tempest-ServerRescueNegativeTestJSON-564949156 None] Flow 'volume_create_manager' (75e37f96-5fcb-4392-8b5f-cfea02125069) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:16:29 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-f01c89fd-883f-4b59-9f80-63d6d0c91914 tempest-ServerRescueNegativeTestJSON-564949156 None] Created volume successfully. Jul 22 03:16:39 devstack cinder-volume[87747]: DEBUG dbcounter [-] [87747] Writing DB stats cinder:UPDATE=7,cinder:SELECT=2,cinder:DELETE=1,cinder:INSERT=1 {{(pid=87747) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 03:16:39 devstack cinder-volume[87747]: DEBUG dbcounter [-] [87747] Writing DB stats cinder:SELECT=6,cinder:UPDATE=5,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87747) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 03:16:51 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-aeae72b2-bc4a-4bab-8b51-9dad6415b661 tempest-ServerRescueNegativeTestJSON-564949156 None] Acquiring lock "cinder-798b3f76-f0a0-47ac-9bb6-21fd7f2be7f9-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:16:51 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-aeae72b2-bc4a-4bab-8b51-9dad6415b661 tempest-ServerRescueNegativeTestJSON-564949156 None] Lock "cinder-798b3f76-f0a0-47ac-9bb6-21fd7f2be7f9-delete_volume" acquired by "delete_volume" :: waited 0.088s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:16:51 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-aeae72b2-bc4a-4bab-8b51-9dad6415b661 tempest-ServerRescueNegativeTestJSON-564949156 None] Acquiring lock "cinder-quobyte-798b3f76-f0a0-47ac-9bb6-21fd7f2be7f9" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:16:51 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-aeae72b2-bc4a-4bab-8b51-9dad6415b661 tempest-ServerRescueNegativeTestJSON-564949156 None] Lock "cinder-quobyte-798b3f76-f0a0-47ac-9bb6-21fd7f2be7f9" acquired by "delete_volume" :: waited 0.057s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:16:51 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[309468bf-e847-4e2b-a58e-efda4dc8b666]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:16:51 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-aeae72b2-bc4a-4bab-8b51-9dad6415b661 tempest-ServerRescueNegativeTestJSON-564949156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-798b3f76-f0a0-47ac-9bb6-21fd7f2be7f9 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:16:52 devstack sudo[91020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-798b3f76-f0a0-47ac-9bb6-21fd7f2be7f9 Jul 22 03:16:52 devstack sudo[91020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:16:52 devstack sudo[91020]: pam_unix(sudo:session): session closed for user root Jul 22 03:16:52 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-aeae72b2-bc4a-4bab-8b51-9dad6415b661 tempest-ServerRescueNegativeTestJSON-564949156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-798b3f76-f0a0-47ac-9bb6-21fd7f2be7f9" returned: 0 in 1.036s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:16:52 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-aeae72b2-bc4a-4bab-8b51-9dad6415b661 tempest-ServerRescueNegativeTestJSON-564949156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-798b3f76-f0a0-47ac-9bb6-21fd7f2be7f9 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:16:52 devstack sudo[91029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-798b3f76-f0a0-47ac-9bb6-21fd7f2be7f9 Jul 22 03:16:52 devstack sudo[91029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:16:53 devstack sudo[91029]: pam_unix(sudo:session): session closed for user root Jul 22 03:16:53 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-aeae72b2-bc4a-4bab-8b51-9dad6415b661 tempest-ServerRescueNegativeTestJSON-564949156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-798b3f76-f0a0-47ac-9bb6-21fd7f2be7f9" returned: 0 in 0.417s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:16:53 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-aeae72b2-bc4a-4bab-8b51-9dad6415b661 tempest-ServerRescueNegativeTestJSON-564949156 None] Lock "cinder-quobyte-798b3f76-f0a0-47ac-9bb6-21fd7f2be7f9" released by "delete_volume" :: held 1.613s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:16:53 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-aeae72b2-bc4a-4bab-8b51-9dad6415b661 tempest-ServerRescueNegativeTestJSON-564949156 None] Created reservations ['128d743c-a1ab-4f8f-9b55-a1d9a611e3fb', '562ef786-8417-4449-aeda-0db50ce6a30d', '70cd4244-bd2d-4deb-b0ec-c4e70fc6e40d', 'e16631dd-bf15-489b-b5f7-828a9f8e0030'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:16:53 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-aeae72b2-bc4a-4bab-8b51-9dad6415b661 tempest-ServerRescueNegativeTestJSON-564949156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:16:53 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-aeae72b2-bc4a-4bab-8b51-9dad6415b661 tempest-ServerRescueNegativeTestJSON-564949156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:16:53 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-aeae72b2-bc4a-4bab-8b51-9dad6415b661 tempest-ServerRescueNegativeTestJSON-564949156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:16:53 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-aeae72b2-bc4a-4bab-8b51-9dad6415b661 tempest-ServerRescueNegativeTestJSON-564949156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:16:53 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-aeae72b2-bc4a-4bab-8b51-9dad6415b661 tempest-ServerRescueNegativeTestJSON-564949156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:16:53 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-aeae72b2-bc4a-4bab-8b51-9dad6415b661 tempest-ServerRescueNegativeTestJSON-564949156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:16:53 devstack sudo[91033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:16:53 devstack sudo[91033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:16:54 devstack sudo[91033]: pam_unix(sudo:session): session closed for user root Jul 22 03:16:54 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-aeae72b2-bc4a-4bab-8b51-9dad6415b661 tempest-ServerRescueNegativeTestJSON-564949156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.759s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:16:54 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-aeae72b2-bc4a-4bab-8b51-9dad6415b661 tempest-ServerRescueNegativeTestJSON-564949156 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:16:54 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-aeae72b2-bc4a-4bab-8b51-9dad6415b661 tempest-ServerRescueNegativeTestJSON-564949156 None] Deleted volume successfully. Jul 22 03:16:54 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-aeae72b2-bc4a-4bab-8b51-9dad6415b661 tempest-ServerRescueNegativeTestJSON-564949156 None] Lock "cinder-798b3f76-f0a0-47ac-9bb6-21fd7f2be7f9-delete_volume" released by "delete_volume" :: held 3.005s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:17:03 devstack cinder-volume[87747]: DEBUG dbcounter [-] [87747] Writing DB stats cinder:UPDATE=10,cinder:SELECT=4,cinder:INSERT=1 {{(pid=87747) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 03:17:04 devstack cinder-volume[87747]: DEBUG dbcounter [-] [87747] Writing DB stats cinder:SELECT=6,cinder:INSERT=3,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=87747) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 03:17:09 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d6f469a-485d-4a68-ba3e-86802f79ab1a tempest-ServersNegativeTestJSON-62749118 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:17:09 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-6d6f469a-485d-4a68-ba3e-86802f79ab1a tempest-ServersNegativeTestJSON-62749118 None] Flow 'volume_create_manager' (50e3e5b4-ee79-4f4f-a98a-a25a551a3a49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:17:09 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-6d6f469a-485d-4a68-ba3e-86802f79ab1a tempest-ServersNegativeTestJSON-62749118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f360a724-0409-477c-917d-28b515e76237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:17:09 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-6d6f469a-485d-4a68-ba3e-86802f79ab1a tempest-ServersNegativeTestJSON-62749118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f360a724-0409-477c-917d-28b515e76237) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:17:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1514036015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1aadde32-1555-42d5-a1a5-d08d07ba3ce9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e2f7d8d62db49f8a91831187838494c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:17:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:17:09Z,use_quota=True,user_id='c1e0302d4e45475ba93e7e54bc3f074e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:17:09 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-6d6f469a-485d-4a68-ba3e-86802f79ab1a tempest-ServersNegativeTestJSON-62749118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a18ff6b1-b42e-4a14-9b80-8bd0d23f43fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:17:09 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-6d6f469a-485d-4a68-ba3e-86802f79ab1a tempest-ServersNegativeTestJSON-62749118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a18ff6b1-b42e-4a14-9b80-8bd0d23f43fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:17:09 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-6d6f469a-485d-4a68-ba3e-86802f79ab1a tempest-ServersNegativeTestJSON-62749118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3547c7df-37fd-4798-8efe-eaffed027cf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:17:09 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-6d6f469a-485d-4a68-ba3e-86802f79ab1a tempest-ServersNegativeTestJSON-62749118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3547c7df-37fd-4798-8efe-eaffed027cf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1aadde32-1555-42d5-a1a5-d08d07ba3ce9', 'volume_name': 'volume-1aadde32-1555-42d5-a1a5-d08d07ba3ce9', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:17:09 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-6d6f469a-485d-4a68-ba3e-86802f79ab1a tempest-ServersNegativeTestJSON-62749118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e79ccfc-7a3f-441a-acc2-850fde78011a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:17:09 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-6d6f469a-485d-4a68-ba3e-86802f79ab1a tempest-ServersNegativeTestJSON-62749118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e79ccfc-7a3f-441a-acc2-850fde78011a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:17:09 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-6d6f469a-485d-4a68-ba3e-86802f79ab1a tempest-ServersNegativeTestJSON-62749118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b74256e1-cdd8-4e84-9ced-07e6935781f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:17:09 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-6d6f469a-485d-4a68-ba3e-86802f79ab1a tempest-ServersNegativeTestJSON-62749118 None] Volume 1aadde32-1555-42d5-a1a5-d08d07ba3ce9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1aadde32-1555-42d5-a1a5-d08d07ba3ce9', 'volume_size': 1} Jul 22 03:17:09 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-6d6f469a-485d-4a68-ba3e-86802f79ab1a tempest-ServersNegativeTestJSON-62749118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:17:09 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-6d6f469a-485d-4a68-ba3e-86802f79ab1a tempest-ServersNegativeTestJSON-62749118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:17:09 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-6d6f469a-485d-4a68-ba3e-86802f79ab1a tempest-ServersNegativeTestJSON-62749118 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:17:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1514036015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1aadde32-1555-42d5-a1a5-d08d07ba3ce9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e2f7d8d62db49f8a91831187838494c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:17:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:17:09Z,use_quota=True,user_id='c1e0302d4e45475ba93e7e54bc3f074e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:17:09 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-6d6f469a-485d-4a68-ba3e-86802f79ab1a tempest-ServersNegativeTestJSON-62749118 None] Creating volume 1aadde32-1555-42d5-a1a5-d08d07ba3ce9 {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:17:09 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-6d6f469a-485d-4a68-ba3e-86802f79ab1a tempest-ServersNegativeTestJSON-62749118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:17:09 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-6d6f469a-485d-4a68-ba3e-86802f79ab1a tempest-ServersNegativeTestJSON-62749118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:17:09 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-6d6f469a-485d-4a68-ba3e-86802f79ab1a tempest-ServersNegativeTestJSON-62749118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:17:09 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-6d6f469a-485d-4a68-ba3e-86802f79ab1a tempest-ServersNegativeTestJSON-62749118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:17:09 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-6d6f469a-485d-4a68-ba3e-86802f79ab1a tempest-ServersNegativeTestJSON-62749118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:17:09 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-6d6f469a-485d-4a68-ba3e-86802f79ab1a tempest-ServersNegativeTestJSON-62749118 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:17:09 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-6d6f469a-485d-4a68-ba3e-86802f79ab1a tempest-ServersNegativeTestJSON-62749118 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:17:09 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-6d6f469a-485d-4a68-ba3e-86802f79ab1a tempest-ServersNegativeTestJSON-62749118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1aadde32-1555-42d5-a1a5-d08d07ba3ce9 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:17:09 devstack sudo[91307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1aadde32-1555-42d5-a1a5-d08d07ba3ce9 1073741824 Jul 22 03:17:09 devstack sudo[91307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:17:10 devstack sudo[91307]: pam_unix(sudo:session): session closed for user root Jul 22 03:17:10 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-6d6f469a-485d-4a68-ba3e-86802f79ab1a tempest-ServersNegativeTestJSON-62749118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1aadde32-1555-42d5-a1a5-d08d07ba3ce9 1073741824" returned: 0 in 0.861s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:17:10 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-6d6f469a-485d-4a68-ba3e-86802f79ab1a tempest-ServersNegativeTestJSON-62749118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1aadde32-1555-42d5-a1a5-d08d07ba3ce9 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:17:10 devstack sudo[91313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1aadde32-1555-42d5-a1a5-d08d07ba3ce9 Jul 22 03:17:10 devstack sudo[91313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:17:10 devstack sudo[91313]: pam_unix(sudo:session): session closed for user root Jul 22 03:17:10 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-6d6f469a-485d-4a68-ba3e-86802f79ab1a tempest-ServersNegativeTestJSON-62749118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1aadde32-1555-42d5-a1a5-d08d07ba3ce9" returned: 0 in 0.291s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:17:10 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-6d6f469a-485d-4a68-ba3e-86802f79ab1a tempest-ServersNegativeTestJSON-62749118 None] <== create_volume: return (1207ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:17:10 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-6d6f469a-485d-4a68-ba3e-86802f79ab1a tempest-ServersNegativeTestJSON-62749118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.215s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:17:10 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-6d6f469a-485d-4a68-ba3e-86802f79ab1a tempest-ServersNegativeTestJSON-62749118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b74256e1-cdd8-4e84-9ced-07e6935781f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1aadde32-1555-42d5-a1a5-d08d07ba3ce9', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:17:10 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-6d6f469a-485d-4a68-ba3e-86802f79ab1a tempest-ServersNegativeTestJSON-62749118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbeb7572-d7bb-4639-9738-d8ad11e2d2ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:17:10 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-6d6f469a-485d-4a68-ba3e-86802f79ab1a tempest-ServersNegativeTestJSON-62749118 None] Volume volume-1aadde32-1555-42d5-a1a5-d08d07ba3ce9 (1aadde32-1555-42d5-a1a5-d08d07ba3ce9): created successfully Jul 22 03:17:10 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-6d6f469a-485d-4a68-ba3e-86802f79ab1a tempest-ServersNegativeTestJSON-62749118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbeb7572-d7bb-4639-9738-d8ad11e2d2ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:17:10 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-6d6f469a-485d-4a68-ba3e-86802f79ab1a tempest-ServersNegativeTestJSON-62749118 None] Flow 'volume_create_manager' (50e3e5b4-ee79-4f4f-a98a-a25a551a3a49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:17:10 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-6d6f469a-485d-4a68-ba3e-86802f79ab1a tempest-ServersNegativeTestJSON-62749118 None] Created volume successfully. Jul 22 03:17:13 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-70ba7a85-81c8-4de7-a67b-98547c1e9b03 tempest-ServersNegativeTestJSON-62749118 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:17:13 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-70ba7a85-81c8-4de7-a67b-98547c1e9b03 tempest-ServersNegativeTestJSON-62749118 None] Flow 'volume_create_manager' (6dc84445-cd89-4d9d-a545-b5c3e0dede19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:17:13 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-70ba7a85-81c8-4de7-a67b-98547c1e9b03 tempest-ServersNegativeTestJSON-62749118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf5ecd45-bdcd-48d2-be9c-4f75b2d05e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:17:13 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-70ba7a85-81c8-4de7-a67b-98547c1e9b03 tempest-ServersNegativeTestJSON-62749118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf5ecd45-bdcd-48d2-be9c-4f75b2d05e06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:17:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-584501113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53107865-a67b-45df-b285-799145fcaa1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e2f7d8d62db49f8a91831187838494c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:17:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:17:14Z,use_quota=True,user_id='c1e0302d4e45475ba93e7e54bc3f074e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:17:13 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-70ba7a85-81c8-4de7-a67b-98547c1e9b03 tempest-ServersNegativeTestJSON-62749118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ed37762-4b61-4957-85f8-794f53688edf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:17:13 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-70ba7a85-81c8-4de7-a67b-98547c1e9b03 tempest-ServersNegativeTestJSON-62749118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ed37762-4b61-4957-85f8-794f53688edf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:17:13 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-70ba7a85-81c8-4de7-a67b-98547c1e9b03 tempest-ServersNegativeTestJSON-62749118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cc3d7df-3f94-4520-970e-9412f7083202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:17:13 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-70ba7a85-81c8-4de7-a67b-98547c1e9b03 tempest-ServersNegativeTestJSON-62749118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cc3d7df-3f94-4520-970e-9412f7083202) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53107865-a67b-45df-b285-799145fcaa1d', 'volume_name': 'volume-53107865-a67b-45df-b285-799145fcaa1d', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:17:13 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-70ba7a85-81c8-4de7-a67b-98547c1e9b03 tempest-ServersNegativeTestJSON-62749118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (436bc4b1-d6ee-4294-a117-88c28d9e3606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:17:13 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-70ba7a85-81c8-4de7-a67b-98547c1e9b03 tempest-ServersNegativeTestJSON-62749118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (436bc4b1-d6ee-4294-a117-88c28d9e3606) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:17:13 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-70ba7a85-81c8-4de7-a67b-98547c1e9b03 tempest-ServersNegativeTestJSON-62749118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76829ac4-a72c-4fe1-b080-4518d30c39f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:17:13 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-70ba7a85-81c8-4de7-a67b-98547c1e9b03 tempest-ServersNegativeTestJSON-62749118 None] Volume 53107865-a67b-45df-b285-799145fcaa1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53107865-a67b-45df-b285-799145fcaa1d', 'volume_size': 1} Jul 22 03:17:13 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-70ba7a85-81c8-4de7-a67b-98547c1e9b03 tempest-ServersNegativeTestJSON-62749118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:17:13 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-70ba7a85-81c8-4de7-a67b-98547c1e9b03 tempest-ServersNegativeTestJSON-62749118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:17:13 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-70ba7a85-81c8-4de7-a67b-98547c1e9b03 tempest-ServersNegativeTestJSON-62749118 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:17:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-584501113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53107865-a67b-45df-b285-799145fcaa1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e2f7d8d62db49f8a91831187838494c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:17:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:17:14Z,use_quota=True,user_id='c1e0302d4e45475ba93e7e54bc3f074e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:17:13 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-70ba7a85-81c8-4de7-a67b-98547c1e9b03 tempest-ServersNegativeTestJSON-62749118 None] Creating volume 53107865-a67b-45df-b285-799145fcaa1d {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:17:13 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-70ba7a85-81c8-4de7-a67b-98547c1e9b03 tempest-ServersNegativeTestJSON-62749118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:17:13 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-70ba7a85-81c8-4de7-a67b-98547c1e9b03 tempest-ServersNegativeTestJSON-62749118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:17:13 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-70ba7a85-81c8-4de7-a67b-98547c1e9b03 tempest-ServersNegativeTestJSON-62749118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:17:14 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-70ba7a85-81c8-4de7-a67b-98547c1e9b03 tempest-ServersNegativeTestJSON-62749118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:17:14 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-70ba7a85-81c8-4de7-a67b-98547c1e9b03 tempest-ServersNegativeTestJSON-62749118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:17:14 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-70ba7a85-81c8-4de7-a67b-98547c1e9b03 tempest-ServersNegativeTestJSON-62749118 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:17:14 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-70ba7a85-81c8-4de7-a67b-98547c1e9b03 tempest-ServersNegativeTestJSON-62749118 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:17:14 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-70ba7a85-81c8-4de7-a67b-98547c1e9b03 tempest-ServersNegativeTestJSON-62749118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-53107865-a67b-45df-b285-799145fcaa1d 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:17:14 devstack sudo[91350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-53107865-a67b-45df-b285-799145fcaa1d 1073741824 Jul 22 03:17:14 devstack sudo[91350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:17:14 devstack sudo[91350]: pam_unix(sudo:session): session closed for user root Jul 22 03:17:14 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-70ba7a85-81c8-4de7-a67b-98547c1e9b03 tempest-ServersNegativeTestJSON-62749118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-53107865-a67b-45df-b285-799145fcaa1d 1073741824" returned: 0 in 0.527s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:17:14 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-70ba7a85-81c8-4de7-a67b-98547c1e9b03 tempest-ServersNegativeTestJSON-62749118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-53107865-a67b-45df-b285-799145fcaa1d {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:17:14 devstack sudo[91361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-53107865-a67b-45df-b285-799145fcaa1d Jul 22 03:17:14 devstack sudo[91361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:17:15 devstack sudo[91361]: pam_unix(sudo:session): session closed for user root Jul 22 03:17:15 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-70ba7a85-81c8-4de7-a67b-98547c1e9b03 tempest-ServersNegativeTestJSON-62749118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-53107865-a67b-45df-b285-799145fcaa1d" returned: 0 in 0.451s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:17:15 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-70ba7a85-81c8-4de7-a67b-98547c1e9b03 tempest-ServersNegativeTestJSON-62749118 None] <== create_volume: return (1045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:17:15 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-70ba7a85-81c8-4de7-a67b-98547c1e9b03 tempest-ServersNegativeTestJSON-62749118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.048s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:17:15 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-70ba7a85-81c8-4de7-a67b-98547c1e9b03 tempest-ServersNegativeTestJSON-62749118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76829ac4-a72c-4fe1-b080-4518d30c39f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53107865-a67b-45df-b285-799145fcaa1d', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:17:15 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-70ba7a85-81c8-4de7-a67b-98547c1e9b03 tempest-ServersNegativeTestJSON-62749118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ff72c2c-bb60-4695-b13d-57dd738d133b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:17:15 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-70ba7a85-81c8-4de7-a67b-98547c1e9b03 tempest-ServersNegativeTestJSON-62749118 None] Volume volume-53107865-a67b-45df-b285-799145fcaa1d (53107865-a67b-45df-b285-799145fcaa1d): created successfully Jul 22 03:17:15 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-70ba7a85-81c8-4de7-a67b-98547c1e9b03 tempest-ServersNegativeTestJSON-62749118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ff72c2c-bb60-4695-b13d-57dd738d133b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:17:15 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-70ba7a85-81c8-4de7-a67b-98547c1e9b03 tempest-ServersNegativeTestJSON-62749118 None] Flow 'volume_create_manager' (6dc84445-cd89-4d9d-a545-b5c3e0dede19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:17:15 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-70ba7a85-81c8-4de7-a67b-98547c1e9b03 tempest-ServersNegativeTestJSON-62749118 None] Created volume successfully. Jul 22 03:17:16 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-c587bddf-a2d6-47fd-81ff-6306d9e6a89d tempest-ServersNegativeTestJSON-62749118 None] Acquiring lock "cinder-53107865-a67b-45df-b285-799145fcaa1d-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:17:16 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-c587bddf-a2d6-47fd-81ff-6306d9e6a89d tempest-ServersNegativeTestJSON-62749118 None] Lock "cinder-53107865-a67b-45df-b285-799145fcaa1d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:17:16 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-c587bddf-a2d6-47fd-81ff-6306d9e6a89d tempest-ServersNegativeTestJSON-62749118 None] Acquiring lock "cinder-quobyte-53107865-a67b-45df-b285-799145fcaa1d" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:17:16 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-c587bddf-a2d6-47fd-81ff-6306d9e6a89d tempest-ServersNegativeTestJSON-62749118 None] Lock "cinder-quobyte-53107865-a67b-45df-b285-799145fcaa1d" acquired by "delete_volume" :: waited 0.027s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:17:16 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[004dd9a8-6a9a-43a7-a57a-a6884fc9f10a]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:17:16 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-c587bddf-a2d6-47fd-81ff-6306d9e6a89d tempest-ServersNegativeTestJSON-62749118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-53107865-a67b-45df-b285-799145fcaa1d {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:17:16 devstack sudo[91366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-53107865-a67b-45df-b285-799145fcaa1d Jul 22 03:17:16 devstack sudo[91366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:17:16 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [req-b2530382-74c1-4a78-aa7d-778b5e97d8c4 req-ddefbb23-785f-4e2a-a9ed-e93f76181712 tempest-VolumesGetTestJSON-678843230 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:17:16 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [req-b2530382-74c1-4a78-aa7d-778b5e97d8c4 req-ddefbb23-785f-4e2a-a9ed-e93f76181712 tempest-VolumesGetTestJSON-678843230 None] Flow 'volume_create_manager' (448145d6-3c48-4543-82a9-35125bdb3875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:17:16 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [req-b2530382-74c1-4a78-aa7d-778b5e97d8c4 req-ddefbb23-785f-4e2a-a9ed-e93f76181712 tempest-VolumesGetTestJSON-678843230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b9f39da-36ee-45d9-bc44-04e18e2af95f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:17:16 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [req-b2530382-74c1-4a78-aa7d-778b5e97d8c4 req-ddefbb23-785f-4e2a-a9ed-e93f76181712 tempest-VolumesGetTestJSON-678843230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b9f39da-36ee-45d9-bc44-04e18e2af95f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:17:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-154717540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71812073-e34e-42d9-a5c7-7b4b6e7443e6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c4c315bb4f4c4c5fada9437bfce7698f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:17:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:17:17Z,use_quota=True,user_id='82e4b86aee8c4aa18929a3fce6a97058',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:17:16 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [req-b2530382-74c1-4a78-aa7d-778b5e97d8c4 req-ddefbb23-785f-4e2a-a9ed-e93f76181712 tempest-VolumesGetTestJSON-678843230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (880e5a41-1a6c-44d4-be6c-20517185b0ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:17:16 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [req-b2530382-74c1-4a78-aa7d-778b5e97d8c4 req-ddefbb23-785f-4e2a-a9ed-e93f76181712 tempest-VolumesGetTestJSON-678843230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (880e5a41-1a6c-44d4-be6c-20517185b0ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:17:16 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [req-b2530382-74c1-4a78-aa7d-778b5e97d8c4 req-ddefbb23-785f-4e2a-a9ed-e93f76181712 tempest-VolumesGetTestJSON-678843230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5582f8cb-5ebd-4c52-a52f-3ca4af52353f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:17:16 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [req-b2530382-74c1-4a78-aa7d-778b5e97d8c4 req-ddefbb23-785f-4e2a-a9ed-e93f76181712 tempest-VolumesGetTestJSON-678843230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5582f8cb-5ebd-4c52-a52f-3ca4af52353f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71812073-e34e-42d9-a5c7-7b4b6e7443e6', 'volume_name': 'volume-71812073-e34e-42d9-a5c7-7b4b6e7443e6', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:17:16 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [req-b2530382-74c1-4a78-aa7d-778b5e97d8c4 req-ddefbb23-785f-4e2a-a9ed-e93f76181712 tempest-VolumesGetTestJSON-678843230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fec4e724-159a-48fd-ad3c-83027a1ef75b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:17:16 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [req-b2530382-74c1-4a78-aa7d-778b5e97d8c4 req-ddefbb23-785f-4e2a-a9ed-e93f76181712 tempest-VolumesGetTestJSON-678843230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fec4e724-159a-48fd-ad3c-83027a1ef75b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:17:16 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [req-b2530382-74c1-4a78-aa7d-778b5e97d8c4 req-ddefbb23-785f-4e2a-a9ed-e93f76181712 tempest-VolumesGetTestJSON-678843230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50a2fd3b-d001-45e6-9e36-6c7932f0eca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:17:16 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [req-b2530382-74c1-4a78-aa7d-778b5e97d8c4 req-ddefbb23-785f-4e2a-a9ed-e93f76181712 tempest-VolumesGetTestJSON-678843230 None] Volume 71812073-e34e-42d9-a5c7-7b4b6e7443e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71812073-e34e-42d9-a5c7-7b4b6e7443e6', 'volume_size': 1} Jul 22 03:17:16 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [req-b2530382-74c1-4a78-aa7d-778b5e97d8c4 req-ddefbb23-785f-4e2a-a9ed-e93f76181712 tempest-VolumesGetTestJSON-678843230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:17:16 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [req-b2530382-74c1-4a78-aa7d-778b5e97d8c4 req-ddefbb23-785f-4e2a-a9ed-e93f76181712 tempest-VolumesGetTestJSON-678843230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:17:16 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [req-b2530382-74c1-4a78-aa7d-778b5e97d8c4 req-ddefbb23-785f-4e2a-a9ed-e93f76181712 tempest-VolumesGetTestJSON-678843230 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:17:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-154717540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71812073-e34e-42d9-a5c7-7b4b6e7443e6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c4c315bb4f4c4c5fada9437bfce7698f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:17:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:17:17Z,use_quota=True,user_id='82e4b86aee8c4aa18929a3fce6a97058',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:17:16 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [req-b2530382-74c1-4a78-aa7d-778b5e97d8c4 req-ddefbb23-785f-4e2a-a9ed-e93f76181712 tempest-VolumesGetTestJSON-678843230 None] Creating volume 71812073-e34e-42d9-a5c7-7b4b6e7443e6 {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:17:16 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [req-b2530382-74c1-4a78-aa7d-778b5e97d8c4 req-ddefbb23-785f-4e2a-a9ed-e93f76181712 tempest-VolumesGetTestJSON-678843230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:17:16 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [req-b2530382-74c1-4a78-aa7d-778b5e97d8c4 req-ddefbb23-785f-4e2a-a9ed-e93f76181712 tempest-VolumesGetTestJSON-678843230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:17:16 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [req-b2530382-74c1-4a78-aa7d-778b5e97d8c4 req-ddefbb23-785f-4e2a-a9ed-e93f76181712 tempest-VolumesGetTestJSON-678843230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:17:16 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [req-b2530382-74c1-4a78-aa7d-778b5e97d8c4 req-ddefbb23-785f-4e2a-a9ed-e93f76181712 tempest-VolumesGetTestJSON-678843230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:17:16 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [req-b2530382-74c1-4a78-aa7d-778b5e97d8c4 req-ddefbb23-785f-4e2a-a9ed-e93f76181712 tempest-VolumesGetTestJSON-678843230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:17:16 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [req-b2530382-74c1-4a78-aa7d-778b5e97d8c4 req-ddefbb23-785f-4e2a-a9ed-e93f76181712 tempest-VolumesGetTestJSON-678843230 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:17:16 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [req-b2530382-74c1-4a78-aa7d-778b5e97d8c4 req-ddefbb23-785f-4e2a-a9ed-e93f76181712 tempest-VolumesGetTestJSON-678843230 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:17:16 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [req-b2530382-74c1-4a78-aa7d-778b5e97d8c4 req-ddefbb23-785f-4e2a-a9ed-e93f76181712 tempest-VolumesGetTestJSON-678843230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-71812073-e34e-42d9-a5c7-7b4b6e7443e6 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:17:16 devstack sudo[91368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-71812073-e34e-42d9-a5c7-7b4b6e7443e6 1073741824 Jul 22 03:17:16 devstack sudo[91368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:17:16 devstack sudo[91366]: pam_unix(sudo:session): session closed for user root Jul 22 03:17:16 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-c587bddf-a2d6-47fd-81ff-6306d9e6a89d tempest-ServersNegativeTestJSON-62749118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-53107865-a67b-45df-b285-799145fcaa1d" returned: 0 in 0.400s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:17:16 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-c587bddf-a2d6-47fd-81ff-6306d9e6a89d tempest-ServersNegativeTestJSON-62749118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-53107865-a67b-45df-b285-799145fcaa1d {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:17:16 devstack sudo[91374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-53107865-a67b-45df-b285-799145fcaa1d Jul 22 03:17:16 devstack sudo[91374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:17:17 devstack sudo[91374]: pam_unix(sudo:session): session closed for user root Jul 22 03:17:17 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-c587bddf-a2d6-47fd-81ff-6306d9e6a89d tempest-ServersNegativeTestJSON-62749118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-53107865-a67b-45df-b285-799145fcaa1d" returned: 0 in 0.243s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:17:17 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-c587bddf-a2d6-47fd-81ff-6306d9e6a89d tempest-ServersNegativeTestJSON-62749118 None] Lock "cinder-quobyte-53107865-a67b-45df-b285-799145fcaa1d" released by "delete_volume" :: held 0.699s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:17:17 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-c587bddf-a2d6-47fd-81ff-6306d9e6a89d tempest-ServersNegativeTestJSON-62749118 None] Created reservations ['41d5b9a9-b0a7-45cb-b120-700fd6db8b8a', '5a735111-5d60-4537-a269-beda3b5faba8', '7ac12351-462c-4af5-8f2b-55ae6d6e6b7b', '9a29decd-889b-4334-b7fa-1350c0979676'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:17:17 devstack sudo[91368]: pam_unix(sudo:session): session closed for user root Jul 22 03:17:17 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [req-b2530382-74c1-4a78-aa7d-778b5e97d8c4 req-ddefbb23-785f-4e2a-a9ed-e93f76181712 tempest-VolumesGetTestJSON-678843230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-71812073-e34e-42d9-a5c7-7b4b6e7443e6 1073741824" returned: 0 in 0.431s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:17:17 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [req-b2530382-74c1-4a78-aa7d-778b5e97d8c4 req-ddefbb23-785f-4e2a-a9ed-e93f76181712 tempest-VolumesGetTestJSON-678843230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-71812073-e34e-42d9-a5c7-7b4b6e7443e6 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:17:17 devstack sudo[91381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-71812073-e34e-42d9-a5c7-7b4b6e7443e6 Jul 22 03:17:17 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-c587bddf-a2d6-47fd-81ff-6306d9e6a89d tempest-ServersNegativeTestJSON-62749118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:17:17 devstack sudo[91381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:17:17 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-c587bddf-a2d6-47fd-81ff-6306d9e6a89d tempest-ServersNegativeTestJSON-62749118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:17:17 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-c587bddf-a2d6-47fd-81ff-6306d9e6a89d tempest-ServersNegativeTestJSON-62749118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:17:17 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-c587bddf-a2d6-47fd-81ff-6306d9e6a89d tempest-ServersNegativeTestJSON-62749118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:17:17 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-c587bddf-a2d6-47fd-81ff-6306d9e6a89d tempest-ServersNegativeTestJSON-62749118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:17:17 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-c587bddf-a2d6-47fd-81ff-6306d9e6a89d tempest-ServersNegativeTestJSON-62749118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:17:17 devstack sudo[91383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:17:17 devstack sudo[91383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:17:17 devstack sudo[91381]: pam_unix(sudo:session): session closed for user root Jul 22 03:17:17 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [req-b2530382-74c1-4a78-aa7d-778b5e97d8c4 req-ddefbb23-785f-4e2a-a9ed-e93f76181712 tempest-VolumesGetTestJSON-678843230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-71812073-e34e-42d9-a5c7-7b4b6e7443e6" returned: 0 in 0.250s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:17:17 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [req-b2530382-74c1-4a78-aa7d-778b5e97d8c4 req-ddefbb23-785f-4e2a-a9ed-e93f76181712 tempest-VolumesGetTestJSON-678843230 None] <== create_volume: return (741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:17:17 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [req-b2530382-74c1-4a78-aa7d-778b5e97d8c4 req-ddefbb23-785f-4e2a-a9ed-e93f76181712 tempest-VolumesGetTestJSON-678843230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.746s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:17:17 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [req-b2530382-74c1-4a78-aa7d-778b5e97d8c4 req-ddefbb23-785f-4e2a-a9ed-e93f76181712 tempest-VolumesGetTestJSON-678843230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50a2fd3b-d001-45e6-9e36-6c7932f0eca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71812073-e34e-42d9-a5c7-7b4b6e7443e6', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:17:17 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [req-b2530382-74c1-4a78-aa7d-778b5e97d8c4 req-ddefbb23-785f-4e2a-a9ed-e93f76181712 tempest-VolumesGetTestJSON-678843230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2022f83c-1d0c-4ac1-ba4f-824e0727ed86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:17:17 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-5efcf1c6-e639-4a7f-b057-2ddace6eaa54 tempest-ServersNegativeTestJSON-62749118 None] Acquiring lock "cinder-1aadde32-1555-42d5-a1a5-d08d07ba3ce9-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:17:17 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [req-b2530382-74c1-4a78-aa7d-778b5e97d8c4 req-ddefbb23-785f-4e2a-a9ed-e93f76181712 tempest-VolumesGetTestJSON-678843230 None] Volume volume-71812073-e34e-42d9-a5c7-7b4b6e7443e6 (71812073-e34e-42d9-a5c7-7b4b6e7443e6): created successfully Jul 22 03:17:17 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [req-b2530382-74c1-4a78-aa7d-778b5e97d8c4 req-ddefbb23-785f-4e2a-a9ed-e93f76181712 tempest-VolumesGetTestJSON-678843230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2022f83c-1d0c-4ac1-ba4f-824e0727ed86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:17:17 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [req-b2530382-74c1-4a78-aa7d-778b5e97d8c4 req-ddefbb23-785f-4e2a-a9ed-e93f76181712 tempest-VolumesGetTestJSON-678843230 None] Flow 'volume_create_manager' (448145d6-3c48-4543-82a9-35125bdb3875) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:17:17 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-5efcf1c6-e639-4a7f-b057-2ddace6eaa54 tempest-ServersNegativeTestJSON-62749118 None] Lock "cinder-1aadde32-1555-42d5-a1a5-d08d07ba3ce9-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:17:17 devstack cinder-volume[87747]: INFO cinder.volume.manager [req-b2530382-74c1-4a78-aa7d-778b5e97d8c4 req-ddefbb23-785f-4e2a-a9ed-e93f76181712 tempest-VolumesGetTestJSON-678843230 None] Created volume successfully. Jul 22 03:17:17 devstack sudo[91383]: pam_unix(sudo:session): session closed for user root Jul 22 03:17:17 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-c587bddf-a2d6-47fd-81ff-6306d9e6a89d tempest-ServersNegativeTestJSON-62749118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.335s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:17:17 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-c587bddf-a2d6-47fd-81ff-6306d9e6a89d tempest-ServersNegativeTestJSON-62749118 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:17:17 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-5efcf1c6-e639-4a7f-b057-2ddace6eaa54 tempest-ServersNegativeTestJSON-62749118 None] Acquiring lock "cinder-quobyte-1aadde32-1555-42d5-a1a5-d08d07ba3ce9" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:17:17 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-c587bddf-a2d6-47fd-81ff-6306d9e6a89d tempest-ServersNegativeTestJSON-62749118 None] Deleted volume successfully. Jul 22 03:17:17 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-5efcf1c6-e639-4a7f-b057-2ddace6eaa54 tempest-ServersNegativeTestJSON-62749118 None] Lock "cinder-quobyte-1aadde32-1555-42d5-a1a5-d08d07ba3ce9" acquired by "delete_volume" :: waited 0.039s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:17:17 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-c587bddf-a2d6-47fd-81ff-6306d9e6a89d tempest-ServersNegativeTestJSON-62749118 None] Lock "cinder-53107865-a67b-45df-b285-799145fcaa1d-delete_volume" released by "delete_volume" :: held 1.341s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:17:17 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa316c8d-d012-4592-908d-ce667b959cc9]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:17:17 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5efcf1c6-e639-4a7f-b057-2ddace6eaa54 tempest-ServersNegativeTestJSON-62749118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1aadde32-1555-42d5-a1a5-d08d07ba3ce9 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:17:17 devstack sudo[91387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1aadde32-1555-42d5-a1a5-d08d07ba3ce9 Jul 22 03:17:17 devstack sudo[91387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:17:18 devstack cinder-volume[87747]: DEBUG cinder.coordination [req-85acadbe-7b93-4ad1-b425-3c26f4f50991 req-d8cabf41-f650-4a89-b7aa-242a1c439196 tempest-VolumesGetTestJSON-678843230 None] Acquiring lock "cinder-71812073-e34e-42d9-a5c7-7b4b6e7443e6-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:17:18 devstack cinder-volume[87747]: DEBUG cinder.coordination [req-85acadbe-7b93-4ad1-b425-3c26f4f50991 req-d8cabf41-f650-4a89-b7aa-242a1c439196 tempest-VolumesGetTestJSON-678843230 None] Lock "cinder-71812073-e34e-42d9-a5c7-7b4b6e7443e6-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:17:18 devstack cinder-volume[87747]: DEBUG cinder.coordination [req-85acadbe-7b93-4ad1-b425-3c26f4f50991 req-d8cabf41-f650-4a89-b7aa-242a1c439196 tempest-VolumesGetTestJSON-678843230 None] Acquiring lock "cinder-quobyte-71812073-e34e-42d9-a5c7-7b4b6e7443e6" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:17:18 devstack cinder-volume[87747]: DEBUG cinder.coordination [req-85acadbe-7b93-4ad1-b425-3c26f4f50991 req-d8cabf41-f650-4a89-b7aa-242a1c439196 tempest-VolumesGetTestJSON-678843230 None] Lock "cinder-quobyte-71812073-e34e-42d9-a5c7-7b4b6e7443e6" acquired by "delete_volume" :: waited 0.023s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:17:18 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[b31a2409-6baa-455e-a128-426a938815c6]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:17:18 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [req-85acadbe-7b93-4ad1-b425-3c26f4f50991 req-d8cabf41-f650-4a89-b7aa-242a1c439196 tempest-VolumesGetTestJSON-678843230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-71812073-e34e-42d9-a5c7-7b4b6e7443e6 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:17:18 devstack sudo[91387]: pam_unix(sudo:session): session closed for user root Jul 22 03:17:18 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5efcf1c6-e639-4a7f-b057-2ddace6eaa54 tempest-ServersNegativeTestJSON-62749118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1aadde32-1555-42d5-a1a5-d08d07ba3ce9" returned: 0 in 0.461s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:17:18 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5efcf1c6-e639-4a7f-b057-2ddace6eaa54 tempest-ServersNegativeTestJSON-62749118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1aadde32-1555-42d5-a1a5-d08d07ba3ce9 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:17:18 devstack sudo[91413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1aadde32-1555-42d5-a1a5-d08d07ba3ce9 Jul 22 03:17:18 devstack sudo[91413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:17:18 devstack sudo[91412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-71812073-e34e-42d9-a5c7-7b4b6e7443e6 Jul 22 03:17:18 devstack sudo[91412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:17:18 devstack sudo[91413]: pam_unix(sudo:session): session closed for user root Jul 22 03:17:18 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5efcf1c6-e639-4a7f-b057-2ddace6eaa54 tempest-ServersNegativeTestJSON-62749118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1aadde32-1555-42d5-a1a5-d08d07ba3ce9" returned: 0 in 0.279s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:17:18 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-5efcf1c6-e639-4a7f-b057-2ddace6eaa54 tempest-ServersNegativeTestJSON-62749118 None] Lock "cinder-quobyte-1aadde32-1555-42d5-a1a5-d08d07ba3ce9" released by "delete_volume" :: held 0.805s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:17:18 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-5efcf1c6-e639-4a7f-b057-2ddace6eaa54 tempest-ServersNegativeTestJSON-62749118 None] Created reservations ['70709af4-352a-46c5-8f9c-d44b211d9501', '0ec6c1af-1834-4545-ad5a-d79b41f6a9be', 'dcf260fd-ca78-413d-b1ec-f7ab631afef4', '04361a24-ca00-4ab3-a52a-d27ce1d54732'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:17:18 devstack sudo[91412]: pam_unix(sudo:session): session closed for user root Jul 22 03:17:18 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [req-85acadbe-7b93-4ad1-b425-3c26f4f50991 req-d8cabf41-f650-4a89-b7aa-242a1c439196 tempest-VolumesGetTestJSON-678843230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-71812073-e34e-42d9-a5c7-7b4b6e7443e6" returned: 0 in 0.391s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:17:18 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [req-85acadbe-7b93-4ad1-b425-3c26f4f50991 req-d8cabf41-f650-4a89-b7aa-242a1c439196 tempest-VolumesGetTestJSON-678843230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-71812073-e34e-42d9-a5c7-7b4b6e7443e6 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:17:18 devstack sudo[91420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-71812073-e34e-42d9-a5c7-7b4b6e7443e6 Jul 22 03:17:18 devstack sudo[91420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:17:18 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-5efcf1c6-e639-4a7f-b057-2ddace6eaa54 tempest-ServersNegativeTestJSON-62749118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:17:18 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-5efcf1c6-e639-4a7f-b057-2ddace6eaa54 tempest-ServersNegativeTestJSON-62749118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:17:18 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-5efcf1c6-e639-4a7f-b057-2ddace6eaa54 tempest-ServersNegativeTestJSON-62749118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:17:18 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-5efcf1c6-e639-4a7f-b057-2ddace6eaa54 tempest-ServersNegativeTestJSON-62749118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:17:18 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-5efcf1c6-e639-4a7f-b057-2ddace6eaa54 tempest-ServersNegativeTestJSON-62749118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:17:18 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5efcf1c6-e639-4a7f-b057-2ddace6eaa54 tempest-ServersNegativeTestJSON-62749118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:17:18 devstack sudo[91422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:17:18 devstack sudo[91422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:17:18 devstack sudo[91420]: pam_unix(sudo:session): session closed for user root Jul 22 03:17:18 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [req-85acadbe-7b93-4ad1-b425-3c26f4f50991 req-d8cabf41-f650-4a89-b7aa-242a1c439196 tempest-VolumesGetTestJSON-678843230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-71812073-e34e-42d9-a5c7-7b4b6e7443e6" returned: 0 in 0.279s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:17:18 devstack cinder-volume[87747]: DEBUG cinder.coordination [req-85acadbe-7b93-4ad1-b425-3c26f4f50991 req-d8cabf41-f650-4a89-b7aa-242a1c439196 tempest-VolumesGetTestJSON-678843230 None] Lock "cinder-quobyte-71812073-e34e-42d9-a5c7-7b4b6e7443e6" released by "delete_volume" :: held 0.723s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:17:18 devstack sudo[91422]: pam_unix(sudo:session): session closed for user root Jul 22 03:17:18 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5efcf1c6-e639-4a7f-b057-2ddace6eaa54 tempest-ServersNegativeTestJSON-62749118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.272s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:17:18 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-5efcf1c6-e639-4a7f-b057-2ddace6eaa54 tempest-ServersNegativeTestJSON-62749118 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:17:18 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-5efcf1c6-e639-4a7f-b057-2ddace6eaa54 tempest-ServersNegativeTestJSON-62749118 None] Deleted volume successfully. Jul 22 03:17:18 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-5efcf1c6-e639-4a7f-b057-2ddace6eaa54 tempest-ServersNegativeTestJSON-62749118 None] Lock "cinder-1aadde32-1555-42d5-a1a5-d08d07ba3ce9-delete_volume" released by "delete_volume" :: held 1.320s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:17:18 devstack cinder-volume[87747]: DEBUG cinder.quota [req-85acadbe-7b93-4ad1-b425-3c26f4f50991 req-d8cabf41-f650-4a89-b7aa-242a1c439196 tempest-VolumesGetTestJSON-678843230 None] Created reservations ['2a7ac2a8-6248-4490-9848-24bcfc987adb', '89f37b5a-3d28-496d-b150-b0c4b8a80475', '788a9a98-8eb3-41e6-8324-ee269a5e6970', 'f55e891f-48ec-4a9c-9d2e-294649266e7e'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:17:19 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [req-85acadbe-7b93-4ad1-b425-3c26f4f50991 req-d8cabf41-f650-4a89-b7aa-242a1c439196 tempest-VolumesGetTestJSON-678843230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:17:19 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [req-85acadbe-7b93-4ad1-b425-3c26f4f50991 req-d8cabf41-f650-4a89-b7aa-242a1c439196 tempest-VolumesGetTestJSON-678843230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:17:19 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [req-85acadbe-7b93-4ad1-b425-3c26f4f50991 req-d8cabf41-f650-4a89-b7aa-242a1c439196 tempest-VolumesGetTestJSON-678843230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:17:19 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [req-85acadbe-7b93-4ad1-b425-3c26f4f50991 req-d8cabf41-f650-4a89-b7aa-242a1c439196 tempest-VolumesGetTestJSON-678843230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:17:19 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [req-85acadbe-7b93-4ad1-b425-3c26f4f50991 req-d8cabf41-f650-4a89-b7aa-242a1c439196 tempest-VolumesGetTestJSON-678843230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:17:19 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [req-85acadbe-7b93-4ad1-b425-3c26f4f50991 req-d8cabf41-f650-4a89-b7aa-242a1c439196 tempest-VolumesGetTestJSON-678843230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:17:19 devstack sudo[91427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:17:19 devstack sudo[91427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:17:19 devstack sudo[91427]: pam_unix(sudo:session): session closed for user root Jul 22 03:17:19 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [req-85acadbe-7b93-4ad1-b425-3c26f4f50991 req-d8cabf41-f650-4a89-b7aa-242a1c439196 tempest-VolumesGetTestJSON-678843230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.265s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:17:19 devstack cinder-volume[87747]: DEBUG cinder.manager [req-85acadbe-7b93-4ad1-b425-3c26f4f50991 req-d8cabf41-f650-4a89-b7aa-242a1c439196 tempest-VolumesGetTestJSON-678843230 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:17:19 devstack cinder-volume[87747]: INFO cinder.volume.manager [req-85acadbe-7b93-4ad1-b425-3c26f4f50991 req-d8cabf41-f650-4a89-b7aa-242a1c439196 tempest-VolumesGetTestJSON-678843230 None] Deleted volume successfully. Jul 22 03:17:19 devstack cinder-volume[87747]: DEBUG cinder.coordination [req-85acadbe-7b93-4ad1-b425-3c26f4f50991 req-d8cabf41-f650-4a89-b7aa-242a1c439196 tempest-VolumesGetTestJSON-678843230 None] Lock "cinder-71812073-e34e-42d9-a5c7-7b4b6e7443e6-delete_volume" released by "delete_volume" :: held 1.260s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:17:22 devstack cinder-volume[87747]: DEBUG oslo_service.periodic_task [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87747) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 03:17:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:17:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:17:22 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:17:22 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:17:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:17:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:17:22 devstack sudo[91456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:17:22 devstack sudo[91456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:17:22 devstack sudo[91456]: pam_unix(sudo:session): session closed for user root Jul 22 03:17:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.249s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:17:22 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:17:22 devstack cinder-volume[87747]: DEBUG oslo_service.periodic_task [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Running periodic task VolumeManager._thread_info {{(pid=87747) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 03:17:22 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] thread count: 8 {{(pid=87747) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 22 03:17:22 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] thread info: [<_MainThread(MainThread, started 132775275860096)>, , , , , , , ] {{(pid=87747) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 22 03:17:26 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [req-4584056f-52ff-4f7f-9517-062095a74289 req-9dad5060-0480-42e5-b473-5dbf1bbdb054 tempest-ServerActionsTestOtherA-1302037554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:17:26 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [req-4584056f-52ff-4f7f-9517-062095a74289 req-9dad5060-0480-42e5-b473-5dbf1bbdb054 tempest-ServerActionsTestOtherA-1302037554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:17:26 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [req-4584056f-52ff-4f7f-9517-062095a74289 req-9dad5060-0480-42e5-b473-5dbf1bbdb054 tempest-ServerActionsTestOtherA-1302037554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:17:26 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [req-4584056f-52ff-4f7f-9517-062095a74289 req-9dad5060-0480-42e5-b473-5dbf1bbdb054 tempest-ServerActionsTestOtherA-1302037554 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f', 'name': 'volume-a50b8bc6-d68e-41fb-a2f4-2645492d16eb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fa476e4a-37f5-41e3-bb32-3c0c13616614', 'enforce_multipath': True} {{(pid=87747) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 22 03:17:26 devstack cinder-volume[87747]: INFO cinder.volume.manager [req-4584056f-52ff-4f7f-9517-062095a74289 req-9dad5060-0480-42e5-b473-5dbf1bbdb054 tempest-ServerActionsTestOtherA-1302037554 None] attachment_update completed successfully. Jul 22 03:17:29 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-f32fcdc3-e4a0-4ae9-bdfa-847a975c0aa9 tempest-AttachVolumeTestJSON-158955983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:17:29 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f32fcdc3-e4a0-4ae9-bdfa-847a975c0aa9 tempest-AttachVolumeTestJSON-158955983 None] Flow 'volume_create_manager' (6ad3ff19-e2da-4aea-822b-1be01093a949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:17:29 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f32fcdc3-e4a0-4ae9-bdfa-847a975c0aa9 tempest-AttachVolumeTestJSON-158955983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1a4c4af-d455-463d-9a4f-e885f78e73e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:17:29 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f32fcdc3-e4a0-4ae9-bdfa-847a975c0aa9 tempest-AttachVolumeTestJSON-158955983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1a4c4af-d455-463d-9a4f-e885f78e73e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:17:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-831133018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=415616d9-0b0d-49a9-8271-9bea99f564b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='867b2b7c0ce34c16b16c490a61e37294',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:17:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:17:29Z,use_quota=True,user_id='bde86b239dfe4cb89bf2162ee5fe5293',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:17:29 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f32fcdc3-e4a0-4ae9-bdfa-847a975c0aa9 tempest-AttachVolumeTestJSON-158955983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a49c5dd9-3975-429b-9f67-aeadd078bad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:17:29 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f32fcdc3-e4a0-4ae9-bdfa-847a975c0aa9 tempest-AttachVolumeTestJSON-158955983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a49c5dd9-3975-429b-9f67-aeadd078bad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:17:29 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f32fcdc3-e4a0-4ae9-bdfa-847a975c0aa9 tempest-AttachVolumeTestJSON-158955983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (549eab08-4fab-47bf-b808-d1cb6c736fa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:17:29 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f32fcdc3-e4a0-4ae9-bdfa-847a975c0aa9 tempest-AttachVolumeTestJSON-158955983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (549eab08-4fab-47bf-b808-d1cb6c736fa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '415616d9-0b0d-49a9-8271-9bea99f564b2', 'volume_name': 'volume-415616d9-0b0d-49a9-8271-9bea99f564b2', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:17:29 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f32fcdc3-e4a0-4ae9-bdfa-847a975c0aa9 tempest-AttachVolumeTestJSON-158955983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5ac8b2a-5762-4428-b2a6-c96c302dc30f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:17:29 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f32fcdc3-e4a0-4ae9-bdfa-847a975c0aa9 tempest-AttachVolumeTestJSON-158955983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5ac8b2a-5762-4428-b2a6-c96c302dc30f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:17:29 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f32fcdc3-e4a0-4ae9-bdfa-847a975c0aa9 tempest-AttachVolumeTestJSON-158955983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8959e9cc-b913-4e6c-b6ab-da60328d05b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:17:29 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-f32fcdc3-e4a0-4ae9-bdfa-847a975c0aa9 tempest-AttachVolumeTestJSON-158955983 None] Volume 415616d9-0b0d-49a9-8271-9bea99f564b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-415616d9-0b0d-49a9-8271-9bea99f564b2', 'volume_size': 1} Jul 22 03:17:29 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-f32fcdc3-e4a0-4ae9-bdfa-847a975c0aa9 tempest-AttachVolumeTestJSON-158955983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:17:29 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-f32fcdc3-e4a0-4ae9-bdfa-847a975c0aa9 tempest-AttachVolumeTestJSON-158955983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:17:29 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-f32fcdc3-e4a0-4ae9-bdfa-847a975c0aa9 tempest-AttachVolumeTestJSON-158955983 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:17:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-831133018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=415616d9-0b0d-49a9-8271-9bea99f564b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='867b2b7c0ce34c16b16c490a61e37294',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:17:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:17:29Z,use_quota=True,user_id='bde86b239dfe4cb89bf2162ee5fe5293',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:17:29 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-f32fcdc3-e4a0-4ae9-bdfa-847a975c0aa9 tempest-AttachVolumeTestJSON-158955983 None] Creating volume 415616d9-0b0d-49a9-8271-9bea99f564b2 {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:17:29 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-f32fcdc3-e4a0-4ae9-bdfa-847a975c0aa9 tempest-AttachVolumeTestJSON-158955983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:17:29 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-f32fcdc3-e4a0-4ae9-bdfa-847a975c0aa9 tempest-AttachVolumeTestJSON-158955983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:17:29 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-f32fcdc3-e4a0-4ae9-bdfa-847a975c0aa9 tempest-AttachVolumeTestJSON-158955983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:17:29 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-f32fcdc3-e4a0-4ae9-bdfa-847a975c0aa9 tempest-AttachVolumeTestJSON-158955983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:17:29 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-f32fcdc3-e4a0-4ae9-bdfa-847a975c0aa9 tempest-AttachVolumeTestJSON-158955983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:17:29 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-f32fcdc3-e4a0-4ae9-bdfa-847a975c0aa9 tempest-AttachVolumeTestJSON-158955983 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:17:29 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-f32fcdc3-e4a0-4ae9-bdfa-847a975c0aa9 tempest-AttachVolumeTestJSON-158955983 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:17:29 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f32fcdc3-e4a0-4ae9-bdfa-847a975c0aa9 tempest-AttachVolumeTestJSON-158955983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-415616d9-0b0d-49a9-8271-9bea99f564b2 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:17:29 devstack sudo[91897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-415616d9-0b0d-49a9-8271-9bea99f564b2 1073741824 Jul 22 03:17:29 devstack sudo[91897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:17:29 devstack sudo[91897]: pam_unix(sudo:session): session closed for user root Jul 22 03:17:29 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f32fcdc3-e4a0-4ae9-bdfa-847a975c0aa9 tempest-AttachVolumeTestJSON-158955983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-415616d9-0b0d-49a9-8271-9bea99f564b2 1073741824" returned: 0 in 0.602s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:17:30 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [req-690cacb7-da3b-4e04-8f25-667be2c49f3b req-622f7c2c-5d33-45d5-a586-3a52bcaf75fb tempest-VolumesSnapshotsTestJSON-452690996 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:17:30 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [req-690cacb7-da3b-4e04-8f25-667be2c49f3b req-622f7c2c-5d33-45d5-a586-3a52bcaf75fb tempest-VolumesSnapshotsTestJSON-452690996 None] Flow 'volume_create_manager' (c251745c-9d27-40de-bc37-619da3ccbf21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:17:30 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [req-690cacb7-da3b-4e04-8f25-667be2c49f3b req-622f7c2c-5d33-45d5-a586-3a52bcaf75fb tempest-VolumesSnapshotsTestJSON-452690996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67c36e75-f84b-4b2e-901c-89c02980bb5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:17:30 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f32fcdc3-e4a0-4ae9-bdfa-847a975c0aa9 tempest-AttachVolumeTestJSON-158955983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-415616d9-0b0d-49a9-8271-9bea99f564b2 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:17:30 devstack sudo[91905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-415616d9-0b0d-49a9-8271-9bea99f564b2 Jul 22 03:17:30 devstack sudo[91905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:17:30 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [req-690cacb7-da3b-4e04-8f25-667be2c49f3b req-622f7c2c-5d33-45d5-a586-3a52bcaf75fb tempest-VolumesSnapshotsTestJSON-452690996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67c36e75-f84b-4b2e-901c-89c02980bb5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:17:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-377187451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=faf0acea-4c4f-47e3-be1d-61414c081fc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='084a00c1919f46d6aa9dc1702cf95d6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:17:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:17:30Z,use_quota=True,user_id='b5e8ed8c4d31475cb6213cec6eb462d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:17:30 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [req-690cacb7-da3b-4e04-8f25-667be2c49f3b req-622f7c2c-5d33-45d5-a586-3a52bcaf75fb tempest-VolumesSnapshotsTestJSON-452690996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2cf5cfe-caf0-4095-a925-bd84f329b435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:17:30 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [req-690cacb7-da3b-4e04-8f25-667be2c49f3b req-622f7c2c-5d33-45d5-a586-3a52bcaf75fb tempest-VolumesSnapshotsTestJSON-452690996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2cf5cfe-caf0-4095-a925-bd84f329b435) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:17:30 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [req-690cacb7-da3b-4e04-8f25-667be2c49f3b req-622f7c2c-5d33-45d5-a586-3a52bcaf75fb tempest-VolumesSnapshotsTestJSON-452690996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26cd2132-2320-4bc2-b923-f10404ea6345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:17:30 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [req-690cacb7-da3b-4e04-8f25-667be2c49f3b req-622f7c2c-5d33-45d5-a586-3a52bcaf75fb tempest-VolumesSnapshotsTestJSON-452690996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26cd2132-2320-4bc2-b923-f10404ea6345) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'faf0acea-4c4f-47e3-be1d-61414c081fc0', 'volume_name': 'volume-faf0acea-4c4f-47e3-be1d-61414c081fc0', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:17:30 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [req-690cacb7-da3b-4e04-8f25-667be2c49f3b req-622f7c2c-5d33-45d5-a586-3a52bcaf75fb tempest-VolumesSnapshotsTestJSON-452690996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90f1c7e6-9eab-455b-a1c0-1197f41ff062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:17:30 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [req-690cacb7-da3b-4e04-8f25-667be2c49f3b req-622f7c2c-5d33-45d5-a586-3a52bcaf75fb tempest-VolumesSnapshotsTestJSON-452690996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90f1c7e6-9eab-455b-a1c0-1197f41ff062) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:17:30 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [req-690cacb7-da3b-4e04-8f25-667be2c49f3b req-622f7c2c-5d33-45d5-a586-3a52bcaf75fb tempest-VolumesSnapshotsTestJSON-452690996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d484f92-75f7-46e0-b949-c0327083f606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:17:30 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [req-690cacb7-da3b-4e04-8f25-667be2c49f3b req-622f7c2c-5d33-45d5-a586-3a52bcaf75fb tempest-VolumesSnapshotsTestJSON-452690996 None] Volume faf0acea-4c4f-47e3-be1d-61414c081fc0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-faf0acea-4c4f-47e3-be1d-61414c081fc0', 'volume_size': 1} Jul 22 03:17:30 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [req-690cacb7-da3b-4e04-8f25-667be2c49f3b req-622f7c2c-5d33-45d5-a586-3a52bcaf75fb tempest-VolumesSnapshotsTestJSON-452690996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:17:30 devstack sudo[91905]: pam_unix(sudo:session): session closed for user root Jul 22 03:17:30 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f32fcdc3-e4a0-4ae9-bdfa-847a975c0aa9 tempest-AttachVolumeTestJSON-158955983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-415616d9-0b0d-49a9-8271-9bea99f564b2" returned: 0 in 0.375s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:17:30 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-f32fcdc3-e4a0-4ae9-bdfa-847a975c0aa9 tempest-AttachVolumeTestJSON-158955983 None] <== create_volume: return (1161ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:17:30 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-f32fcdc3-e4a0-4ae9-bdfa-847a975c0aa9 tempest-AttachVolumeTestJSON-158955983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.163s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:17:30 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [req-690cacb7-da3b-4e04-8f25-667be2c49f3b req-622f7c2c-5d33-45d5-a586-3a52bcaf75fb tempest-VolumesSnapshotsTestJSON-452690996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.251s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:17:30 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [req-690cacb7-da3b-4e04-8f25-667be2c49f3b req-622f7c2c-5d33-45d5-a586-3a52bcaf75fb tempest-VolumesSnapshotsTestJSON-452690996 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:17:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-377187451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=faf0acea-4c4f-47e3-be1d-61414c081fc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='084a00c1919f46d6aa9dc1702cf95d6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:17:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:17:30Z,use_quota=True,user_id='b5e8ed8c4d31475cb6213cec6eb462d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:17:30 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [req-690cacb7-da3b-4e04-8f25-667be2c49f3b req-622f7c2c-5d33-45d5-a586-3a52bcaf75fb tempest-VolumesSnapshotsTestJSON-452690996 None] Creating volume faf0acea-4c4f-47e3-be1d-61414c081fc0 {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:17:30 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [req-690cacb7-da3b-4e04-8f25-667be2c49f3b req-622f7c2c-5d33-45d5-a586-3a52bcaf75fb tempest-VolumesSnapshotsTestJSON-452690996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:17:30 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [req-690cacb7-da3b-4e04-8f25-667be2c49f3b req-622f7c2c-5d33-45d5-a586-3a52bcaf75fb tempest-VolumesSnapshotsTestJSON-452690996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:17:30 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [req-690cacb7-da3b-4e04-8f25-667be2c49f3b req-622f7c2c-5d33-45d5-a586-3a52bcaf75fb tempest-VolumesSnapshotsTestJSON-452690996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:17:30 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [req-690cacb7-da3b-4e04-8f25-667be2c49f3b req-622f7c2c-5d33-45d5-a586-3a52bcaf75fb tempest-VolumesSnapshotsTestJSON-452690996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:17:30 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [req-690cacb7-da3b-4e04-8f25-667be2c49f3b req-622f7c2c-5d33-45d5-a586-3a52bcaf75fb tempest-VolumesSnapshotsTestJSON-452690996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:17:30 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [req-690cacb7-da3b-4e04-8f25-667be2c49f3b req-622f7c2c-5d33-45d5-a586-3a52bcaf75fb tempest-VolumesSnapshotsTestJSON-452690996 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:17:30 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [req-690cacb7-da3b-4e04-8f25-667be2c49f3b req-622f7c2c-5d33-45d5-a586-3a52bcaf75fb tempest-VolumesSnapshotsTestJSON-452690996 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:17:30 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [req-690cacb7-da3b-4e04-8f25-667be2c49f3b req-622f7c2c-5d33-45d5-a586-3a52bcaf75fb tempest-VolumesSnapshotsTestJSON-452690996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-faf0acea-4c4f-47e3-be1d-61414c081fc0 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:17:30 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f32fcdc3-e4a0-4ae9-bdfa-847a975c0aa9 tempest-AttachVolumeTestJSON-158955983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8959e9cc-b913-4e6c-b6ab-da60328d05b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-415616d9-0b0d-49a9-8271-9bea99f564b2', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:17:30 devstack sudo[91910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-faf0acea-4c4f-47e3-be1d-61414c081fc0 1073741824 Jul 22 03:17:30 devstack sudo[91910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:17:30 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f32fcdc3-e4a0-4ae9-bdfa-847a975c0aa9 tempest-AttachVolumeTestJSON-158955983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbd1e344-ba7f-40dd-900e-c6f3f52a6d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:17:30 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-f32fcdc3-e4a0-4ae9-bdfa-847a975c0aa9 tempest-AttachVolumeTestJSON-158955983 None] Volume volume-415616d9-0b0d-49a9-8271-9bea99f564b2 (415616d9-0b0d-49a9-8271-9bea99f564b2): created successfully Jul 22 03:17:30 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f32fcdc3-e4a0-4ae9-bdfa-847a975c0aa9 tempest-AttachVolumeTestJSON-158955983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbd1e344-ba7f-40dd-900e-c6f3f52a6d4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:17:30 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f32fcdc3-e4a0-4ae9-bdfa-847a975c0aa9 tempest-AttachVolumeTestJSON-158955983 None] Flow 'volume_create_manager' (6ad3ff19-e2da-4aea-822b-1be01093a949) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:17:30 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-f32fcdc3-e4a0-4ae9-bdfa-847a975c0aa9 tempest-AttachVolumeTestJSON-158955983 None] Created volume successfully. Jul 22 03:17:30 devstack cinder-volume[87747]: INFO cinder.volume.manager [req-799e4268-0c15-4720-937c-0a4cebc2ef1d req-dc1fdbe2-c15d-4336-a58a-cdbe225b9b8b tempest-ServerActionsTestOtherA-1302037554 None] Terminate volume connection completed successfully. Jul 22 03:17:30 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [req-799e4268-0c15-4720-937c-0a4cebc2ef1d req-dc1fdbe2-c15d-4336-a58a-cdbe225b9b8b tempest-ServerActionsTestOtherA-1302037554 None] Deleting attachment fa476e4a-37f5-41e3-bb32-3c0c13616614. {{(pid=87747) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 22 03:17:30 devstack sudo[91910]: pam_unix(sudo:session): session closed for user root Jul 22 03:17:30 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [req-690cacb7-da3b-4e04-8f25-667be2c49f3b req-622f7c2c-5d33-45d5-a586-3a52bcaf75fb tempest-VolumesSnapshotsTestJSON-452690996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-faf0acea-4c4f-47e3-be1d-61414c081fc0 1073741824" returned: 0 in 0.514s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:17:30 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [req-690cacb7-da3b-4e04-8f25-667be2c49f3b req-622f7c2c-5d33-45d5-a586-3a52bcaf75fb tempest-VolumesSnapshotsTestJSON-452690996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-faf0acea-4c4f-47e3-be1d-61414c081fc0 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:17:31 devstack sudo[91947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-faf0acea-4c4f-47e3-be1d-61414c081fc0 Jul 22 03:17:31 devstack sudo[91947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:17:31 devstack sudo[91947]: pam_unix(sudo:session): session closed for user root Jul 22 03:17:31 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [req-690cacb7-da3b-4e04-8f25-667be2c49f3b req-622f7c2c-5d33-45d5-a586-3a52bcaf75fb tempest-VolumesSnapshotsTestJSON-452690996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-faf0acea-4c4f-47e3-be1d-61414c081fc0" returned: 0 in 0.417s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:17:31 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [req-690cacb7-da3b-4e04-8f25-667be2c49f3b req-622f7c2c-5d33-45d5-a586-3a52bcaf75fb tempest-VolumesSnapshotsTestJSON-452690996 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:17:31 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [req-690cacb7-da3b-4e04-8f25-667be2c49f3b req-622f7c2c-5d33-45d5-a586-3a52bcaf75fb tempest-VolumesSnapshotsTestJSON-452690996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:17:31 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [req-690cacb7-da3b-4e04-8f25-667be2c49f3b req-622f7c2c-5d33-45d5-a586-3a52bcaf75fb tempest-VolumesSnapshotsTestJSON-452690996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d484f92-75f7-46e0-b949-c0327083f606) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-faf0acea-4c4f-47e3-be1d-61414c081fc0', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:17:31 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [req-690cacb7-da3b-4e04-8f25-667be2c49f3b req-622f7c2c-5d33-45d5-a586-3a52bcaf75fb tempest-VolumesSnapshotsTestJSON-452690996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42d44864-a269-45ff-9501-64c0a745945e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:17:31 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [req-690cacb7-da3b-4e04-8f25-667be2c49f3b req-622f7c2c-5d33-45d5-a586-3a52bcaf75fb tempest-VolumesSnapshotsTestJSON-452690996 None] Volume volume-faf0acea-4c4f-47e3-be1d-61414c081fc0 (faf0acea-4c4f-47e3-be1d-61414c081fc0): created successfully Jul 22 03:17:31 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [req-690cacb7-da3b-4e04-8f25-667be2c49f3b req-622f7c2c-5d33-45d5-a586-3a52bcaf75fb tempest-VolumesSnapshotsTestJSON-452690996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42d44864-a269-45ff-9501-64c0a745945e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:17:31 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [req-690cacb7-da3b-4e04-8f25-667be2c49f3b req-622f7c2c-5d33-45d5-a586-3a52bcaf75fb tempest-VolumesSnapshotsTestJSON-452690996 None] Flow 'volume_create_manager' (c251745c-9d27-40de-bc37-619da3ccbf21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:17:31 devstack cinder-volume[87747]: INFO cinder.volume.manager [req-690cacb7-da3b-4e04-8f25-667be2c49f3b req-622f7c2c-5d33-45d5-a586-3a52bcaf75fb tempest-VolumesSnapshotsTestJSON-452690996 None] Created volume successfully. Jul 22 03:17:31 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [req-799e4268-0c15-4720-937c-0a4cebc2ef1d req-2abecd24-941b-4eeb-867a-956e4cf6e51a tempest-ServerActionsTestOtherA-1302037554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:17:31 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [req-799e4268-0c15-4720-937c-0a4cebc2ef1d req-2abecd24-941b-4eeb-867a-956e4cf6e51a tempest-ServerActionsTestOtherA-1302037554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:17:31 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [req-799e4268-0c15-4720-937c-0a4cebc2ef1d req-2abecd24-941b-4eeb-867a-956e4cf6e51a tempest-ServerActionsTestOtherA-1302037554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:17:31 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [req-799e4268-0c15-4720-937c-0a4cebc2ef1d req-2abecd24-941b-4eeb-867a-956e4cf6e51a tempest-ServerActionsTestOtherA-1302037554 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f', 'name': 'volume-a50b8bc6-d68e-41fb-a2f4-2645492d16eb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5c792b40-b7ed-4bc3-8845-9f8bc7a7d539', 'enforce_multipath': True} {{(pid=87747) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 22 03:17:31 devstack cinder-volume[87747]: INFO cinder.volume.manager [req-799e4268-0c15-4720-937c-0a4cebc2ef1d req-2abecd24-941b-4eeb-867a-956e4cf6e51a tempest-ServerActionsTestOtherA-1302037554 None] attachment_update completed successfully. Jul 22 03:17:32 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [req-68a7f0f9-43ff-4d18-9a0d-e2848dde97c4 req-425f1988-f15e-4d66-85d7-273308e4fa0f tempest-VolumesSnapshotsTestJSON-452690996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:17:32 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [req-68a7f0f9-43ff-4d18-9a0d-e2848dde97c4 req-425f1988-f15e-4d66-85d7-273308e4fa0f tempest-VolumesSnapshotsTestJSON-452690996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:17:32 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [req-68a7f0f9-43ff-4d18-9a0d-e2848dde97c4 req-425f1988-f15e-4d66-85d7-273308e4fa0f tempest-VolumesSnapshotsTestJSON-452690996 None] Creating offline snapshot 058e5e3c-3ecd-49a1-a645-09e1206fef9a of volume faf0acea-4c4f-47e3-be1d-61414c081fc0 {{(pid=87747) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 03:17:32 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [req-1a1bc502-cbc9-4790-9c16-c2f636baf3d4 req-5ee79965-628b-4793-bd88-e501b5a3bb3f tempest-AttachVolumeTestJSON-158955983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:17:32 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[c13ec3fb-7e2f-47f3-bf93-e68d41373ffc]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:17:32 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [req-68a7f0f9-43ff-4d18-9a0d-e2848dde97c4 req-425f1988-f15e-4d66-85d7-273308e4fa0f tempest-VolumesSnapshotsTestJSON-452690996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-faf0acea-4c4f-47e3-be1d-61414c081fc0 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:17:33 devstack sudo[92007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-faf0acea-4c4f-47e3-be1d-61414c081fc0 Jul 22 03:17:33 devstack sudo[92007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:17:33 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [req-68a7f0f9-43ff-4d18-9a0d-e2848dde97c4 req-425f1988-f15e-4d66-85d7-273308e4fa0f tempest-VolumesSnapshotsTestJSON-452690996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-faf0acea-4c4f-47e3-be1d-61414c081fc0" returned: 0 in 0.580s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:17:33 devstack sudo[92007]: pam_unix(sudo:session): session closed for user root Jul 22 03:17:33 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [req-68a7f0f9-43ff-4d18-9a0d-e2848dde97c4 req-425f1988-f15e-4d66-85d7-273308e4fa0f tempest-VolumesSnapshotsTestJSON-452690996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-faf0acea-4c4f-47e3-be1d-61414c081fc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-faf0acea-4c4f-47e3-be1d-61414c081fc0.058e5e3c-3ecd-49a1-a645-09e1206fef9a 1G {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:17:33 devstack sudo[92090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-faf0acea-4c4f-47e3-be1d-61414c081fc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-faf0acea-4c4f-47e3-be1d-61414c081fc0.058e5e3c-3ecd-49a1-a645-09e1206fef9a 1G Jul 22 03:17:33 devstack sudo[92090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:17:34 devstack sudo[92090]: pam_unix(sudo:session): session closed for user root Jul 22 03:17:34 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [req-68a7f0f9-43ff-4d18-9a0d-e2848dde97c4 req-425f1988-f15e-4d66-85d7-273308e4fa0f tempest-VolumesSnapshotsTestJSON-452690996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-faf0acea-4c4f-47e3-be1d-61414c081fc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-faf0acea-4c4f-47e3-be1d-61414c081fc0.058e5e3c-3ecd-49a1-a645-09e1206fef9a 1G" returned: 0 in 0.562s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:17:34 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [req-68a7f0f9-43ff-4d18-9a0d-e2848dde97c4 req-425f1988-f15e-4d66-85d7-273308e4fa0f tempest-VolumesSnapshotsTestJSON-452690996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-faf0acea-4c4f-47e3-be1d-61414c081fc0 -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-faf0acea-4c4f-47e3-be1d-61414c081fc0.058e5e3c-3ecd-49a1-a645-09e1206fef9a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:17:34 devstack sudo[92438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-faf0acea-4c4f-47e3-be1d-61414c081fc0 -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-faf0acea-4c4f-47e3-be1d-61414c081fc0.058e5e3c-3ecd-49a1-a645-09e1206fef9a Jul 22 03:17:34 devstack sudo[92438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:17:34 devstack sudo[92438]: pam_unix(sudo:session): session closed for user root Jul 22 03:17:34 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [req-68a7f0f9-43ff-4d18-9a0d-e2848dde97c4 req-425f1988-f15e-4d66-85d7-273308e4fa0f tempest-VolumesSnapshotsTestJSON-452690996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-faf0acea-4c4f-47e3-be1d-61414c081fc0 -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-faf0acea-4c4f-47e3-be1d-61414c081fc0.058e5e3c-3ecd-49a1-a645-09e1206fef9a" returned: 0 in 0.391s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:17:34 devstack cinder-volume[87747]: WARNING cinder.volume.drivers.remotefs [req-68a7f0f9-43ff-4d18-9a0d-e2848dde97c4 req-425f1988-f15e-4d66-85d7-273308e4fa0f tempest-VolumesSnapshotsTestJSON-452690996 None] /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-faf0acea-4c4f-47e3-be1d-61414c081fc0.058e5e3c-3ecd-49a1-a645-09e1206fef9a is being set with open permissions: ugo+rw Jul 22 03:17:34 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [req-68a7f0f9-43ff-4d18-9a0d-e2848dde97c4 req-425f1988-f15e-4d66-85d7-273308e4fa0f tempest-VolumesSnapshotsTestJSON-452690996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-faf0acea-4c4f-47e3-be1d-61414c081fc0.058e5e3c-3ecd-49a1-a645-09e1206fef9a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:17:34 devstack sudo[92446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-faf0acea-4c4f-47e3-be1d-61414c081fc0.058e5e3c-3ecd-49a1-a645-09e1206fef9a Jul 22 03:17:34 devstack sudo[92446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:17:34 devstack sudo[92446]: pam_unix(sudo:session): session closed for user root Jul 22 03:17:34 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [req-68a7f0f9-43ff-4d18-9a0d-e2848dde97c4 req-425f1988-f15e-4d66-85d7-273308e4fa0f tempest-VolumesSnapshotsTestJSON-452690996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-faf0acea-4c4f-47e3-be1d-61414c081fc0.058e5e3c-3ecd-49a1-a645-09e1206fef9a" returned: 0 in 0.285s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:17:34 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [req-68a7f0f9-43ff-4d18-9a0d-e2848dde97c4 req-425f1988-f15e-4d66-85d7-273308e4fa0f tempest-VolumesSnapshotsTestJSON-452690996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-faf0acea-4c4f-47e3-be1d-61414c081fc0.info {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:17:34 devstack sudo[92449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-faf0acea-4c4f-47e3-be1d-61414c081fc0.info Jul 22 03:17:34 devstack sudo[92449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:17:35 devstack sudo[92449]: pam_unix(sudo:session): session closed for user root Jul 22 03:17:35 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [req-68a7f0f9-43ff-4d18-9a0d-e2848dde97c4 req-425f1988-f15e-4d66-85d7-273308e4fa0f tempest-VolumesSnapshotsTestJSON-452690996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-faf0acea-4c4f-47e3-be1d-61414c081fc0.info" returned: 0 in 0.261s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:17:35 devstack cinder-volume[87747]: WARNING cinder.volume.drivers.remotefs [req-68a7f0f9-43ff-4d18-9a0d-e2848dde97c4 req-425f1988-f15e-4d66-85d7-273308e4fa0f tempest-VolumesSnapshotsTestJSON-452690996 None] /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-faf0acea-4c4f-47e3-be1d-61414c081fc0.info is being set with open permissions: ugo+rw Jul 22 03:17:35 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [req-68a7f0f9-43ff-4d18-9a0d-e2848dde97c4 req-425f1988-f15e-4d66-85d7-273308e4fa0f tempest-VolumesSnapshotsTestJSON-452690996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-faf0acea-4c4f-47e3-be1d-61414c081fc0.info {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:17:35 devstack sudo[92452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-faf0acea-4c4f-47e3-be1d-61414c081fc0.info Jul 22 03:17:35 devstack sudo[92452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:17:35 devstack sudo[92452]: pam_unix(sudo:session): session closed for user root Jul 22 03:17:35 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [req-68a7f0f9-43ff-4d18-9a0d-e2848dde97c4 req-425f1988-f15e-4d66-85d7-273308e4fa0f tempest-VolumesSnapshotsTestJSON-452690996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-faf0acea-4c4f-47e3-be1d-61414c081fc0.info" returned: 0 in 0.308s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:17:35 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [req-68a7f0f9-43ff-4d18-9a0d-e2848dde97c4 req-425f1988-f15e-4d66-85d7-273308e4fa0f tempest-VolumesSnapshotsTestJSON-452690996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.536s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:17:35 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [req-1a1bc502-cbc9-4790-9c16-c2f636baf3d4 req-5ee79965-628b-4793-bd88-e501b5a3bb3f tempest-AttachVolumeTestJSON-158955983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.477s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:17:35 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [req-1a1bc502-cbc9-4790-9c16-c2f636baf3d4 req-5ee79965-628b-4793-bd88-e501b5a3bb3f tempest-AttachVolumeTestJSON-158955983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.049s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:17:35 devstack cinder-volume[87747]: INFO cinder.volume.manager [req-68a7f0f9-43ff-4d18-9a0d-e2848dde97c4 req-425f1988-f15e-4d66-85d7-273308e4fa0f tempest-VolumesSnapshotsTestJSON-452690996 None] Create snapshot completed successfully Jul 22 03:17:35 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [req-1a1bc502-cbc9-4790-9c16-c2f636baf3d4 req-5ee79965-628b-4793-bd88-e501b5a3bb3f tempest-AttachVolumeTestJSON-158955983 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f', 'name': 'volume-415616d9-0b0d-49a9-8271-9bea99f564b2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '54a702c4-7a5e-46ef-8b06-81acea1c5303', 'enforce_multipath': True} {{(pid=87747) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 22 03:17:35 devstack cinder-volume[87747]: INFO cinder.volume.manager [req-1a1bc502-cbc9-4790-9c16-c2f636baf3d4 req-5ee79965-628b-4793-bd88-e501b5a3bb3f tempest-AttachVolumeTestJSON-158955983 None] attachment_update completed successfully. Jul 22 03:17:35 devstack cinder-volume[87747]: DEBUG cinder.coordination [req-4cdc6f7e-7db2-4f36-ac1d-13307c811240 req-4a2dbecb-5366-4061-bceb-d7c7b5f9d220 tempest-VolumesSnapshotsTestJSON-452690996 None] Acquiring lock "cinder-058e5e3c-3ecd-49a1-a645-09e1206fef9a-delete_snapshot" by "delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:17:35 devstack cinder-volume[87747]: DEBUG cinder.coordination [req-4cdc6f7e-7db2-4f36-ac1d-13307c811240 req-4a2dbecb-5366-4061-bceb-d7c7b5f9d220 tempest-VolumesSnapshotsTestJSON-452690996 None] Lock "cinder-058e5e3c-3ecd-49a1-a645-09e1206fef9a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:17:36 devstack cinder-volume[87747]: DEBUG cinder.coordination [req-4cdc6f7e-7db2-4f36-ac1d-13307c811240 req-4a2dbecb-5366-4061-bceb-d7c7b5f9d220 tempest-VolumesSnapshotsTestJSON-452690996 None] Acquiring lock "cinder-quobyte-faf0acea-4c4f-47e3-be1d-61414c081fc0" by "delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:17:36 devstack cinder-volume[87747]: DEBUG cinder.coordination [req-4cdc6f7e-7db2-4f36-ac1d-13307c811240 req-4a2dbecb-5366-4061-bceb-d7c7b5f9d220 tempest-VolumesSnapshotsTestJSON-452690996 None] Lock "cinder-quobyte-faf0acea-4c4f-47e3-be1d-61414c081fc0" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:17:36 devstack cinder-volume[87747]: DEBUG cinder.coordination [req-4cdc6f7e-7db2-4f36-ac1d-13307c811240 req-4a2dbecb-5366-4061-bceb-d7c7b5f9d220 tempest-VolumesSnapshotsTestJSON-452690996 None] Acquiring lock "cinder-quobyte-058e5e3c-3ecd-49a1-a645-09e1206fef9a" by "_delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:17:36 devstack cinder-volume[87747]: DEBUG cinder.coordination [req-4cdc6f7e-7db2-4f36-ac1d-13307c811240 req-4a2dbecb-5366-4061-bceb-d7c7b5f9d220 tempest-VolumesSnapshotsTestJSON-452690996 None] Lock "cinder-quobyte-058e5e3c-3ecd-49a1-a645-09e1206fef9a" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:17:36 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [req-4cdc6f7e-7db2-4f36-ac1d-13307c811240 req-4a2dbecb-5366-4061-bceb-d7c7b5f9d220 tempest-VolumesSnapshotsTestJSON-452690996 None] Deleting offline snapshot 058e5e3c-3ecd-49a1-a645-09e1206fef9a of volume faf0acea-4c4f-47e3-be1d-61414c081fc0 {{(pid=87747) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 03:17:36 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [req-4cdc6f7e-7db2-4f36-ac1d-13307c811240 req-4a2dbecb-5366-4061-bceb-d7c7b5f9d220 tempest-VolumesSnapshotsTestJSON-452690996 None] snapshot_file for this snap is: volume-faf0acea-4c4f-47e3-be1d-61414c081fc0.058e5e3c-3ecd-49a1-a645-09e1206fef9a {{(pid=87747) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 03:17:36 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[27756ea0-f0a9-4c05-a34d-3e67a5105587]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:17:36 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [req-4cdc6f7e-7db2-4f36-ac1d-13307c811240 req-4a2dbecb-5366-4061-bceb-d7c7b5f9d220 tempest-VolumesSnapshotsTestJSON-452690996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-faf0acea-4c4f-47e3-be1d-61414c081fc0.058e5e3c-3ecd-49a1-a645-09e1206fef9a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:17:36 devstack sudo[92459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-faf0acea-4c4f-47e3-be1d-61414c081fc0.058e5e3c-3ecd-49a1-a645-09e1206fef9a Jul 22 03:17:36 devstack sudo[92459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:17:36 devstack sudo[92459]: pam_unix(sudo:session): session closed for user root Jul 22 03:17:36 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [req-4cdc6f7e-7db2-4f36-ac1d-13307c811240 req-4a2dbecb-5366-4061-bceb-d7c7b5f9d220 tempest-VolumesSnapshotsTestJSON-452690996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-faf0acea-4c4f-47e3-be1d-61414c081fc0.058e5e3c-3ecd-49a1-a645-09e1206fef9a" returned: 0 in 0.629s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:17:36 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [req-4cdc6f7e-7db2-4f36-ac1d-13307c811240 req-4a2dbecb-5366-4061-bceb-d7c7b5f9d220 tempest-VolumesSnapshotsTestJSON-452690996 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-faf0acea-4c4f-47e3-be1d-61414c081fc0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87747) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 03:17:36 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[0da3835e-7d98-4dce-85a2-4af201b172c2]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:17:36 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [req-4cdc6f7e-7db2-4f36-ac1d-13307c811240 req-4a2dbecb-5366-4061-bceb-d7c7b5f9d220 tempest-VolumesSnapshotsTestJSON-452690996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-faf0acea-4c4f-47e3-be1d-61414c081fc0 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:17:37 devstack sudo[92466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-faf0acea-4c4f-47e3-be1d-61414c081fc0 Jul 22 03:17:37 devstack sudo[92466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:17:37 devstack sudo[92466]: pam_unix(sudo:session): session closed for user root Jul 22 03:17:37 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [req-4cdc6f7e-7db2-4f36-ac1d-13307c811240 req-4a2dbecb-5366-4061-bceb-d7c7b5f9d220 tempest-VolumesSnapshotsTestJSON-452690996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-faf0acea-4c4f-47e3-be1d-61414c081fc0" returned: 0 in 0.428s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:17:37 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [req-4cdc6f7e-7db2-4f36-ac1d-13307c811240 req-4a2dbecb-5366-4061-bceb-d7c7b5f9d220 tempest-VolumesSnapshotsTestJSON-452690996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-faf0acea-4c4f-47e3-be1d-61414c081fc0.058e5e3c-3ecd-49a1-a645-09e1206fef9a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:17:37 devstack sudo[92472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-faf0acea-4c4f-47e3-be1d-61414c081fc0.058e5e3c-3ecd-49a1-a645-09e1206fef9a Jul 22 03:17:37 devstack sudo[92472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:17:37 devstack sudo[92472]: pam_unix(sudo:session): session closed for user root Jul 22 03:17:37 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [req-4cdc6f7e-7db2-4f36-ac1d-13307c811240 req-4a2dbecb-5366-4061-bceb-d7c7b5f9d220 tempest-VolumesSnapshotsTestJSON-452690996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-faf0acea-4c4f-47e3-be1d-61414c081fc0.058e5e3c-3ecd-49a1-a645-09e1206fef9a" returned: 0 in 0.529s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:17:37 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [req-4cdc6f7e-7db2-4f36-ac1d-13307c811240 req-4a2dbecb-5366-4061-bceb-d7c7b5f9d220 tempest-VolumesSnapshotsTestJSON-452690996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-faf0acea-4c4f-47e3-be1d-61414c081fc0.058e5e3c-3ecd-49a1-a645-09e1206fef9a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:17:37 devstack sudo[92477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-faf0acea-4c4f-47e3-be1d-61414c081fc0.058e5e3c-3ecd-49a1-a645-09e1206fef9a Jul 22 03:17:37 devstack sudo[92477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:17:38 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd55f526-bb2e-4769-8193-c559d0f12bdd tempest-AttachVolumeTestJSON-158955983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:17:38 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-fd55f526-bb2e-4769-8193-c559d0f12bdd tempest-AttachVolumeTestJSON-158955983 None] Flow 'volume_create_manager' (4ed36bc7-0bb5-4244-951f-1fc69260f5a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:17:38 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-fd55f526-bb2e-4769-8193-c559d0f12bdd tempest-AttachVolumeTestJSON-158955983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dc3c08b-928c-4a39-a966-6a10b5ab0e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:17:38 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-fd55f526-bb2e-4769-8193-c559d0f12bdd tempest-AttachVolumeTestJSON-158955983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dc3c08b-928c-4a39-a966-6a10b5ab0e83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:17:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1196350287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e1b6061-7d8a-4476-9fd0-c5f880c91a06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='867b2b7c0ce34c16b16c490a61e37294',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:17:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:17:38Z,use_quota=True,user_id='bde86b239dfe4cb89bf2162ee5fe5293',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:17:38 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-fd55f526-bb2e-4769-8193-c559d0f12bdd tempest-AttachVolumeTestJSON-158955983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e23fd1e-9491-46eb-ac29-dcb7452d9b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:17:38 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-fd55f526-bb2e-4769-8193-c559d0f12bdd tempest-AttachVolumeTestJSON-158955983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e23fd1e-9491-46eb-ac29-dcb7452d9b32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:17:38 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-fd55f526-bb2e-4769-8193-c559d0f12bdd tempest-AttachVolumeTestJSON-158955983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (298b5bcc-16d3-481d-a511-8a88f36f5b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:17:38 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-fd55f526-bb2e-4769-8193-c559d0f12bdd tempest-AttachVolumeTestJSON-158955983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (298b5bcc-16d3-481d-a511-8a88f36f5b40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e1b6061-7d8a-4476-9fd0-c5f880c91a06', 'volume_name': 'volume-3e1b6061-7d8a-4476-9fd0-c5f880c91a06', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:17:38 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-fd55f526-bb2e-4769-8193-c559d0f12bdd tempest-AttachVolumeTestJSON-158955983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c1680fa-017b-44e4-8150-32ec55f30f37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:17:38 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-fd55f526-bb2e-4769-8193-c559d0f12bdd tempest-AttachVolumeTestJSON-158955983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c1680fa-017b-44e4-8150-32ec55f30f37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:17:38 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-fd55f526-bb2e-4769-8193-c559d0f12bdd tempest-AttachVolumeTestJSON-158955983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e554517d-b515-4a35-8297-982e7c0da61e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:17:38 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-fd55f526-bb2e-4769-8193-c559d0f12bdd tempest-AttachVolumeTestJSON-158955983 None] Volume 3e1b6061-7d8a-4476-9fd0-c5f880c91a06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e1b6061-7d8a-4476-9fd0-c5f880c91a06', 'volume_size': 1} Jul 22 03:17:38 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-fd55f526-bb2e-4769-8193-c559d0f12bdd tempest-AttachVolumeTestJSON-158955983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:17:38 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-fd55f526-bb2e-4769-8193-c559d0f12bdd tempest-AttachVolumeTestJSON-158955983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:17:38 devstack sudo[92477]: pam_unix(sudo:session): session closed for user root Jul 22 03:17:38 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-fd55f526-bb2e-4769-8193-c559d0f12bdd tempest-AttachVolumeTestJSON-158955983 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:17:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1196350287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e1b6061-7d8a-4476-9fd0-c5f880c91a06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='867b2b7c0ce34c16b16c490a61e37294',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:17:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:17:38Z,use_quota=True,user_id='bde86b239dfe4cb89bf2162ee5fe5293',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:17:38 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-fd55f526-bb2e-4769-8193-c559d0f12bdd tempest-AttachVolumeTestJSON-158955983 None] Creating volume 3e1b6061-7d8a-4476-9fd0-c5f880c91a06 {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:17:38 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-fd55f526-bb2e-4769-8193-c559d0f12bdd tempest-AttachVolumeTestJSON-158955983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:17:38 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-fd55f526-bb2e-4769-8193-c559d0f12bdd tempest-AttachVolumeTestJSON-158955983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:17:38 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-fd55f526-bb2e-4769-8193-c559d0f12bdd tempest-AttachVolumeTestJSON-158955983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:17:38 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-fd55f526-bb2e-4769-8193-c559d0f12bdd tempest-AttachVolumeTestJSON-158955983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:17:38 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-fd55f526-bb2e-4769-8193-c559d0f12bdd tempest-AttachVolumeTestJSON-158955983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:17:38 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-fd55f526-bb2e-4769-8193-c559d0f12bdd tempest-AttachVolumeTestJSON-158955983 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:17:38 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-fd55f526-bb2e-4769-8193-c559d0f12bdd tempest-AttachVolumeTestJSON-158955983 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:17:38 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-fd55f526-bb2e-4769-8193-c559d0f12bdd tempest-AttachVolumeTestJSON-158955983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3e1b6061-7d8a-4476-9fd0-c5f880c91a06 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:17:38 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [req-4cdc6f7e-7db2-4f36-ac1d-13307c811240 req-4a2dbecb-5366-4061-bceb-d7c7b5f9d220 tempest-VolumesSnapshotsTestJSON-452690996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-faf0acea-4c4f-47e3-be1d-61414c081fc0.058e5e3c-3ecd-49a1-a645-09e1206fef9a" returned: 0 in 0.350s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:17:38 devstack sudo[92480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3e1b6061-7d8a-4476-9fd0-c5f880c91a06 1073741824 Jul 22 03:17:38 devstack sudo[92480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:17:38 devstack cinder-volume[87747]: DEBUG cinder.coordination [req-4cdc6f7e-7db2-4f36-ac1d-13307c811240 req-4a2dbecb-5366-4061-bceb-d7c7b5f9d220 tempest-VolumesSnapshotsTestJSON-452690996 None] Lock "cinder-quobyte-058e5e3c-3ecd-49a1-a645-09e1206fef9a" released by "_delete_snapshot" :: held 2.164s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:17:38 devstack cinder-volume[87747]: DEBUG cinder.coordination [req-4cdc6f7e-7db2-4f36-ac1d-13307c811240 req-4a2dbecb-5366-4061-bceb-d7c7b5f9d220 tempest-VolumesSnapshotsTestJSON-452690996 None] Lock "cinder-quobyte-faf0acea-4c4f-47e3-be1d-61414c081fc0" released by "delete_snapshot" :: held 2.220s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:17:38 devstack cinder-volume[87747]: WARNING cinder.quota [req-4cdc6f7e-7db2-4f36-ac1d-13307c811240 req-4a2dbecb-5366-4061-bceb-d7c7b5f9d220 tempest-VolumesSnapshotsTestJSON-452690996 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 22 03:17:38 devstack cinder-volume[87747]: DEBUG cinder.quota [req-4cdc6f7e-7db2-4f36-ac1d-13307c811240 req-4a2dbecb-5366-4061-bceb-d7c7b5f9d220 tempest-VolumesSnapshotsTestJSON-452690996 None] Created reservations ['a6ebee6f-b5e9-4096-84e3-60f2668f314a', '8d4c22e5-11ae-4e6a-9e37-d1ff567e7601', '52740cce-6a26-4f39-961c-eaae7abaa48d', 'bb8966ff-7c34-4bbf-8b15-96d7d5c90216'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:17:38 devstack cinder-volume[87747]: INFO cinder.volume.manager [req-4cdc6f7e-7db2-4f36-ac1d-13307c811240 req-4a2dbecb-5366-4061-bceb-d7c7b5f9d220 tempest-VolumesSnapshotsTestJSON-452690996 None] Delete snapshot completed successfully. Jul 22 03:17:38 devstack cinder-volume[87747]: DEBUG cinder.coordination [req-4cdc6f7e-7db2-4f36-ac1d-13307c811240 req-4a2dbecb-5366-4061-bceb-d7c7b5f9d220 tempest-VolumesSnapshotsTestJSON-452690996 None] Lock "cinder-058e5e3c-3ecd-49a1-a645-09e1206fef9a-delete_snapshot" released by "delete_snapshot" :: held 2.443s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:17:38 devstack sudo[92480]: pam_unix(sudo:session): session closed for user root Jul 22 03:17:38 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-fd55f526-bb2e-4769-8193-c559d0f12bdd tempest-AttachVolumeTestJSON-158955983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3e1b6061-7d8a-4476-9fd0-c5f880c91a06 1073741824" returned: 0 in 0.493s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:17:38 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-fd55f526-bb2e-4769-8193-c559d0f12bdd tempest-AttachVolumeTestJSON-158955983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3e1b6061-7d8a-4476-9fd0-c5f880c91a06 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:17:38 devstack sudo[92486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3e1b6061-7d8a-4476-9fd0-c5f880c91a06 Jul 22 03:17:38 devstack sudo[92486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:17:38 devstack sudo[92486]: pam_unix(sudo:session): session closed for user root Jul 22 03:17:38 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-fd55f526-bb2e-4769-8193-c559d0f12bdd tempest-AttachVolumeTestJSON-158955983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3e1b6061-7d8a-4476-9fd0-c5f880c91a06" returned: 0 in 0.260s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:17:38 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-fd55f526-bb2e-4769-8193-c559d0f12bdd tempest-AttachVolumeTestJSON-158955983 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:17:38 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-fd55f526-bb2e-4769-8193-c559d0f12bdd tempest-AttachVolumeTestJSON-158955983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.799s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:17:38 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-fd55f526-bb2e-4769-8193-c559d0f12bdd tempest-AttachVolumeTestJSON-158955983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e554517d-b515-4a35-8297-982e7c0da61e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e1b6061-7d8a-4476-9fd0-c5f880c91a06', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:17:38 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-fd55f526-bb2e-4769-8193-c559d0f12bdd tempest-AttachVolumeTestJSON-158955983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8af70213-37a3-4098-8843-d10710046b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:17:38 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-fd55f526-bb2e-4769-8193-c559d0f12bdd tempest-AttachVolumeTestJSON-158955983 None] Volume volume-3e1b6061-7d8a-4476-9fd0-c5f880c91a06 (3e1b6061-7d8a-4476-9fd0-c5f880c91a06): created successfully Jul 22 03:17:39 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-fd55f526-bb2e-4769-8193-c559d0f12bdd tempest-AttachVolumeTestJSON-158955983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8af70213-37a3-4098-8843-d10710046b97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:17:39 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-fd55f526-bb2e-4769-8193-c559d0f12bdd tempest-AttachVolumeTestJSON-158955983 None] Flow 'volume_create_manager' (4ed36bc7-0bb5-4244-951f-1fc69260f5a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:17:39 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-fd55f526-bb2e-4769-8193-c559d0f12bdd tempest-AttachVolumeTestJSON-158955983 None] Created volume successfully. Jul 22 03:17:39 devstack cinder-volume[87747]: DEBUG cinder.coordination [req-f1e058b8-fc96-4ca1-8e14-a44e1eeee275 req-6883e831-299e-4ef1-ba68-8e2a401867b1 tempest-VolumesSnapshotsTestJSON-452690996 None] Acquiring lock "cinder-faf0acea-4c4f-47e3-be1d-61414c081fc0-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:17:39 devstack cinder-volume[87747]: DEBUG cinder.coordination [req-f1e058b8-fc96-4ca1-8e14-a44e1eeee275 req-6883e831-299e-4ef1-ba68-8e2a401867b1 tempest-VolumesSnapshotsTestJSON-452690996 None] Lock "cinder-faf0acea-4c4f-47e3-be1d-61414c081fc0-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:17:39 devstack cinder-volume[87747]: DEBUG cinder.coordination [req-f1e058b8-fc96-4ca1-8e14-a44e1eeee275 req-6883e831-299e-4ef1-ba68-8e2a401867b1 tempest-VolumesSnapshotsTestJSON-452690996 None] Acquiring lock "cinder-quobyte-faf0acea-4c4f-47e3-be1d-61414c081fc0" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:17:39 devstack cinder-volume[87747]: DEBUG cinder.coordination [req-f1e058b8-fc96-4ca1-8e14-a44e1eeee275 req-6883e831-299e-4ef1-ba68-8e2a401867b1 tempest-VolumesSnapshotsTestJSON-452690996 None] Lock "cinder-quobyte-faf0acea-4c4f-47e3-be1d-61414c081fc0" acquired by "delete_volume" :: waited 0.019s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:17:39 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbbeaed4-6a0c-46fb-964b-25ed75d7fd16]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:17:39 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [req-f1e058b8-fc96-4ca1-8e14-a44e1eeee275 req-6883e831-299e-4ef1-ba68-8e2a401867b1 tempest-VolumesSnapshotsTestJSON-452690996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-faf0acea-4c4f-47e3-be1d-61414c081fc0 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:17:39 devstack sudo[92489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-faf0acea-4c4f-47e3-be1d-61414c081fc0 Jul 22 03:17:39 devstack sudo[92489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:17:40 devstack sudo[92489]: pam_unix(sudo:session): session closed for user root Jul 22 03:17:40 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [req-f1e058b8-fc96-4ca1-8e14-a44e1eeee275 req-6883e831-299e-4ef1-ba68-8e2a401867b1 tempest-VolumesSnapshotsTestJSON-452690996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-faf0acea-4c4f-47e3-be1d-61414c081fc0" returned: 0 in 0.433s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:17:40 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [req-f1e058b8-fc96-4ca1-8e14-a44e1eeee275 req-6883e831-299e-4ef1-ba68-8e2a401867b1 tempest-VolumesSnapshotsTestJSON-452690996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-faf0acea-4c4f-47e3-be1d-61414c081fc0 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:17:40 devstack sudo[92495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-faf0acea-4c4f-47e3-be1d-61414c081fc0 Jul 22 03:17:40 devstack sudo[92495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:17:40 devstack sudo[92495]: pam_unix(sudo:session): session closed for user root Jul 22 03:17:40 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [req-f1e058b8-fc96-4ca1-8e14-a44e1eeee275 req-6883e831-299e-4ef1-ba68-8e2a401867b1 tempest-VolumesSnapshotsTestJSON-452690996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-faf0acea-4c4f-47e3-be1d-61414c081fc0" returned: 0 in 0.274s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:17:40 devstack cinder-volume[87747]: DEBUG cinder.coordination [req-f1e058b8-fc96-4ca1-8e14-a44e1eeee275 req-6883e831-299e-4ef1-ba68-8e2a401867b1 tempest-VolumesSnapshotsTestJSON-452690996 None] Lock "cinder-quobyte-faf0acea-4c4f-47e3-be1d-61414c081fc0" released by "delete_volume" :: held 0.770s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:17:40 devstack cinder-volume[87747]: DEBUG cinder.quota [req-f1e058b8-fc96-4ca1-8e14-a44e1eeee275 req-6883e831-299e-4ef1-ba68-8e2a401867b1 tempest-VolumesSnapshotsTestJSON-452690996 None] Created reservations ['0d60a4ee-fd9d-4c92-98e7-d614491b3111', '53a167fd-1e2f-407e-aacc-40a665fb2af4', '21df77e7-d79c-49ce-81a3-1fae011da9e6', '506a7b4b-6c03-4ec7-94d9-45298d69e960'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:17:40 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [req-f1e058b8-fc96-4ca1-8e14-a44e1eeee275 req-6883e831-299e-4ef1-ba68-8e2a401867b1 tempest-VolumesSnapshotsTestJSON-452690996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:17:40 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [req-f1e058b8-fc96-4ca1-8e14-a44e1eeee275 req-6883e831-299e-4ef1-ba68-8e2a401867b1 tempest-VolumesSnapshotsTestJSON-452690996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:17:40 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [req-f1e058b8-fc96-4ca1-8e14-a44e1eeee275 req-6883e831-299e-4ef1-ba68-8e2a401867b1 tempest-VolumesSnapshotsTestJSON-452690996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:17:40 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [req-f1e058b8-fc96-4ca1-8e14-a44e1eeee275 req-6883e831-299e-4ef1-ba68-8e2a401867b1 tempest-VolumesSnapshotsTestJSON-452690996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:17:40 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [req-f1e058b8-fc96-4ca1-8e14-a44e1eeee275 req-6883e831-299e-4ef1-ba68-8e2a401867b1 tempest-VolumesSnapshotsTestJSON-452690996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:17:40 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [req-f1e058b8-fc96-4ca1-8e14-a44e1eeee275 req-6883e831-299e-4ef1-ba68-8e2a401867b1 tempest-VolumesSnapshotsTestJSON-452690996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:17:40 devstack sudo[92502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:17:40 devstack sudo[92502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:17:41 devstack sudo[92502]: pam_unix(sudo:session): session closed for user root Jul 22 03:17:41 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [req-f1e058b8-fc96-4ca1-8e14-a44e1eeee275 req-6883e831-299e-4ef1-ba68-8e2a401867b1 tempest-VolumesSnapshotsTestJSON-452690996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.476s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:17:41 devstack cinder-volume[87747]: DEBUG cinder.manager [req-f1e058b8-fc96-4ca1-8e14-a44e1eeee275 req-6883e831-299e-4ef1-ba68-8e2a401867b1 tempest-VolumesSnapshotsTestJSON-452690996 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:17:41 devstack cinder-volume[87747]: INFO cinder.volume.manager [req-f1e058b8-fc96-4ca1-8e14-a44e1eeee275 req-6883e831-299e-4ef1-ba68-8e2a401867b1 tempest-VolumesSnapshotsTestJSON-452690996 None] Deleted volume successfully. Jul 22 03:17:41 devstack cinder-volume[87747]: DEBUG cinder.coordination [req-f1e058b8-fc96-4ca1-8e14-a44e1eeee275 req-6883e831-299e-4ef1-ba68-8e2a401867b1 tempest-VolumesSnapshotsTestJSON-452690996 None] Lock "cinder-faf0acea-4c4f-47e3-be1d-61414c081fc0-delete_volume" released by "delete_volume" :: held 1.558s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:17:41 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [req-da26c7b2-acf0-4599-b6e0-e87704eef957 req-273f3a0a-2355-4198-bdf4-a602f2cc1160 tempest-AttachVolumeTestJSON-158955983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:17:41 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [req-da26c7b2-acf0-4599-b6e0-e87704eef957 req-273f3a0a-2355-4198-bdf4-a602f2cc1160 tempest-AttachVolumeTestJSON-158955983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:17:41 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [req-da26c7b2-acf0-4599-b6e0-e87704eef957 req-273f3a0a-2355-4198-bdf4-a602f2cc1160 tempest-AttachVolumeTestJSON-158955983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:17:41 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [req-da26c7b2-acf0-4599-b6e0-e87704eef957 req-273f3a0a-2355-4198-bdf4-a602f2cc1160 tempest-AttachVolumeTestJSON-158955983 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f', 'name': 'volume-3e1b6061-7d8a-4476-9fd0-c5f880c91a06', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a434bf03-21c6-4ca1-b298-78076315c728', 'enforce_multipath': True} {{(pid=87747) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 22 03:17:41 devstack cinder-volume[87747]: INFO cinder.volume.manager [req-da26c7b2-acf0-4599-b6e0-e87704eef957 req-273f3a0a-2355-4198-bdf4-a602f2cc1160 tempest-AttachVolumeTestJSON-158955983 None] attachment_update completed successfully. Jul 22 03:17:44 devstack cinder-volume[87747]: INFO cinder.volume.manager [req-4ed960fc-683e-478b-8136-7cc0bcf8815e req-115c2515-180c-458e-b76c-9cb40515741b tempest-AttachVolumeTestJSON-158955983 None] Terminate volume connection completed successfully. Jul 22 03:17:44 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [req-4ed960fc-683e-478b-8136-7cc0bcf8815e req-115c2515-180c-458e-b76c-9cb40515741b tempest-AttachVolumeTestJSON-158955983 None] Deleting attachment 54a702c4-7a5e-46ef-8b06-81acea1c5303. {{(pid=87747) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 22 03:17:46 devstack cinder-volume[87747]: INFO cinder.volume.manager [req-932e00d3-d114-4d33-9907-cce6c03c692f req-ea865aa5-c102-4532-88e4-24c29204b95e tempest-AttachVolumeTestJSON-158955983 None] Terminate volume connection completed successfully. Jul 22 03:17:46 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [req-932e00d3-d114-4d33-9907-cce6c03c692f req-ea865aa5-c102-4532-88e4-24c29204b95e tempest-AttachVolumeTestJSON-158955983 None] Deleting attachment a434bf03-21c6-4ca1-b298-78076315c728. {{(pid=87747) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 22 03:17:46 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-2509b106-724e-489b-8213-fcbcbe9c1f75 tempest-VolumesTestJSON-679048376 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:17:46 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2509b106-724e-489b-8213-fcbcbe9c1f75 tempest-VolumesTestJSON-679048376 None] Flow 'volume_create_manager' (973cca08-0722-4f0c-a510-f8b932242a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:17:46 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2509b106-724e-489b-8213-fcbcbe9c1f75 tempest-VolumesTestJSON-679048376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec3cc7f5-f7f7-4e18-9c94-d69996e6b17b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:17:46 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2509b106-724e-489b-8213-fcbcbe9c1f75 tempest-VolumesTestJSON-679048376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec3cc7f5-f7f7-4e18-9c94-d69996e6b17b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:17:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1568826194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02ef4db8-617f-4c8a-8e4e-48a7b44ef42f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b8ed337f322045b2a792e168efd3955c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:17:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:17:46Z,use_quota=True,user_id='fa6e2dba5d40415bad948e79e23eb75f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:17:46 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2509b106-724e-489b-8213-fcbcbe9c1f75 tempest-VolumesTestJSON-679048376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a6ca9e9-7b34-40b5-9d26-1f627abf98f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:17:46 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2509b106-724e-489b-8213-fcbcbe9c1f75 tempest-VolumesTestJSON-679048376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a6ca9e9-7b34-40b5-9d26-1f627abf98f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:17:46 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2509b106-724e-489b-8213-fcbcbe9c1f75 tempest-VolumesTestJSON-679048376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34487648-466b-4f04-8a13-07261cfc58d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:17:46 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2509b106-724e-489b-8213-fcbcbe9c1f75 tempest-VolumesTestJSON-679048376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34487648-466b-4f04-8a13-07261cfc58d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02ef4db8-617f-4c8a-8e4e-48a7b44ef42f', 'volume_name': 'volume-02ef4db8-617f-4c8a-8e4e-48a7b44ef42f', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:17:46 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2509b106-724e-489b-8213-fcbcbe9c1f75 tempest-VolumesTestJSON-679048376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa701229-a4f6-4d3a-bc60-abcd1ad75891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:17:46 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2509b106-724e-489b-8213-fcbcbe9c1f75 tempest-VolumesTestJSON-679048376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa701229-a4f6-4d3a-bc60-abcd1ad75891) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:17:46 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2509b106-724e-489b-8213-fcbcbe9c1f75 tempest-VolumesTestJSON-679048376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c420216a-39d7-45c8-8a89-7e5828c3370a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:17:46 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-2509b106-724e-489b-8213-fcbcbe9c1f75 tempest-VolumesTestJSON-679048376 None] Volume 02ef4db8-617f-4c8a-8e4e-48a7b44ef42f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02ef4db8-617f-4c8a-8e4e-48a7b44ef42f', 'volume_size': 1} Jul 22 03:17:46 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-2509b106-724e-489b-8213-fcbcbe9c1f75 tempest-VolumesTestJSON-679048376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:17:46 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-2509b106-724e-489b-8213-fcbcbe9c1f75 tempest-VolumesTestJSON-679048376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:17:46 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-2509b106-724e-489b-8213-fcbcbe9c1f75 tempest-VolumesTestJSON-679048376 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:17:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1568826194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02ef4db8-617f-4c8a-8e4e-48a7b44ef42f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b8ed337f322045b2a792e168efd3955c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:17:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:17:46Z,use_quota=True,user_id='fa6e2dba5d40415bad948e79e23eb75f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:17:46 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-2509b106-724e-489b-8213-fcbcbe9c1f75 tempest-VolumesTestJSON-679048376 None] Creating volume 02ef4db8-617f-4c8a-8e4e-48a7b44ef42f {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:17:46 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-2509b106-724e-489b-8213-fcbcbe9c1f75 tempest-VolumesTestJSON-679048376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:17:46 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-2509b106-724e-489b-8213-fcbcbe9c1f75 tempest-VolumesTestJSON-679048376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:17:46 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-2509b106-724e-489b-8213-fcbcbe9c1f75 tempest-VolumesTestJSON-679048376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:17:46 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-2509b106-724e-489b-8213-fcbcbe9c1f75 tempest-VolumesTestJSON-679048376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:17:46 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-2509b106-724e-489b-8213-fcbcbe9c1f75 tempest-VolumesTestJSON-679048376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:17:46 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-2509b106-724e-489b-8213-fcbcbe9c1f75 tempest-VolumesTestJSON-679048376 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:17:46 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-2509b106-724e-489b-8213-fcbcbe9c1f75 tempest-VolumesTestJSON-679048376 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:17:46 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2509b106-724e-489b-8213-fcbcbe9c1f75 tempest-VolumesTestJSON-679048376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-02ef4db8-617f-4c8a-8e4e-48a7b44ef42f 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:17:46 devstack sudo[92532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-02ef4db8-617f-4c8a-8e4e-48a7b44ef42f 1073741824 Jul 22 03:17:46 devstack sudo[92532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:17:47 devstack sudo[92532]: pam_unix(sudo:session): session closed for user root Jul 22 03:17:47 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2509b106-724e-489b-8213-fcbcbe9c1f75 tempest-VolumesTestJSON-679048376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-02ef4db8-617f-4c8a-8e4e-48a7b44ef42f 1073741824" returned: 0 in 0.582s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:17:47 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2509b106-724e-489b-8213-fcbcbe9c1f75 tempest-VolumesTestJSON-679048376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-02ef4db8-617f-4c8a-8e4e-48a7b44ef42f {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:17:47 devstack sudo[92538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-02ef4db8-617f-4c8a-8e4e-48a7b44ef42f Jul 22 03:17:47 devstack sudo[92538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:17:47 devstack sudo[92538]: pam_unix(sudo:session): session closed for user root Jul 22 03:17:47 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2509b106-724e-489b-8213-fcbcbe9c1f75 tempest-VolumesTestJSON-679048376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-02ef4db8-617f-4c8a-8e4e-48a7b44ef42f" returned: 0 in 0.379s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:17:47 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-2509b106-724e-489b-8213-fcbcbe9c1f75 tempest-VolumesTestJSON-679048376 None] <== create_volume: return (1019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:17:47 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-2509b106-724e-489b-8213-fcbcbe9c1f75 tempest-VolumesTestJSON-679048376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:17:47 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2509b106-724e-489b-8213-fcbcbe9c1f75 tempest-VolumesTestJSON-679048376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c420216a-39d7-45c8-8a89-7e5828c3370a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02ef4db8-617f-4c8a-8e4e-48a7b44ef42f', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:17:47 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2509b106-724e-489b-8213-fcbcbe9c1f75 tempest-VolumesTestJSON-679048376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (174e0977-65ec-4f96-9461-6b5fee79e6d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:17:47 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-2509b106-724e-489b-8213-fcbcbe9c1f75 tempest-VolumesTestJSON-679048376 None] Volume volume-02ef4db8-617f-4c8a-8e4e-48a7b44ef42f (02ef4db8-617f-4c8a-8e4e-48a7b44ef42f): created successfully Jul 22 03:17:47 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2509b106-724e-489b-8213-fcbcbe9c1f75 tempest-VolumesTestJSON-679048376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (174e0977-65ec-4f96-9461-6b5fee79e6d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:17:47 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2509b106-724e-489b-8213-fcbcbe9c1f75 tempest-VolumesTestJSON-679048376 None] Flow 'volume_create_manager' (973cca08-0722-4f0c-a510-f8b932242a08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:17:47 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-2509b106-724e-489b-8213-fcbcbe9c1f75 tempest-VolumesTestJSON-679048376 None] Created volume successfully. Jul 22 03:17:49 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-497bca1e-3275-4b46-a1d1-a23477aaae43 tempest-VolumesTestJSON-679048376 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:17:49 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-497bca1e-3275-4b46-a1d1-a23477aaae43 tempest-VolumesTestJSON-679048376 None] Flow 'volume_create_manager' (f05a8e78-1c12-4e54-95ea-3e2134ce7fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:17:49 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-497bca1e-3275-4b46-a1d1-a23477aaae43 tempest-VolumesTestJSON-679048376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41e84ce3-23d0-4ab0-a26d-472b5d08dade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:17:49 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-497bca1e-3275-4b46-a1d1-a23477aaae43 tempest-VolumesTestJSON-679048376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41e84ce3-23d0-4ab0-a26d-472b5d08dade) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:17:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1825785007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ced35d83-c3c7-4ef9-8a61-ebaa9b8839d8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b8ed337f322045b2a792e168efd3955c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:17:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:17:49Z,use_quota=True,user_id='fa6e2dba5d40415bad948e79e23eb75f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:17:49 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-497bca1e-3275-4b46-a1d1-a23477aaae43 tempest-VolumesTestJSON-679048376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12d66e74-8d55-4652-9359-876e38c6b386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:17:49 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-497bca1e-3275-4b46-a1d1-a23477aaae43 tempest-VolumesTestJSON-679048376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12d66e74-8d55-4652-9359-876e38c6b386) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:17:49 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-497bca1e-3275-4b46-a1d1-a23477aaae43 tempest-VolumesTestJSON-679048376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e494c692-7bfa-4d1f-acfe-c63611a8d42a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:17:49 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-497bca1e-3275-4b46-a1d1-a23477aaae43 tempest-VolumesTestJSON-679048376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e494c692-7bfa-4d1f-acfe-c63611a8d42a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ced35d83-c3c7-4ef9-8a61-ebaa9b8839d8', 'volume_name': 'volume-ced35d83-c3c7-4ef9-8a61-ebaa9b8839d8', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:17:49 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-497bca1e-3275-4b46-a1d1-a23477aaae43 tempest-VolumesTestJSON-679048376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f08e906d-05f9-455f-80b8-ec7993213815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:17:49 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-497bca1e-3275-4b46-a1d1-a23477aaae43 tempest-VolumesTestJSON-679048376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f08e906d-05f9-455f-80b8-ec7993213815) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:17:49 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-497bca1e-3275-4b46-a1d1-a23477aaae43 tempest-VolumesTestJSON-679048376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ef2a573-db13-4b95-b0cf-3e5a86c34ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:17:49 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-497bca1e-3275-4b46-a1d1-a23477aaae43 tempest-VolumesTestJSON-679048376 None] Volume ced35d83-c3c7-4ef9-8a61-ebaa9b8839d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ced35d83-c3c7-4ef9-8a61-ebaa9b8839d8', 'volume_size': 1} Jul 22 03:17:49 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-497bca1e-3275-4b46-a1d1-a23477aaae43 tempest-VolumesTestJSON-679048376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:17:49 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-497bca1e-3275-4b46-a1d1-a23477aaae43 tempest-VolumesTestJSON-679048376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:17:49 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-497bca1e-3275-4b46-a1d1-a23477aaae43 tempest-VolumesTestJSON-679048376 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:17:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1825785007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ced35d83-c3c7-4ef9-8a61-ebaa9b8839d8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b8ed337f322045b2a792e168efd3955c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:17:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:17:49Z,use_quota=True,user_id='fa6e2dba5d40415bad948e79e23eb75f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:17:49 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-497bca1e-3275-4b46-a1d1-a23477aaae43 tempest-VolumesTestJSON-679048376 None] Creating volume ced35d83-c3c7-4ef9-8a61-ebaa9b8839d8 {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:17:49 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-497bca1e-3275-4b46-a1d1-a23477aaae43 tempest-VolumesTestJSON-679048376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:17:49 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-497bca1e-3275-4b46-a1d1-a23477aaae43 tempest-VolumesTestJSON-679048376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:17:49 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-497bca1e-3275-4b46-a1d1-a23477aaae43 tempest-VolumesTestJSON-679048376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:17:49 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-497bca1e-3275-4b46-a1d1-a23477aaae43 tempest-VolumesTestJSON-679048376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:17:49 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-497bca1e-3275-4b46-a1d1-a23477aaae43 tempest-VolumesTestJSON-679048376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:17:49 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-497bca1e-3275-4b46-a1d1-a23477aaae43 tempest-VolumesTestJSON-679048376 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:17:49 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-497bca1e-3275-4b46-a1d1-a23477aaae43 tempest-VolumesTestJSON-679048376 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:17:49 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-497bca1e-3275-4b46-a1d1-a23477aaae43 tempest-VolumesTestJSON-679048376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ced35d83-c3c7-4ef9-8a61-ebaa9b8839d8 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:17:49 devstack sudo[92607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ced35d83-c3c7-4ef9-8a61-ebaa9b8839d8 1073741824 Jul 22 03:17:49 devstack sudo[92607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:17:50 devstack sudo[92607]: pam_unix(sudo:session): session closed for user root Jul 22 03:17:50 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-497bca1e-3275-4b46-a1d1-a23477aaae43 tempest-VolumesTestJSON-679048376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ced35d83-c3c7-4ef9-8a61-ebaa9b8839d8 1073741824" returned: 0 in 0.577s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:17:50 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-497bca1e-3275-4b46-a1d1-a23477aaae43 tempest-VolumesTestJSON-679048376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ced35d83-c3c7-4ef9-8a61-ebaa9b8839d8 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:17:50 devstack sudo[92614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ced35d83-c3c7-4ef9-8a61-ebaa9b8839d8 Jul 22 03:17:50 devstack sudo[92614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:17:50 devstack sudo[92614]: pam_unix(sudo:session): session closed for user root Jul 22 03:17:50 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-497bca1e-3275-4b46-a1d1-a23477aaae43 tempest-VolumesTestJSON-679048376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ced35d83-c3c7-4ef9-8a61-ebaa9b8839d8" returned: 0 in 0.312s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:17:50 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-497bca1e-3275-4b46-a1d1-a23477aaae43 tempest-VolumesTestJSON-679048376 None] <== create_volume: return (951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:17:50 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-497bca1e-3275-4b46-a1d1-a23477aaae43 tempest-VolumesTestJSON-679048376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.954s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:17:50 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-497bca1e-3275-4b46-a1d1-a23477aaae43 tempest-VolumesTestJSON-679048376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ef2a573-db13-4b95-b0cf-3e5a86c34ebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ced35d83-c3c7-4ef9-8a61-ebaa9b8839d8', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:17:50 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-497bca1e-3275-4b46-a1d1-a23477aaae43 tempest-VolumesTestJSON-679048376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77203b39-5a34-4e2f-b54f-087c920182cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:17:50 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-497bca1e-3275-4b46-a1d1-a23477aaae43 tempest-VolumesTestJSON-679048376 None] Volume volume-ced35d83-c3c7-4ef9-8a61-ebaa9b8839d8 (ced35d83-c3c7-4ef9-8a61-ebaa9b8839d8): created successfully Jul 22 03:17:50 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-497bca1e-3275-4b46-a1d1-a23477aaae43 tempest-VolumesTestJSON-679048376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77203b39-5a34-4e2f-b54f-087c920182cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:17:50 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-497bca1e-3275-4b46-a1d1-a23477aaae43 tempest-VolumesTestJSON-679048376 None] Flow 'volume_create_manager' (f05a8e78-1c12-4e54-95ea-3e2134ce7fde) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:17:50 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-497bca1e-3275-4b46-a1d1-a23477aaae43 tempest-VolumesTestJSON-679048376 None] Created volume successfully. Jul 22 03:17:51 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-f5609bbb-511f-452f-8229-c3c2f7f1420f tempest-AttachVolumeTestJSON-158955983 None] Acquiring lock "cinder-3e1b6061-7d8a-4476-9fd0-c5f880c91a06-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:17:51 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-f5609bbb-511f-452f-8229-c3c2f7f1420f tempest-AttachVolumeTestJSON-158955983 None] Lock "cinder-3e1b6061-7d8a-4476-9fd0-c5f880c91a06-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:17:51 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-f5609bbb-511f-452f-8229-c3c2f7f1420f tempest-AttachVolumeTestJSON-158955983 None] Acquiring lock "cinder-quobyte-3e1b6061-7d8a-4476-9fd0-c5f880c91a06" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:17:51 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-f5609bbb-511f-452f-8229-c3c2f7f1420f tempest-AttachVolumeTestJSON-158955983 None] Lock "cinder-quobyte-3e1b6061-7d8a-4476-9fd0-c5f880c91a06" acquired by "delete_volume" :: waited 0.017s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:17:51 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0256e47-4882-4ad1-988c-6f0dff6315fe]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:17:51 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f5609bbb-511f-452f-8229-c3c2f7f1420f tempest-AttachVolumeTestJSON-158955983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3e1b6061-7d8a-4476-9fd0-c5f880c91a06 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:17:51 devstack sudo[92617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3e1b6061-7d8a-4476-9fd0-c5f880c91a06 Jul 22 03:17:51 devstack sudo[92617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:17:52 devstack sudo[92617]: pam_unix(sudo:session): session closed for user root Jul 22 03:17:52 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f5609bbb-511f-452f-8229-c3c2f7f1420f tempest-AttachVolumeTestJSON-158955983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3e1b6061-7d8a-4476-9fd0-c5f880c91a06" returned: 0 in 0.417s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:17:52 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f5609bbb-511f-452f-8229-c3c2f7f1420f tempest-AttachVolumeTestJSON-158955983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3e1b6061-7d8a-4476-9fd0-c5f880c91a06 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:17:52 devstack sudo[92622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3e1b6061-7d8a-4476-9fd0-c5f880c91a06 Jul 22 03:17:52 devstack sudo[92622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:17:52 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f6695b6-080e-4155-8f23-60fab720e513 tempest-VolumesTestJSON-679048376 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:17:52 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-1f6695b6-080e-4155-8f23-60fab720e513 tempest-VolumesTestJSON-679048376 None] Flow 'volume_create_manager' (08904ceb-1c01-435a-ab62-e1ab9b1d1729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:17:52 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-1f6695b6-080e-4155-8f23-60fab720e513 tempest-VolumesTestJSON-679048376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e54c461-6aa4-4a44-88b5-c5f01c862387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:17:52 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-1f6695b6-080e-4155-8f23-60fab720e513 tempest-VolumesTestJSON-679048376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e54c461-6aa4-4a44-88b5-c5f01c862387) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:17:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-464245315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d31bf59-f67e-4625-a4af-d9524f09443d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b8ed337f322045b2a792e168efd3955c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:17:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:17:52Z,use_quota=True,user_id='fa6e2dba5d40415bad948e79e23eb75f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:17:52 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-1f6695b6-080e-4155-8f23-60fab720e513 tempest-VolumesTestJSON-679048376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b928039-84a4-4e04-939c-b8a66d62c506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:17:52 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-1f6695b6-080e-4155-8f23-60fab720e513 tempest-VolumesTestJSON-679048376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b928039-84a4-4e04-939c-b8a66d62c506) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:17:52 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-1f6695b6-080e-4155-8f23-60fab720e513 tempest-VolumesTestJSON-679048376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45287289-b3e6-4e88-ae43-5b4272d265e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:17:52 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-1f6695b6-080e-4155-8f23-60fab720e513 tempest-VolumesTestJSON-679048376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45287289-b3e6-4e88-ae43-5b4272d265e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d31bf59-f67e-4625-a4af-d9524f09443d', 'volume_name': 'volume-1d31bf59-f67e-4625-a4af-d9524f09443d', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:17:52 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-1f6695b6-080e-4155-8f23-60fab720e513 tempest-VolumesTestJSON-679048376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de011349-e20d-4f42-9ea2-f920ac91370c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:17:52 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-1f6695b6-080e-4155-8f23-60fab720e513 tempest-VolumesTestJSON-679048376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de011349-e20d-4f42-9ea2-f920ac91370c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:17:52 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-1f6695b6-080e-4155-8f23-60fab720e513 tempest-VolumesTestJSON-679048376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9673a92f-5bf1-4a77-be5a-7882dac09e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:17:52 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-1f6695b6-080e-4155-8f23-60fab720e513 tempest-VolumesTestJSON-679048376 None] Volume 1d31bf59-f67e-4625-a4af-d9524f09443d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d31bf59-f67e-4625-a4af-d9524f09443d', 'volume_size': 1} Jul 22 03:17:52 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-1f6695b6-080e-4155-8f23-60fab720e513 tempest-VolumesTestJSON-679048376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:17:52 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-1f6695b6-080e-4155-8f23-60fab720e513 tempest-VolumesTestJSON-679048376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:17:52 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-1f6695b6-080e-4155-8f23-60fab720e513 tempest-VolumesTestJSON-679048376 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:17:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-464245315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d31bf59-f67e-4625-a4af-d9524f09443d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b8ed337f322045b2a792e168efd3955c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:17:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:17:52Z,use_quota=True,user_id='fa6e2dba5d40415bad948e79e23eb75f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:17:52 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-1f6695b6-080e-4155-8f23-60fab720e513 tempest-VolumesTestJSON-679048376 None] Creating volume 1d31bf59-f67e-4625-a4af-d9524f09443d {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:17:52 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-1f6695b6-080e-4155-8f23-60fab720e513 tempest-VolumesTestJSON-679048376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:17:52 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-1f6695b6-080e-4155-8f23-60fab720e513 tempest-VolumesTestJSON-679048376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:17:52 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-1f6695b6-080e-4155-8f23-60fab720e513 tempest-VolumesTestJSON-679048376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:17:52 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-1f6695b6-080e-4155-8f23-60fab720e513 tempest-VolumesTestJSON-679048376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:17:52 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-1f6695b6-080e-4155-8f23-60fab720e513 tempest-VolumesTestJSON-679048376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:17:52 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-1f6695b6-080e-4155-8f23-60fab720e513 tempest-VolumesTestJSON-679048376 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:17:52 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-1f6695b6-080e-4155-8f23-60fab720e513 tempest-VolumesTestJSON-679048376 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:17:52 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-1f6695b6-080e-4155-8f23-60fab720e513 tempest-VolumesTestJSON-679048376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1d31bf59-f67e-4625-a4af-d9524f09443d 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:17:52 devstack sudo[92624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1d31bf59-f67e-4625-a4af-d9524f09443d 1073741824 Jul 22 03:17:52 devstack sudo[92624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:17:52 devstack sudo[92622]: pam_unix(sudo:session): session closed for user root Jul 22 03:17:52 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f5609bbb-511f-452f-8229-c3c2f7f1420f tempest-AttachVolumeTestJSON-158955983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3e1b6061-7d8a-4476-9fd0-c5f880c91a06" returned: 0 in 0.262s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:17:52 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-f5609bbb-511f-452f-8229-c3c2f7f1420f tempest-AttachVolumeTestJSON-158955983 None] Lock "cinder-quobyte-3e1b6061-7d8a-4476-9fd0-c5f880c91a06" released by "delete_volume" :: held 0.732s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:17:52 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-f5609bbb-511f-452f-8229-c3c2f7f1420f tempest-AttachVolumeTestJSON-158955983 None] Created reservations ['0acc2725-94cd-43dc-bf65-b49c2e5a1779', 'fee8792e-2530-4988-88fa-69c4dfffd156', '5d8b1680-0bfe-4371-a142-648dfac25bfd', 'e0a61ff3-c243-4143-a885-7de39bfa8b6e'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:17:52 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-f5609bbb-511f-452f-8229-c3c2f7f1420f tempest-AttachVolumeTestJSON-158955983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:17:52 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-f5609bbb-511f-452f-8229-c3c2f7f1420f tempest-AttachVolumeTestJSON-158955983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:17:52 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-f5609bbb-511f-452f-8229-c3c2f7f1420f tempest-AttachVolumeTestJSON-158955983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:17:52 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-f5609bbb-511f-452f-8229-c3c2f7f1420f tempest-AttachVolumeTestJSON-158955983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:17:52 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-f5609bbb-511f-452f-8229-c3c2f7f1420f tempest-AttachVolumeTestJSON-158955983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:17:52 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f5609bbb-511f-452f-8229-c3c2f7f1420f tempest-AttachVolumeTestJSON-158955983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:17:52 devstack sudo[92627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:17:52 devstack sudo[92627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:17:52 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-7bfc5c30-dae8-4ca1-a426-9db27d2a7656 tempest-AttachVolumeTestJSON-158955983 None] Acquiring lock "cinder-415616d9-0b0d-49a9-8271-9bea99f564b2-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:17:52 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-7bfc5c30-dae8-4ca1-a426-9db27d2a7656 tempest-AttachVolumeTestJSON-158955983 None] Lock "cinder-415616d9-0b0d-49a9-8271-9bea99f564b2-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:17:52 devstack sudo[92627]: pam_unix(sudo:session): session closed for user root Jul 22 03:17:52 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f5609bbb-511f-452f-8229-c3c2f7f1420f tempest-AttachVolumeTestJSON-158955983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.313s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:17:52 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-f5609bbb-511f-452f-8229-c3c2f7f1420f tempest-AttachVolumeTestJSON-158955983 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:17:52 devstack sudo[92624]: pam_unix(sudo:session): session closed for user root Jul 22 03:17:52 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-f5609bbb-511f-452f-8229-c3c2f7f1420f tempest-AttachVolumeTestJSON-158955983 None] Deleted volume successfully. Jul 22 03:17:52 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-1f6695b6-080e-4155-8f23-60fab720e513 tempest-VolumesTestJSON-679048376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1d31bf59-f67e-4625-a4af-d9524f09443d 1073741824" returned: 0 in 0.548s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:17:52 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-7bfc5c30-dae8-4ca1-a426-9db27d2a7656 tempest-AttachVolumeTestJSON-158955983 None] Acquiring lock "cinder-quobyte-415616d9-0b0d-49a9-8271-9bea99f564b2" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:17:52 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-f5609bbb-511f-452f-8229-c3c2f7f1420f tempest-AttachVolumeTestJSON-158955983 None] Lock "cinder-3e1b6061-7d8a-4476-9fd0-c5f880c91a06-delete_volume" released by "delete_volume" :: held 1.328s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:17:52 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-7bfc5c30-dae8-4ca1-a426-9db27d2a7656 tempest-AttachVolumeTestJSON-158955983 None] Lock "cinder-quobyte-415616d9-0b0d-49a9-8271-9bea99f564b2" acquired by "delete_volume" :: waited 0.022s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:17:52 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[b35db64a-bb36-4a19-bbbc-af8d740f254d]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:17:52 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-7bfc5c30-dae8-4ca1-a426-9db27d2a7656 tempest-AttachVolumeTestJSON-158955983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-415616d9-0b0d-49a9-8271-9bea99f564b2 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:17:52 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-1f6695b6-080e-4155-8f23-60fab720e513 tempest-VolumesTestJSON-679048376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1d31bf59-f67e-4625-a4af-d9524f09443d {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:17:52 devstack sudo[92637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1d31bf59-f67e-4625-a4af-d9524f09443d Jul 22 03:17:52 devstack sudo[92637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:17:52 devstack sudo[92636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-415616d9-0b0d-49a9-8271-9bea99f564b2 Jul 22 03:17:52 devstack sudo[92636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:17:53 devstack sudo[92637]: pam_unix(sudo:session): session closed for user root Jul 22 03:17:53 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-1f6695b6-080e-4155-8f23-60fab720e513 tempest-VolumesTestJSON-679048376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1d31bf59-f67e-4625-a4af-d9524f09443d" returned: 0 in 0.277s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:17:53 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-1f6695b6-080e-4155-8f23-60fab720e513 tempest-VolumesTestJSON-679048376 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:17:53 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-1f6695b6-080e-4155-8f23-60fab720e513 tempest-VolumesTestJSON-679048376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:17:53 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-1f6695b6-080e-4155-8f23-60fab720e513 tempest-VolumesTestJSON-679048376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9673a92f-5bf1-4a77-be5a-7882dac09e21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d31bf59-f67e-4625-a4af-d9524f09443d', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:17:53 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-1f6695b6-080e-4155-8f23-60fab720e513 tempest-VolumesTestJSON-679048376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4269d262-1e47-4f17-9877-8316e6cd27d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:17:53 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-1f6695b6-080e-4155-8f23-60fab720e513 tempest-VolumesTestJSON-679048376 None] Volume volume-1d31bf59-f67e-4625-a4af-d9524f09443d (1d31bf59-f67e-4625-a4af-d9524f09443d): created successfully Jul 22 03:17:53 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-1f6695b6-080e-4155-8f23-60fab720e513 tempest-VolumesTestJSON-679048376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4269d262-1e47-4f17-9877-8316e6cd27d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:17:53 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-1f6695b6-080e-4155-8f23-60fab720e513 tempest-VolumesTestJSON-679048376 None] Flow 'volume_create_manager' (08904ceb-1c01-435a-ab62-e1ab9b1d1729) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:17:53 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-1f6695b6-080e-4155-8f23-60fab720e513 tempest-VolumesTestJSON-679048376 None] Created volume successfully. Jul 22 03:17:53 devstack sudo[92636]: pam_unix(sudo:session): session closed for user root Jul 22 03:17:53 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-7bfc5c30-dae8-4ca1-a426-9db27d2a7656 tempest-AttachVolumeTestJSON-158955983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-415616d9-0b0d-49a9-8271-9bea99f564b2" returned: 0 in 0.411s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:17:53 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-7bfc5c30-dae8-4ca1-a426-9db27d2a7656 tempest-AttachVolumeTestJSON-158955983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-415616d9-0b0d-49a9-8271-9bea99f564b2 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:17:53 devstack sudo[92645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-415616d9-0b0d-49a9-8271-9bea99f564b2 Jul 22 03:17:53 devstack sudo[92645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:17:53 devstack sudo[92645]: pam_unix(sudo:session): session closed for user root Jul 22 03:17:53 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-7bfc5c30-dae8-4ca1-a426-9db27d2a7656 tempest-AttachVolumeTestJSON-158955983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-415616d9-0b0d-49a9-8271-9bea99f564b2" returned: 0 in 0.258s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:17:53 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-7bfc5c30-dae8-4ca1-a426-9db27d2a7656 tempest-AttachVolumeTestJSON-158955983 None] Lock "cinder-quobyte-415616d9-0b0d-49a9-8271-9bea99f564b2" released by "delete_volume" :: held 0.709s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:17:53 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-7bfc5c30-dae8-4ca1-a426-9db27d2a7656 tempest-AttachVolumeTestJSON-158955983 None] Created reservations ['e3bfc8d2-b21a-42e5-98a5-eb17a12210ed', '994bab77-07f0-4b3e-84d6-645a8aa27cc9', 'd135c903-5758-488f-8a9b-8937a90002a0', 'b71f3ba0-76ae-4d07-be09-cf0372736526'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:17:53 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-7bfc5c30-dae8-4ca1-a426-9db27d2a7656 tempest-AttachVolumeTestJSON-158955983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:17:53 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-7bfc5c30-dae8-4ca1-a426-9db27d2a7656 tempest-AttachVolumeTestJSON-158955983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:17:53 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-7bfc5c30-dae8-4ca1-a426-9db27d2a7656 tempest-AttachVolumeTestJSON-158955983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:17:53 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-7bfc5c30-dae8-4ca1-a426-9db27d2a7656 tempest-AttachVolumeTestJSON-158955983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:17:53 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-7bfc5c30-dae8-4ca1-a426-9db27d2a7656 tempest-AttachVolumeTestJSON-158955983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:17:53 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-7bfc5c30-dae8-4ca1-a426-9db27d2a7656 tempest-AttachVolumeTestJSON-158955983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:17:53 devstack sudo[92672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:17:53 devstack sudo[92672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:17:53 devstack sudo[92672]: pam_unix(sudo:session): session closed for user root Jul 22 03:17:53 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-87f03016-d916-41d7-93b0-3ce78f9530dd tempest-AttachVolumeTestJSON-158955983 None] Acquiring lock "cinder-54f5ce18-50ff-4191-9173-a0aad302f59c-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:17:53 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-7bfc5c30-dae8-4ca1-a426-9db27d2a7656 tempest-AttachVolumeTestJSON-158955983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.318s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:17:53 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-7bfc5c30-dae8-4ca1-a426-9db27d2a7656 tempest-AttachVolumeTestJSON-158955983 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:17:53 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-7bfc5c30-dae8-4ca1-a426-9db27d2a7656 tempest-AttachVolumeTestJSON-158955983 None] Deleted volume successfully. Jul 22 03:17:53 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-87f03016-d916-41d7-93b0-3ce78f9530dd tempest-AttachVolumeTestJSON-158955983 None] Lock "cinder-54f5ce18-50ff-4191-9173-a0aad302f59c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:17:54 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-7bfc5c30-dae8-4ca1-a426-9db27d2a7656 tempest-AttachVolumeTestJSON-158955983 None] Lock "cinder-415616d9-0b0d-49a9-8271-9bea99f564b2-delete_volume" released by "delete_volume" :: held 1.335s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:17:54 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-87f03016-d916-41d7-93b0-3ce78f9530dd tempest-AttachVolumeTestJSON-158955983 None] Acquiring lock "cinder-quobyte-54f5ce18-50ff-4191-9173-a0aad302f59c" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:17:54 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-87f03016-d916-41d7-93b0-3ce78f9530dd tempest-AttachVolumeTestJSON-158955983 None] Lock "cinder-quobyte-54f5ce18-50ff-4191-9173-a0aad302f59c" acquired by "delete_volume" :: waited 0.018s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:17:54 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[956a9622-a7c9-4b63-ba3e-618717c2ed0d]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:17:54 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-87f03016-d916-41d7-93b0-3ce78f9530dd tempest-AttachVolumeTestJSON-158955983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-54f5ce18-50ff-4191-9173-a0aad302f59c {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:17:54 devstack sudo[92675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-54f5ce18-50ff-4191-9173-a0aad302f59c Jul 22 03:17:54 devstack sudo[92675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:17:54 devstack sudo[92675]: pam_unix(sudo:session): session closed for user root Jul 22 03:17:54 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-87f03016-d916-41d7-93b0-3ce78f9530dd tempest-AttachVolumeTestJSON-158955983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-54f5ce18-50ff-4191-9173-a0aad302f59c" returned: 0 in 0.444s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:17:54 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-87f03016-d916-41d7-93b0-3ce78f9530dd tempest-AttachVolumeTestJSON-158955983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-54f5ce18-50ff-4191-9173-a0aad302f59c {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:17:54 devstack sudo[92681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-54f5ce18-50ff-4191-9173-a0aad302f59c Jul 22 03:17:54 devstack sudo[92681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:17:54 devstack sudo[92681]: pam_unix(sudo:session): session closed for user root Jul 22 03:17:54 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-87f03016-d916-41d7-93b0-3ce78f9530dd tempest-AttachVolumeTestJSON-158955983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-54f5ce18-50ff-4191-9173-a0aad302f59c" returned: 0 in 0.290s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:17:54 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-87f03016-d916-41d7-93b0-3ce78f9530dd tempest-AttachVolumeTestJSON-158955983 None] Lock "cinder-quobyte-54f5ce18-50ff-4191-9173-a0aad302f59c" released by "delete_volume" :: held 0.786s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:17:54 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-87f03016-d916-41d7-93b0-3ce78f9530dd tempest-AttachVolumeTestJSON-158955983 None] Created reservations ['e5d92df9-d996-438f-be6b-2e2b2c257c4d', '631a62fa-d530-4e7d-aeb3-d4f0fe77db8c', 'c5e22386-7b9f-4f87-997a-f9c0f95de30a', '89e1d98b-8263-4911-98a2-8e0cf8a8895c'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:17:55 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-87f03016-d916-41d7-93b0-3ce78f9530dd tempest-AttachVolumeTestJSON-158955983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:17:55 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-87f03016-d916-41d7-93b0-3ce78f9530dd tempest-AttachVolumeTestJSON-158955983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:17:55 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-87f03016-d916-41d7-93b0-3ce78f9530dd tempest-AttachVolumeTestJSON-158955983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:17:55 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-87f03016-d916-41d7-93b0-3ce78f9530dd tempest-AttachVolumeTestJSON-158955983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:17:55 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-87f03016-d916-41d7-93b0-3ce78f9530dd tempest-AttachVolumeTestJSON-158955983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:17:55 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-87f03016-d916-41d7-93b0-3ce78f9530dd tempest-AttachVolumeTestJSON-158955983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:17:55 devstack sudo[92684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:17:55 devstack sudo[92684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:17:55 devstack sudo[92684]: pam_unix(sudo:session): session closed for user root Jul 22 03:17:55 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-87f03016-d916-41d7-93b0-3ce78f9530dd tempest-AttachVolumeTestJSON-158955983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.423s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:17:55 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-87f03016-d916-41d7-93b0-3ce78f9530dd tempest-AttachVolumeTestJSON-158955983 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:17:55 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-87f03016-d916-41d7-93b0-3ce78f9530dd tempest-AttachVolumeTestJSON-158955983 None] Deleted volume successfully. Jul 22 03:17:55 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-87f03016-d916-41d7-93b0-3ce78f9530dd tempest-AttachVolumeTestJSON-158955983 None] Lock "cinder-54f5ce18-50ff-4191-9173-a0aad302f59c-delete_volume" released by "delete_volume" :: held 1.547s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:17:55 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-191479af-643e-4dd3-a14e-92c70db57150 tempest-VolumesTestJSON-679048376 None] Acquiring lock "cinder-1d31bf59-f67e-4625-a4af-d9524f09443d-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:17:55 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-191479af-643e-4dd3-a14e-92c70db57150 tempest-VolumesTestJSON-679048376 None] Lock "cinder-1d31bf59-f67e-4625-a4af-d9524f09443d-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:17:55 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-191479af-643e-4dd3-a14e-92c70db57150 tempest-VolumesTestJSON-679048376 None] Acquiring lock "cinder-quobyte-1d31bf59-f67e-4625-a4af-d9524f09443d" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:17:55 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-191479af-643e-4dd3-a14e-92c70db57150 tempest-VolumesTestJSON-679048376 None] Lock "cinder-quobyte-1d31bf59-f67e-4625-a4af-d9524f09443d" acquired by "delete_volume" :: waited 0.018s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:17:55 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8b7ca44-f2a5-4092-8c4a-8e55aa57daf0]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:17:55 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-191479af-643e-4dd3-a14e-92c70db57150 tempest-VolumesTestJSON-679048376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1d31bf59-f67e-4625-a4af-d9524f09443d {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:17:56 devstack sudo[92687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1d31bf59-f67e-4625-a4af-d9524f09443d Jul 22 03:17:56 devstack sudo[92687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:17:56 devstack sudo[92687]: pam_unix(sudo:session): session closed for user root Jul 22 03:17:56 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-191479af-643e-4dd3-a14e-92c70db57150 tempest-VolumesTestJSON-679048376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1d31bf59-f67e-4625-a4af-d9524f09443d" returned: 0 in 0.675s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:17:56 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-191479af-643e-4dd3-a14e-92c70db57150 tempest-VolumesTestJSON-679048376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1d31bf59-f67e-4625-a4af-d9524f09443d {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:17:56 devstack sudo[92695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1d31bf59-f67e-4625-a4af-d9524f09443d Jul 22 03:17:56 devstack sudo[92695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:17:56 devstack sudo[92695]: pam_unix(sudo:session): session closed for user root Jul 22 03:17:56 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-191479af-643e-4dd3-a14e-92c70db57150 tempest-VolumesTestJSON-679048376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1d31bf59-f67e-4625-a4af-d9524f09443d" returned: 0 in 0.312s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:17:56 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-191479af-643e-4dd3-a14e-92c70db57150 tempest-VolumesTestJSON-679048376 None] Lock "cinder-quobyte-1d31bf59-f67e-4625-a4af-d9524f09443d" released by "delete_volume" :: held 1.052s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:17:56 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-191479af-643e-4dd3-a14e-92c70db57150 tempest-VolumesTestJSON-679048376 None] Created reservations ['161fb2b5-b8da-4aca-bd8f-eb247111d441', '6e185b2e-a535-4abd-8195-f289d38bf30f', 'ea44c8a9-51cf-430e-8571-0c03cc5bd2c1', '797a9fcb-b19f-4a11-b060-c4c44d932d99'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:17:57 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-191479af-643e-4dd3-a14e-92c70db57150 tempest-VolumesTestJSON-679048376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:17:57 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-191479af-643e-4dd3-a14e-92c70db57150 tempest-VolumesTestJSON-679048376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:17:57 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-191479af-643e-4dd3-a14e-92c70db57150 tempest-VolumesTestJSON-679048376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:17:57 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-191479af-643e-4dd3-a14e-92c70db57150 tempest-VolumesTestJSON-679048376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:17:57 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-191479af-643e-4dd3-a14e-92c70db57150 tempest-VolumesTestJSON-679048376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:17:57 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-191479af-643e-4dd3-a14e-92c70db57150 tempest-VolumesTestJSON-679048376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:17:57 devstack sudo[92698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:17:57 devstack sudo[92698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:17:57 devstack sudo[92698]: pam_unix(sudo:session): session closed for user root Jul 22 03:17:57 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-191479af-643e-4dd3-a14e-92c70db57150 tempest-VolumesTestJSON-679048376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.255s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:17:57 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-191479af-643e-4dd3-a14e-92c70db57150 tempest-VolumesTestJSON-679048376 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:17:57 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-191479af-643e-4dd3-a14e-92c70db57150 tempest-VolumesTestJSON-679048376 None] Deleted volume successfully. Jul 22 03:17:57 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-191479af-643e-4dd3-a14e-92c70db57150 tempest-VolumesTestJSON-679048376 None] Lock "cinder-1d31bf59-f67e-4625-a4af-d9524f09443d-delete_volume" released by "delete_volume" :: held 1.583s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:17:58 devstack cinder-volume[87747]: INFO cinder.volume.manager [req-31bc143d-c95d-4ad0-a5c4-e043f42ed2e2 req-4d5d515d-d52e-4daa-b7a1-9690b4146a13 tempest-ServerActionsTestOtherA-1302037554 None] Terminate volume connection completed successfully. Jul 22 03:17:58 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [req-31bc143d-c95d-4ad0-a5c4-e043f42ed2e2 req-4d5d515d-d52e-4daa-b7a1-9690b4146a13 tempest-ServerActionsTestOtherA-1302037554 None] Deleting attachment 5c792b40-b7ed-4bc3-8845-9f8bc7a7d539. {{(pid=87747) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 22 03:17:58 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-1ffd160f-e342-45e4-8347-bc3e9bdc02c2 tempest-VolumesTestJSON-679048376 None] Acquiring lock "cinder-ced35d83-c3c7-4ef9-8a61-ebaa9b8839d8-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:17:58 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-1ffd160f-e342-45e4-8347-bc3e9bdc02c2 tempest-VolumesTestJSON-679048376 None] Lock "cinder-ced35d83-c3c7-4ef9-8a61-ebaa9b8839d8-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:17:58 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-1ffd160f-e342-45e4-8347-bc3e9bdc02c2 tempest-VolumesTestJSON-679048376 None] Acquiring lock "cinder-quobyte-ced35d83-c3c7-4ef9-8a61-ebaa9b8839d8" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:17:58 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-1ffd160f-e342-45e4-8347-bc3e9bdc02c2 tempest-VolumesTestJSON-679048376 None] Lock "cinder-quobyte-ced35d83-c3c7-4ef9-8a61-ebaa9b8839d8" acquired by "delete_volume" :: waited 0.024s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:17:58 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[29ea126b-529c-406d-8440-83f92b3a2659]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:17:58 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-1ffd160f-e342-45e4-8347-bc3e9bdc02c2 tempest-VolumesTestJSON-679048376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ced35d83-c3c7-4ef9-8a61-ebaa9b8839d8 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:17:58 devstack sudo[92706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ced35d83-c3c7-4ef9-8a61-ebaa9b8839d8 Jul 22 03:17:58 devstack sudo[92706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:17:58 devstack sudo[92706]: pam_unix(sudo:session): session closed for user root Jul 22 03:17:58 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-1ffd160f-e342-45e4-8347-bc3e9bdc02c2 tempest-VolumesTestJSON-679048376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ced35d83-c3c7-4ef9-8a61-ebaa9b8839d8" returned: 0 in 0.437s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:17:58 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-1ffd160f-e342-45e4-8347-bc3e9bdc02c2 tempest-VolumesTestJSON-679048376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ced35d83-c3c7-4ef9-8a61-ebaa9b8839d8 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:17:58 devstack sudo[92712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ced35d83-c3c7-4ef9-8a61-ebaa9b8839d8 Jul 22 03:17:58 devstack sudo[92712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:17:59 devstack sudo[92712]: pam_unix(sudo:session): session closed for user root Jul 22 03:17:59 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-1ffd160f-e342-45e4-8347-bc3e9bdc02c2 tempest-VolumesTestJSON-679048376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ced35d83-c3c7-4ef9-8a61-ebaa9b8839d8" returned: 0 in 0.437s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:17:59 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-1ffd160f-e342-45e4-8347-bc3e9bdc02c2 tempest-VolumesTestJSON-679048376 None] Lock "cinder-quobyte-ced35d83-c3c7-4ef9-8a61-ebaa9b8839d8" released by "delete_volume" :: held 0.933s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:17:59 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-1ffd160f-e342-45e4-8347-bc3e9bdc02c2 tempest-VolumesTestJSON-679048376 None] Created reservations ['8ea72d61-e997-4b9a-be28-b5818b32f2e1', '6f4820f7-1050-4ebf-a0ea-d0d952f13769', '32c5257b-7b2c-4bd5-9b6f-a0ae98c2dd21', 'c5d47329-2136-4a46-be35-e6968c41dfbf'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:17:59 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-1ffd160f-e342-45e4-8347-bc3e9bdc02c2 tempest-VolumesTestJSON-679048376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:17:59 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-1ffd160f-e342-45e4-8347-bc3e9bdc02c2 tempest-VolumesTestJSON-679048376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:17:59 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-1ffd160f-e342-45e4-8347-bc3e9bdc02c2 tempest-VolumesTestJSON-679048376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:17:59 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-1ffd160f-e342-45e4-8347-bc3e9bdc02c2 tempest-VolumesTestJSON-679048376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:17:59 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-1ffd160f-e342-45e4-8347-bc3e9bdc02c2 tempest-VolumesTestJSON-679048376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:17:59 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-1ffd160f-e342-45e4-8347-bc3e9bdc02c2 tempest-VolumesTestJSON-679048376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:17:59 devstack sudo[92718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:17:59 devstack sudo[92718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:17:59 devstack sudo[92718]: pam_unix(sudo:session): session closed for user root Jul 22 03:17:59 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-1ffd160f-e342-45e4-8347-bc3e9bdc02c2 tempest-VolumesTestJSON-679048376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.345s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:17:59 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-1ffd160f-e342-45e4-8347-bc3e9bdc02c2 tempest-VolumesTestJSON-679048376 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:17:59 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-1ffd160f-e342-45e4-8347-bc3e9bdc02c2 tempest-VolumesTestJSON-679048376 None] Deleted volume successfully. Jul 22 03:17:59 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-1ffd160f-e342-45e4-8347-bc3e9bdc02c2 tempest-VolumesTestJSON-679048376 None] Lock "cinder-ced35d83-c3c7-4ef9-8a61-ebaa9b8839d8-delete_volume" released by "delete_volume" :: held 1.625s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:18:00 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-ddd6f6fe-e57f-4c9b-b862-308fa6d8efb5 tempest-VolumesTestJSON-679048376 None] Acquiring lock "cinder-02ef4db8-617f-4c8a-8e4e-48a7b44ef42f-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:18:00 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-ddd6f6fe-e57f-4c9b-b862-308fa6d8efb5 tempest-VolumesTestJSON-679048376 None] Lock "cinder-02ef4db8-617f-4c8a-8e4e-48a7b44ef42f-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:18:00 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-ddd6f6fe-e57f-4c9b-b862-308fa6d8efb5 tempest-VolumesTestJSON-679048376 None] Acquiring lock "cinder-quobyte-02ef4db8-617f-4c8a-8e4e-48a7b44ef42f" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:18:00 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-ddd6f6fe-e57f-4c9b-b862-308fa6d8efb5 tempest-VolumesTestJSON-679048376 None] Lock "cinder-quobyte-02ef4db8-617f-4c8a-8e4e-48a7b44ef42f" acquired by "delete_volume" :: waited 0.025s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:18:00 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7a37f2f-c33f-469e-b6b3-07123ead86b3]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:18:00 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ddd6f6fe-e57f-4c9b-b862-308fa6d8efb5 tempest-VolumesTestJSON-679048376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-02ef4db8-617f-4c8a-8e4e-48a7b44ef42f {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:18:00 devstack sudo[92744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-02ef4db8-617f-4c8a-8e4e-48a7b44ef42f Jul 22 03:18:00 devstack sudo[92744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:18:01 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d6fbf2f-8cdf-435b-a605-2e06521157d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1903463103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:18:01 devstack sudo[92744]: pam_unix(sudo:session): session closed for user root Jul 22 03:18:01 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-7d6fbf2f-8cdf-435b-a605-2e06521157d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1903463103 None] Flow 'volume_create_manager' (fd82775e-a0e4-45ec-aeb2-c68f32ad8056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:18:01 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-7d6fbf2f-8cdf-435b-a605-2e06521157d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1903463103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aeb36e36-0952-4e41-80e6-e7b16332fa39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:18:01 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ddd6f6fe-e57f-4c9b-b862-308fa6d8efb5 tempest-VolumesTestJSON-679048376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-02ef4db8-617f-4c8a-8e4e-48a7b44ef42f" returned: 0 in 0.795s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:18:01 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ddd6f6fe-e57f-4c9b-b862-308fa6d8efb5 tempest-VolumesTestJSON-679048376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-02ef4db8-617f-4c8a-8e4e-48a7b44ef42f {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:18:01 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-7d6fbf2f-8cdf-435b-a605-2e06521157d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1903463103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aeb36e36-0952-4e41-80e6-e7b16332fa39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:18:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1839883060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de523893-a856-49be-8e55-2f85cce1e244,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85c80847f70c4688812e968435833c8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:18:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:18:01Z,use_quota=True,user_id='504fbe17988f445eba82986be7e17fd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:18:01 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-7d6fbf2f-8cdf-435b-a605-2e06521157d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1903463103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37c029b9-e203-42de-b7ed-e91b5035352f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:18:01 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-7d6fbf2f-8cdf-435b-a605-2e06521157d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1903463103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37c029b9-e203-42de-b7ed-e91b5035352f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:18:01 devstack sudo[92752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-02ef4db8-617f-4c8a-8e4e-48a7b44ef42f Jul 22 03:18:01 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-7d6fbf2f-8cdf-435b-a605-2e06521157d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1903463103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f17bae93-967e-4269-a3e4-29bca19148c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:18:01 devstack sudo[92752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:18:01 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-7d6fbf2f-8cdf-435b-a605-2e06521157d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1903463103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f17bae93-967e-4269-a3e4-29bca19148c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de523893-a856-49be-8e55-2f85cce1e244', 'volume_name': 'volume-de523893-a856-49be-8e55-2f85cce1e244', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:18:01 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-7d6fbf2f-8cdf-435b-a605-2e06521157d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1903463103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce64ebe3-3c26-47e3-b28f-5f6592e1a9a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:18:01 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-7d6fbf2f-8cdf-435b-a605-2e06521157d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1903463103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce64ebe3-3c26-47e3-b28f-5f6592e1a9a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:18:01 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-7d6fbf2f-8cdf-435b-a605-2e06521157d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1903463103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af1ff521-bdf0-49b0-9783-f7563caf4b16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:18:01 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-7d6fbf2f-8cdf-435b-a605-2e06521157d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1903463103 None] Volume de523893-a856-49be-8e55-2f85cce1e244: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de523893-a856-49be-8e55-2f85cce1e244', 'volume_size': 1} Jul 22 03:18:01 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-7d6fbf2f-8cdf-435b-a605-2e06521157d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1903463103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:18:01 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-7d6fbf2f-8cdf-435b-a605-2e06521157d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1903463103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:18:01 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-7d6fbf2f-8cdf-435b-a605-2e06521157d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1903463103 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:18:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1839883060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de523893-a856-49be-8e55-2f85cce1e244,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85c80847f70c4688812e968435833c8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:18:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:18:01Z,use_quota=True,user_id='504fbe17988f445eba82986be7e17fd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:18:01 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-7d6fbf2f-8cdf-435b-a605-2e06521157d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1903463103 None] Creating volume de523893-a856-49be-8e55-2f85cce1e244 {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:18:01 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-7d6fbf2f-8cdf-435b-a605-2e06521157d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1903463103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:18:01 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-7d6fbf2f-8cdf-435b-a605-2e06521157d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1903463103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:18:01 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-7d6fbf2f-8cdf-435b-a605-2e06521157d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1903463103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:18:01 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-7d6fbf2f-8cdf-435b-a605-2e06521157d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1903463103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:18:01 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-7d6fbf2f-8cdf-435b-a605-2e06521157d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1903463103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:18:01 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-7d6fbf2f-8cdf-435b-a605-2e06521157d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1903463103 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:18:01 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-7d6fbf2f-8cdf-435b-a605-2e06521157d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1903463103 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:18:01 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-7d6fbf2f-8cdf-435b-a605-2e06521157d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1903463103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-de523893-a856-49be-8e55-2f85cce1e244 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:18:01 devstack sudo[92755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-de523893-a856-49be-8e55-2f85cce1e244 1073741824 Jul 22 03:18:01 devstack sudo[92755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:18:01 devstack sudo[92752]: pam_unix(sudo:session): session closed for user root Jul 22 03:18:01 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ddd6f6fe-e57f-4c9b-b862-308fa6d8efb5 tempest-VolumesTestJSON-679048376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-02ef4db8-617f-4c8a-8e4e-48a7b44ef42f" returned: 0 in 0.404s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:18:01 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-ddd6f6fe-e57f-4c9b-b862-308fa6d8efb5 tempest-VolumesTestJSON-679048376 None] Lock "cinder-quobyte-02ef4db8-617f-4c8a-8e4e-48a7b44ef42f" released by "delete_volume" :: held 1.260s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:18:01 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-ddd6f6fe-e57f-4c9b-b862-308fa6d8efb5 tempest-VolumesTestJSON-679048376 None] Created reservations ['b401fbee-213f-4ee2-b2cb-9f6fd3420bf2', 'ca9fe1f2-6978-4168-84e8-ae55df0b57a1', 'd11030c8-c3ff-48a9-b658-2d8e34a64d0a', 'd89ce836-7266-4dc0-99f4-388a981d8d81'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:18:01 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-ddd6f6fe-e57f-4c9b-b862-308fa6d8efb5 tempest-VolumesTestJSON-679048376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:18:01 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-ddd6f6fe-e57f-4c9b-b862-308fa6d8efb5 tempest-VolumesTestJSON-679048376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:18:01 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-ddd6f6fe-e57f-4c9b-b862-308fa6d8efb5 tempest-VolumesTestJSON-679048376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:18:01 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-ddd6f6fe-e57f-4c9b-b862-308fa6d8efb5 tempest-VolumesTestJSON-679048376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:18:01 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-ddd6f6fe-e57f-4c9b-b862-308fa6d8efb5 tempest-VolumesTestJSON-679048376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:18:01 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ddd6f6fe-e57f-4c9b-b862-308fa6d8efb5 tempest-VolumesTestJSON-679048376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:18:01 devstack sudo[92755]: pam_unix(sudo:session): session closed for user root Jul 22 03:18:01 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-7d6fbf2f-8cdf-435b-a605-2e06521157d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1903463103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-de523893-a856-49be-8e55-2f85cce1e244 1073741824" returned: 0 in 0.518s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:18:02 devstack sudo[92762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:18:02 devstack sudo[92762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:18:02 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-7d6fbf2f-8cdf-435b-a605-2e06521157d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1903463103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-de523893-a856-49be-8e55-2f85cce1e244 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:18:02 devstack sudo[92764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-de523893-a856-49be-8e55-2f85cce1e244 Jul 22 03:18:02 devstack sudo[92764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:18:02 devstack sudo[92762]: pam_unix(sudo:session): session closed for user root Jul 22 03:18:02 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ddd6f6fe-e57f-4c9b-b862-308fa6d8efb5 tempest-VolumesTestJSON-679048376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.303s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:18:02 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-ddd6f6fe-e57f-4c9b-b862-308fa6d8efb5 tempest-VolumesTestJSON-679048376 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:18:02 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-ddd6f6fe-e57f-4c9b-b862-308fa6d8efb5 tempest-VolumesTestJSON-679048376 None] Deleted volume successfully. Jul 22 03:18:02 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-ddd6f6fe-e57f-4c9b-b862-308fa6d8efb5 tempest-VolumesTestJSON-679048376 None] Lock "cinder-02ef4db8-617f-4c8a-8e4e-48a7b44ef42f-delete_volume" released by "delete_volume" :: held 1.884s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:18:02 devstack sudo[92764]: pam_unix(sudo:session): session closed for user root Jul 22 03:18:02 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-7d6fbf2f-8cdf-435b-a605-2e06521157d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1903463103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-de523893-a856-49be-8e55-2f85cce1e244" returned: 0 in 0.338s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:18:02 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-7d6fbf2f-8cdf-435b-a605-2e06521157d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1903463103 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:18:02 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-7d6fbf2f-8cdf-435b-a605-2e06521157d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1903463103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:18:02 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-7d6fbf2f-8cdf-435b-a605-2e06521157d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1903463103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af1ff521-bdf0-49b0-9783-f7563caf4b16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de523893-a856-49be-8e55-2f85cce1e244', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:18:02 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-7d6fbf2f-8cdf-435b-a605-2e06521157d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1903463103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54ed9460-703a-4954-aa35-8d63ce9e3069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:18:02 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-7d6fbf2f-8cdf-435b-a605-2e06521157d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1903463103 None] Volume volume-de523893-a856-49be-8e55-2f85cce1e244 (de523893-a856-49be-8e55-2f85cce1e244): created successfully Jul 22 03:18:02 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-7d6fbf2f-8cdf-435b-a605-2e06521157d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1903463103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54ed9460-703a-4954-aa35-8d63ce9e3069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:18:02 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-7d6fbf2f-8cdf-435b-a605-2e06521157d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1903463103 None] Flow 'volume_create_manager' (fd82775e-a0e4-45ec-aeb2-c68f32ad8056) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:18:02 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-7d6fbf2f-8cdf-435b-a605-2e06521157d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1903463103 None] Created volume successfully. Jul 22 03:18:03 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-94dfe5d5-85ef-4520-8fcb-8beeede2c665 tempest-ServerActionsTestOtherA-1302037554 None] Acquiring lock "cinder-a50b8bc6-d68e-41fb-a2f4-2645492d16eb-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:18:03 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-94dfe5d5-85ef-4520-8fcb-8beeede2c665 tempest-ServerActionsTestOtherA-1302037554 None] Lock "cinder-a50b8bc6-d68e-41fb-a2f4-2645492d16eb-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:18:03 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-94dfe5d5-85ef-4520-8fcb-8beeede2c665 tempest-ServerActionsTestOtherA-1302037554 None] Acquiring lock "cinder-quobyte-a50b8bc6-d68e-41fb-a2f4-2645492d16eb" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:18:03 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-94dfe5d5-85ef-4520-8fcb-8beeede2c665 tempest-ServerActionsTestOtherA-1302037554 None] Lock "cinder-quobyte-a50b8bc6-d68e-41fb-a2f4-2645492d16eb" acquired by "delete_volume" :: waited 0.034s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:18:03 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[b039091c-6c60-4cb2-8c79-790dc2c1f80e]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:18:03 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-94dfe5d5-85ef-4520-8fcb-8beeede2c665 tempest-ServerActionsTestOtherA-1302037554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a50b8bc6-d68e-41fb-a2f4-2645492d16eb {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:18:03 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-22a22024-ef98-461d-9ec0-672aea2b6874 tempest-VolumeSnapshotQuotasNegativeTestJSON-1903463103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:18:03 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-22a22024-ef98-461d-9ec0-672aea2b6874 tempest-VolumeSnapshotQuotasNegativeTestJSON-1903463103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:18:03 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-22a22024-ef98-461d-9ec0-672aea2b6874 tempest-VolumeSnapshotQuotasNegativeTestJSON-1903463103 None] Creating offline snapshot 3902914d-24c8-4c3c-bba0-b2e8d87e1cb6 of volume de523893-a856-49be-8e55-2f85cce1e244 {{(pid=87747) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 03:18:03 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[53863342-f055-40af-a6c6-f2598575d00e]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:18:03 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-22a22024-ef98-461d-9ec0-672aea2b6874 tempest-VolumeSnapshotQuotasNegativeTestJSON-1903463103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-de523893-a856-49be-8e55-2f85cce1e244 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:18:03 devstack sudo[92769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a50b8bc6-d68e-41fb-a2f4-2645492d16eb Jul 22 03:18:03 devstack sudo[92769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:18:03 devstack sudo[92770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-de523893-a856-49be-8e55-2f85cce1e244 Jul 22 03:18:03 devstack sudo[92770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:18:04 devstack sudo[92769]: pam_unix(sudo:session): session closed for user root Jul 22 03:18:04 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-94dfe5d5-85ef-4520-8fcb-8beeede2c665 tempest-ServerActionsTestOtherA-1302037554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a50b8bc6-d68e-41fb-a2f4-2645492d16eb" returned: 0 in 0.489s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:18:04 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-94dfe5d5-85ef-4520-8fcb-8beeede2c665 tempest-ServerActionsTestOtherA-1302037554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a50b8bc6-d68e-41fb-a2f4-2645492d16eb {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:18:04 devstack sudo[92780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a50b8bc6-d68e-41fb-a2f4-2645492d16eb Jul 22 03:18:04 devstack sudo[92780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:18:04 devstack sudo[92770]: pam_unix(sudo:session): session closed for user root Jul 22 03:18:04 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-22a22024-ef98-461d-9ec0-672aea2b6874 tempest-VolumeSnapshotQuotasNegativeTestJSON-1903463103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-de523893-a856-49be-8e55-2f85cce1e244" returned: 0 in 0.512s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:18:04 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-22a22024-ef98-461d-9ec0-672aea2b6874 tempest-VolumeSnapshotQuotasNegativeTestJSON-1903463103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-de523893-a856-49be-8e55-2f85cce1e244,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-de523893-a856-49be-8e55-2f85cce1e244.3902914d-24c8-4c3c-bba0-b2e8d87e1cb6 1G {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:18:04 devstack sudo[92782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-de523893-a856-49be-8e55-2f85cce1e244,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-de523893-a856-49be-8e55-2f85cce1e244.3902914d-24c8-4c3c-bba0-b2e8d87e1cb6 1G Jul 22 03:18:04 devstack sudo[92782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:18:04 devstack sudo[92780]: pam_unix(sudo:session): session closed for user root Jul 22 03:18:04 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-94dfe5d5-85ef-4520-8fcb-8beeede2c665 tempest-ServerActionsTestOtherA-1302037554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a50b8bc6-d68e-41fb-a2f4-2645492d16eb" returned: 0 in 0.285s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:18:04 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-94dfe5d5-85ef-4520-8fcb-8beeede2c665 tempest-ServerActionsTestOtherA-1302037554 None] Lock "cinder-quobyte-a50b8bc6-d68e-41fb-a2f4-2645492d16eb" released by "delete_volume" :: held 0.835s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:18:04 devstack cinder-volume[87747]: DEBUG dbcounter [-] [87747] Writing DB stats cinder:SELECT=118,cinder:UPDATE=117,cinder:INSERT=27,cinder:DELETE=11 {{(pid=87747) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 03:18:04 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-94dfe5d5-85ef-4520-8fcb-8beeede2c665 tempest-ServerActionsTestOtherA-1302037554 None] Created reservations ['112a7270-75ae-45c1-89e1-5d4955966cbb', 'fd94efba-93ea-4005-a7d1-0cd60b95fe5b', 'efc72fc5-5c42-4ab8-8ac0-ce030c5c5403', '430e5ad5-d1b5-490b-9350-4f4a17f6aa48'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:18:04 devstack cinder-volume[87747]: DEBUG dbcounter [-] [87747] Writing DB stats cinder:UPDATE=136,cinder:SELECT=111,cinder:INSERT=30,cinder:DELETE=10 {{(pid=87747) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 03:18:04 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-94dfe5d5-85ef-4520-8fcb-8beeede2c665 tempest-ServerActionsTestOtherA-1302037554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:18:04 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-94dfe5d5-85ef-4520-8fcb-8beeede2c665 tempest-ServerActionsTestOtherA-1302037554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:18:04 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-94dfe5d5-85ef-4520-8fcb-8beeede2c665 tempest-ServerActionsTestOtherA-1302037554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:18:04 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-94dfe5d5-85ef-4520-8fcb-8beeede2c665 tempest-ServerActionsTestOtherA-1302037554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:18:04 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-94dfe5d5-85ef-4520-8fcb-8beeede2c665 tempest-ServerActionsTestOtherA-1302037554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:18:04 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-94dfe5d5-85ef-4520-8fcb-8beeede2c665 tempest-ServerActionsTestOtherA-1302037554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:18:04 devstack sudo[92789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:18:04 devstack sudo[92789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:18:04 devstack sudo[92782]: pam_unix(sudo:session): session closed for user root Jul 22 03:18:04 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-22a22024-ef98-461d-9ec0-672aea2b6874 tempest-VolumeSnapshotQuotasNegativeTestJSON-1903463103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-de523893-a856-49be-8e55-2f85cce1e244,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-de523893-a856-49be-8e55-2f85cce1e244.3902914d-24c8-4c3c-bba0-b2e8d87e1cb6 1G" returned: 0 in 0.600s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:18:04 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-22a22024-ef98-461d-9ec0-672aea2b6874 tempest-VolumeSnapshotQuotasNegativeTestJSON-1903463103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de523893-a856-49be-8e55-2f85cce1e244 -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-de523893-a856-49be-8e55-2f85cce1e244.3902914d-24c8-4c3c-bba0-b2e8d87e1cb6 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:18:04 devstack sudo[92791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de523893-a856-49be-8e55-2f85cce1e244 -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-de523893-a856-49be-8e55-2f85cce1e244.3902914d-24c8-4c3c-bba0-b2e8d87e1cb6 Jul 22 03:18:04 devstack sudo[92791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:18:05 devstack sudo[92789]: pam_unix(sudo:session): session closed for user root Jul 22 03:18:05 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-94dfe5d5-85ef-4520-8fcb-8beeede2c665 tempest-ServerActionsTestOtherA-1302037554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.459s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:18:05 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-94dfe5d5-85ef-4520-8fcb-8beeede2c665 tempest-ServerActionsTestOtherA-1302037554 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:18:05 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-94dfe5d5-85ef-4520-8fcb-8beeede2c665 tempest-ServerActionsTestOtherA-1302037554 None] Deleted volume successfully. Jul 22 03:18:05 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-94dfe5d5-85ef-4520-8fcb-8beeede2c665 tempest-ServerActionsTestOtherA-1302037554 None] Lock "cinder-a50b8bc6-d68e-41fb-a2f4-2645492d16eb-delete_volume" released by "delete_volume" :: held 1.649s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:18:05 devstack sudo[92791]: pam_unix(sudo:session): session closed for user root Jul 22 03:18:05 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-22a22024-ef98-461d-9ec0-672aea2b6874 tempest-VolumeSnapshotQuotasNegativeTestJSON-1903463103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de523893-a856-49be-8e55-2f85cce1e244 -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-de523893-a856-49be-8e55-2f85cce1e244.3902914d-24c8-4c3c-bba0-b2e8d87e1cb6" returned: 0 in 0.453s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:18:05 devstack cinder-volume[87747]: WARNING cinder.volume.drivers.remotefs [None req-22a22024-ef98-461d-9ec0-672aea2b6874 tempest-VolumeSnapshotQuotasNegativeTestJSON-1903463103 None] /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-de523893-a856-49be-8e55-2f85cce1e244.3902914d-24c8-4c3c-bba0-b2e8d87e1cb6 is being set with open permissions: ugo+rw Jul 22 03:18:05 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-22a22024-ef98-461d-9ec0-672aea2b6874 tempest-VolumeSnapshotQuotasNegativeTestJSON-1903463103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-de523893-a856-49be-8e55-2f85cce1e244.3902914d-24c8-4c3c-bba0-b2e8d87e1cb6 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:18:05 devstack sudo[92804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-de523893-a856-49be-8e55-2f85cce1e244.3902914d-24c8-4c3c-bba0-b2e8d87e1cb6 Jul 22 03:18:05 devstack sudo[92804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:18:05 devstack sudo[92804]: pam_unix(sudo:session): session closed for user root Jul 22 03:18:05 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-22a22024-ef98-461d-9ec0-672aea2b6874 tempest-VolumeSnapshotQuotasNegativeTestJSON-1903463103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-de523893-a856-49be-8e55-2f85cce1e244.3902914d-24c8-4c3c-bba0-b2e8d87e1cb6" returned: 0 in 0.374s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:18:05 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-22a22024-ef98-461d-9ec0-672aea2b6874 tempest-VolumeSnapshotQuotasNegativeTestJSON-1903463103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-de523893-a856-49be-8e55-2f85cce1e244.info {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:18:05 devstack sudo[92823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-de523893-a856-49be-8e55-2f85cce1e244.info Jul 22 03:18:05 devstack sudo[92823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:18:06 devstack sudo[92823]: pam_unix(sudo:session): session closed for user root Jul 22 03:18:06 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-22a22024-ef98-461d-9ec0-672aea2b6874 tempest-VolumeSnapshotQuotasNegativeTestJSON-1903463103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-de523893-a856-49be-8e55-2f85cce1e244.info" returned: 0 in 0.418s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:18:06 devstack cinder-volume[87747]: WARNING cinder.volume.drivers.remotefs [None req-22a22024-ef98-461d-9ec0-672aea2b6874 tempest-VolumeSnapshotQuotasNegativeTestJSON-1903463103 None] /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-de523893-a856-49be-8e55-2f85cce1e244.info is being set with open permissions: ugo+rw Jul 22 03:18:06 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-22a22024-ef98-461d-9ec0-672aea2b6874 tempest-VolumeSnapshotQuotasNegativeTestJSON-1903463103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-de523893-a856-49be-8e55-2f85cce1e244.info {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:18:06 devstack sudo[92826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-de523893-a856-49be-8e55-2f85cce1e244.info Jul 22 03:18:06 devstack sudo[92826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:18:06 devstack sudo[92826]: pam_unix(sudo:session): session closed for user root Jul 22 03:18:06 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-22a22024-ef98-461d-9ec0-672aea2b6874 tempest-VolumeSnapshotQuotasNegativeTestJSON-1903463103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-de523893-a856-49be-8e55-2f85cce1e244.info" returned: 0 in 0.293s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:18:06 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-22a22024-ef98-461d-9ec0-672aea2b6874 tempest-VolumeSnapshotQuotasNegativeTestJSON-1903463103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.792s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:18:06 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-22a22024-ef98-461d-9ec0-672aea2b6874 tempest-VolumeSnapshotQuotasNegativeTestJSON-1903463103 None] Create snapshot completed successfully Jul 22 03:18:06 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-bc8211dc-6c6b-4722-8051-fdf9229d801f tempest-GroupSnapshotsV319Test-746241117 None] Group tempest-GroupSnapshotsV319Test-Group-1242060821: creating Jul 22 03:18:06 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-bc8211dc-6c6b-4722-8051-fdf9229d801f tempest-GroupSnapshotsV319Test-746241117 None] Group tempest-GroupSnapshotsV319Test-Group-1242060821: created successfully Jul 22 03:18:06 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-bc8211dc-6c6b-4722-8051-fdf9229d801f tempest-GroupSnapshotsV319Test-746241117 None] Create group completed successfully. Jul 22 03:18:07 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-0457cea8-d0ef-45bf-b9e2-6bd5f43adb5c tempest-VolumeSnapshotQuotasNegativeTestJSON-1903463103 None] Acquiring lock "cinder-3902914d-24c8-4c3c-bba0-b2e8d87e1cb6-delete_snapshot" by "delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:18:07 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-0457cea8-d0ef-45bf-b9e2-6bd5f43adb5c tempest-VolumeSnapshotQuotasNegativeTestJSON-1903463103 None] Lock "cinder-3902914d-24c8-4c3c-bba0-b2e8d87e1cb6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:18:07 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-0457cea8-d0ef-45bf-b9e2-6bd5f43adb5c tempest-VolumeSnapshotQuotasNegativeTestJSON-1903463103 None] Acquiring lock "cinder-quobyte-de523893-a856-49be-8e55-2f85cce1e244" by "delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:18:07 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-0457cea8-d0ef-45bf-b9e2-6bd5f43adb5c tempest-VolumeSnapshotQuotasNegativeTestJSON-1903463103 None] Lock "cinder-quobyte-de523893-a856-49be-8e55-2f85cce1e244" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:18:07 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-0457cea8-d0ef-45bf-b9e2-6bd5f43adb5c tempest-VolumeSnapshotQuotasNegativeTestJSON-1903463103 None] Acquiring lock "cinder-quobyte-3902914d-24c8-4c3c-bba0-b2e8d87e1cb6" by "_delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:18:07 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-0457cea8-d0ef-45bf-b9e2-6bd5f43adb5c tempest-VolumeSnapshotQuotasNegativeTestJSON-1903463103 None] Lock "cinder-quobyte-3902914d-24c8-4c3c-bba0-b2e8d87e1cb6" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:18:07 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-0457cea8-d0ef-45bf-b9e2-6bd5f43adb5c tempest-VolumeSnapshotQuotasNegativeTestJSON-1903463103 None] Deleting offline snapshot 3902914d-24c8-4c3c-bba0-b2e8d87e1cb6 of volume de523893-a856-49be-8e55-2f85cce1e244 {{(pid=87747) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 03:18:07 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-0457cea8-d0ef-45bf-b9e2-6bd5f43adb5c tempest-VolumeSnapshotQuotasNegativeTestJSON-1903463103 None] snapshot_file for this snap is: volume-de523893-a856-49be-8e55-2f85cce1e244.3902914d-24c8-4c3c-bba0-b2e8d87e1cb6 {{(pid=87747) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 03:18:07 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd6af3e8-d296-43fd-b46d-22783f1e0006]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:18:07 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-0457cea8-d0ef-45bf-b9e2-6bd5f43adb5c tempest-VolumeSnapshotQuotasNegativeTestJSON-1903463103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-de523893-a856-49be-8e55-2f85cce1e244.3902914d-24c8-4c3c-bba0-b2e8d87e1cb6 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:18:07 devstack sudo[92830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-de523893-a856-49be-8e55-2f85cce1e244.3902914d-24c8-4c3c-bba0-b2e8d87e1cb6 Jul 22 03:18:07 devstack sudo[92830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:18:07 devstack sudo[92830]: pam_unix(sudo:session): session closed for user root Jul 22 03:18:07 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-0457cea8-d0ef-45bf-b9e2-6bd5f43adb5c tempest-VolumeSnapshotQuotasNegativeTestJSON-1903463103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-de523893-a856-49be-8e55-2f85cce1e244.3902914d-24c8-4c3c-bba0-b2e8d87e1cb6" returned: 0 in 0.570s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:18:07 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-0457cea8-d0ef-45bf-b9e2-6bd5f43adb5c tempest-VolumeSnapshotQuotasNegativeTestJSON-1903463103 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de523893-a856-49be-8e55-2f85cce1e244(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87747) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 03:18:07 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef4a6b5f-4a3d-443d-9c39-b290ee50acb4]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:18:07 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-0457cea8-d0ef-45bf-b9e2-6bd5f43adb5c tempest-VolumeSnapshotQuotasNegativeTestJSON-1903463103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-de523893-a856-49be-8e55-2f85cce1e244 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:18:08 devstack sudo[92837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-de523893-a856-49be-8e55-2f85cce1e244 Jul 22 03:18:08 devstack sudo[92837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:18:08 devstack sudo[92837]: pam_unix(sudo:session): session closed for user root Jul 22 03:18:08 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-0457cea8-d0ef-45bf-b9e2-6bd5f43adb5c tempest-VolumeSnapshotQuotasNegativeTestJSON-1903463103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-de523893-a856-49be-8e55-2f85cce1e244" returned: 0 in 0.582s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:18:08 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-0457cea8-d0ef-45bf-b9e2-6bd5f43adb5c tempest-VolumeSnapshotQuotasNegativeTestJSON-1903463103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-de523893-a856-49be-8e55-2f85cce1e244.3902914d-24c8-4c3c-bba0-b2e8d87e1cb6 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:18:08 devstack sudo[92843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-de523893-a856-49be-8e55-2f85cce1e244.3902914d-24c8-4c3c-bba0-b2e8d87e1cb6 Jul 22 03:18:08 devstack sudo[92843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:18:08 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-928e669e-f601-417e-8dc7-6603c8965b62 tempest-GroupSnapshotsV319Test-746241117 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:18:08 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-928e669e-f601-417e-8dc7-6603c8965b62 tempest-GroupSnapshotsV319Test-746241117 None] Flow 'volume_create_manager' (c3ed0861-7339-445c-9de8-ec6b4c4c402c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:18:08 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-928e669e-f601-417e-8dc7-6603c8965b62 tempest-GroupSnapshotsV319Test-746241117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88f886e7-b535-4aa0-8e41-18f5c6bc8a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:18:08 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-928e669e-f601-417e-8dc7-6603c8965b62 tempest-GroupSnapshotsV319Test-746241117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88f886e7-b535-4aa0-8e41-18f5c6bc8a92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:18:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1504518480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4d159794-59ec-4719-a099-d0d7ca9d062a,host='devstack@QuobyteHD#QuobyteHD',id=4a80e623-6e10-4120-ae23-1373b273645e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1716cc6212234972803814ad88cb25d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:18:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:18:08Z,use_quota=True,user_id='f2eb9dc6147b44c0a0454618d70025fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55ad6960-daf7-453a-afd2-d6612fe47995),volume_type_id=55ad6960-daf7-453a-afd2-d6612fe47995)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:18:08 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-928e669e-f601-417e-8dc7-6603c8965b62 tempest-GroupSnapshotsV319Test-746241117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a14b66ff-3fab-4288-87ef-f734734347e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:18:08 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-928e669e-f601-417e-8dc7-6603c8965b62 tempest-GroupSnapshotsV319Test-746241117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a14b66ff-3fab-4288-87ef-f734734347e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:18:08 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-928e669e-f601-417e-8dc7-6603c8965b62 tempest-GroupSnapshotsV319Test-746241117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1b98e3d-abb1-42f1-b4df-aa64b2f2f6c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:18:08 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-928e669e-f601-417e-8dc7-6603c8965b62 tempest-GroupSnapshotsV319Test-746241117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1b98e3d-abb1-42f1-b4df-aa64b2f2f6c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a80e623-6e10-4120-ae23-1373b273645e', 'volume_name': 'volume-4a80e623-6e10-4120-ae23-1373b273645e', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:18:08 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-928e669e-f601-417e-8dc7-6603c8965b62 tempest-GroupSnapshotsV319Test-746241117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4024fe66-5e7e-4380-a517-bf97c5413312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:18:08 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-928e669e-f601-417e-8dc7-6603c8965b62 tempest-GroupSnapshotsV319Test-746241117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4024fe66-5e7e-4380-a517-bf97c5413312) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:18:08 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-928e669e-f601-417e-8dc7-6603c8965b62 tempest-GroupSnapshotsV319Test-746241117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67710718-bbaa-4645-9ec5-bf2c2958e926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:18:08 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-928e669e-f601-417e-8dc7-6603c8965b62 tempest-GroupSnapshotsV319Test-746241117 None] Volume 4a80e623-6e10-4120-ae23-1373b273645e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a80e623-6e10-4120-ae23-1373b273645e', 'volume_size': 1} Jul 22 03:18:08 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-928e669e-f601-417e-8dc7-6603c8965b62 tempest-GroupSnapshotsV319Test-746241117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:18:08 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-928e669e-f601-417e-8dc7-6603c8965b62 tempest-GroupSnapshotsV319Test-746241117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:18:08 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-928e669e-f601-417e-8dc7-6603c8965b62 tempest-GroupSnapshotsV319Test-746241117 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=4d159794-59ec-4719-a099-d0d7ca9d062a,created_at=2026-07-22T01:18:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1504518480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4d159794-59ec-4719-a099-d0d7ca9d062a,host='devstack@QuobyteHD#QuobyteHD',id=4a80e623-6e10-4120-ae23-1373b273645e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1716cc6212234972803814ad88cb25d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:18:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:18:08Z,use_quota=True,user_id='f2eb9dc6147b44c0a0454618d70025fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55ad6960-daf7-453a-afd2-d6612fe47995),volume_type_id=55ad6960-daf7-453a-afd2-d6612fe47995)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:18:08 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-928e669e-f601-417e-8dc7-6603c8965b62 tempest-GroupSnapshotsV319Test-746241117 None] Creating volume 4a80e623-6e10-4120-ae23-1373b273645e {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:18:08 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-928e669e-f601-417e-8dc7-6603c8965b62 tempest-GroupSnapshotsV319Test-746241117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:18:08 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-928e669e-f601-417e-8dc7-6603c8965b62 tempest-GroupSnapshotsV319Test-746241117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:18:08 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-928e669e-f601-417e-8dc7-6603c8965b62 tempest-GroupSnapshotsV319Test-746241117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:18:08 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-928e669e-f601-417e-8dc7-6603c8965b62 tempest-GroupSnapshotsV319Test-746241117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:18:08 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-928e669e-f601-417e-8dc7-6603c8965b62 tempest-GroupSnapshotsV319Test-746241117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:18:08 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-928e669e-f601-417e-8dc7-6603c8965b62 tempest-GroupSnapshotsV319Test-746241117 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:18:08 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-928e669e-f601-417e-8dc7-6603c8965b62 tempest-GroupSnapshotsV319Test-746241117 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:18:08 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-928e669e-f601-417e-8dc7-6603c8965b62 tempest-GroupSnapshotsV319Test-746241117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4a80e623-6e10-4120-ae23-1373b273645e 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:18:08 devstack sudo[92845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4a80e623-6e10-4120-ae23-1373b273645e 1073741824 Jul 22 03:18:08 devstack sudo[92845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:18:08 devstack sudo[92843]: pam_unix(sudo:session): session closed for user root Jul 22 03:18:08 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-0457cea8-d0ef-45bf-b9e2-6bd5f43adb5c tempest-VolumeSnapshotQuotasNegativeTestJSON-1903463103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-de523893-a856-49be-8e55-2f85cce1e244.3902914d-24c8-4c3c-bba0-b2e8d87e1cb6" returned: 0 in 0.388s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:18:08 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-0457cea8-d0ef-45bf-b9e2-6bd5f43adb5c tempest-VolumeSnapshotQuotasNegativeTestJSON-1903463103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-de523893-a856-49be-8e55-2f85cce1e244.3902914d-24c8-4c3c-bba0-b2e8d87e1cb6 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:18:08 devstack sudo[92853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-de523893-a856-49be-8e55-2f85cce1e244.3902914d-24c8-4c3c-bba0-b2e8d87e1cb6 Jul 22 03:18:08 devstack sudo[92853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:18:09 devstack sudo[92845]: pam_unix(sudo:session): session closed for user root Jul 22 03:18:09 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-928e669e-f601-417e-8dc7-6603c8965b62 tempest-GroupSnapshotsV319Test-746241117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4a80e623-6e10-4120-ae23-1373b273645e 1073741824" returned: 0 in 0.531s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:18:09 devstack sudo[92853]: pam_unix(sudo:session): session closed for user root Jul 22 03:18:09 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-928e669e-f601-417e-8dc7-6603c8965b62 tempest-GroupSnapshotsV319Test-746241117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4a80e623-6e10-4120-ae23-1373b273645e {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:18:09 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-0457cea8-d0ef-45bf-b9e2-6bd5f43adb5c tempest-VolumeSnapshotQuotasNegativeTestJSON-1903463103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-de523893-a856-49be-8e55-2f85cce1e244.3902914d-24c8-4c3c-bba0-b2e8d87e1cb6" returned: 0 in 0.328s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:18:09 devstack sudo[92858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4a80e623-6e10-4120-ae23-1373b273645e Jul 22 03:18:09 devstack sudo[92858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:18:09 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-0457cea8-d0ef-45bf-b9e2-6bd5f43adb5c tempest-VolumeSnapshotQuotasNegativeTestJSON-1903463103 None] Lock "cinder-quobyte-3902914d-24c8-4c3c-bba0-b2e8d87e1cb6" released by "_delete_snapshot" :: held 2.029s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:18:09 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-0457cea8-d0ef-45bf-b9e2-6bd5f43adb5c tempest-VolumeSnapshotQuotasNegativeTestJSON-1903463103 None] Lock "cinder-quobyte-de523893-a856-49be-8e55-2f85cce1e244" released by "delete_snapshot" :: held 2.069s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:18:09 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-0457cea8-d0ef-45bf-b9e2-6bd5f43adb5c tempest-VolumeSnapshotQuotasNegativeTestJSON-1903463103 None] Created reservations ['36011dd2-778e-4935-a3de-8763b500a936', '3d9fe1c7-926c-4fb2-9aa1-6e5d9028f4fb', '692089fe-20f8-446a-b5f5-db5efbc892c3', 'a88b1380-b3fa-4cf8-86b3-90ce8e489e72'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:18:09 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-0457cea8-d0ef-45bf-b9e2-6bd5f43adb5c tempest-VolumeSnapshotQuotasNegativeTestJSON-1903463103 None] Delete snapshot completed successfully. Jul 22 03:18:09 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-0457cea8-d0ef-45bf-b9e2-6bd5f43adb5c tempest-VolumeSnapshotQuotasNegativeTestJSON-1903463103 None] Lock "cinder-3902914d-24c8-4c3c-bba0-b2e8d87e1cb6-delete_snapshot" released by "delete_snapshot" :: held 2.283s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:18:09 devstack sudo[92858]: pam_unix(sudo:session): session closed for user root Jul 22 03:18:09 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-928e669e-f601-417e-8dc7-6603c8965b62 tempest-GroupSnapshotsV319Test-746241117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4a80e623-6e10-4120-ae23-1373b273645e" returned: 0 in 0.375s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:18:09 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-928e669e-f601-417e-8dc7-6603c8965b62 tempest-GroupSnapshotsV319Test-746241117 None] <== create_volume: return (957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:18:09 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-928e669e-f601-417e-8dc7-6603c8965b62 tempest-GroupSnapshotsV319Test-746241117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.959s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:18:09 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-928e669e-f601-417e-8dc7-6603c8965b62 tempest-GroupSnapshotsV319Test-746241117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67710718-bbaa-4645-9ec5-bf2c2958e926) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a80e623-6e10-4120-ae23-1373b273645e', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:18:09 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-928e669e-f601-417e-8dc7-6603c8965b62 tempest-GroupSnapshotsV319Test-746241117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8df6fe6-6a77-4ed1-976a-d21e1654289b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:18:09 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-928e669e-f601-417e-8dc7-6603c8965b62 tempest-GroupSnapshotsV319Test-746241117 None] Volume volume-4a80e623-6e10-4120-ae23-1373b273645e (4a80e623-6e10-4120-ae23-1373b273645e): created successfully Jul 22 03:18:09 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-928e669e-f601-417e-8dc7-6603c8965b62 tempest-GroupSnapshotsV319Test-746241117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8df6fe6-6a77-4ed1-976a-d21e1654289b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:18:09 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-928e669e-f601-417e-8dc7-6603c8965b62 tempest-GroupSnapshotsV319Test-746241117 None] Flow 'volume_create_manager' (c3ed0861-7339-445c-9de8-ec6b4c4c402c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:18:09 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-928e669e-f601-417e-8dc7-6603c8965b62 tempest-GroupSnapshotsV319Test-746241117 None] Created volume successfully. Jul 22 03:18:10 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-c78b525d-19b8-4711-ad06-9aa24e4db2f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1903463103 None] Acquiring lock "cinder-de523893-a856-49be-8e55-2f85cce1e244-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:18:10 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-c78b525d-19b8-4711-ad06-9aa24e4db2f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1903463103 None] Lock "cinder-de523893-a856-49be-8e55-2f85cce1e244-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:18:10 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-c78b525d-19b8-4711-ad06-9aa24e4db2f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1903463103 None] Acquiring lock "cinder-quobyte-de523893-a856-49be-8e55-2f85cce1e244" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:18:10 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-c78b525d-19b8-4711-ad06-9aa24e4db2f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1903463103 None] Lock "cinder-quobyte-de523893-a856-49be-8e55-2f85cce1e244" acquired by "delete_volume" :: waited 0.024s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:18:10 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[f60d3a15-eaec-4b34-bba5-7703eb93984b]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:18:10 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-c78b525d-19b8-4711-ad06-9aa24e4db2f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1903463103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-de523893-a856-49be-8e55-2f85cce1e244 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:18:10 devstack sudo[92861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-de523893-a856-49be-8e55-2f85cce1e244 Jul 22 03:18:10 devstack sudo[92861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:18:11 devstack sudo[92861]: pam_unix(sudo:session): session closed for user root Jul 22 03:18:11 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-c78b525d-19b8-4711-ad06-9aa24e4db2f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1903463103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-de523893-a856-49be-8e55-2f85cce1e244" returned: 0 in 0.484s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:18:11 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-c78b525d-19b8-4711-ad06-9aa24e4db2f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1903463103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-de523893-a856-49be-8e55-2f85cce1e244 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:18:11 devstack sudo[92866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-de523893-a856-49be-8e55-2f85cce1e244 Jul 22 03:18:11 devstack sudo[92866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:18:11 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-1fcc4bff-f0cb-4775-8922-72293639aa7f tempest-GroupSnapshotsV319Test-746241117 None] GroupSnapshot dadff30e-8180-4e11-ab9e-7cd75256a781: creating. Jul 22 03:18:11 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-1fcc4bff-f0cb-4775-8922-72293639aa7f tempest-GroupSnapshotsV319Test-746241117 None] Group snapshot dadff30e-8180-4e11-ab9e-7cd75256a781: creating. {{(pid=87747) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 22 03:18:11 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-1fcc4bff-f0cb-4775-8922-72293639aa7f tempest-GroupSnapshotsV319Test-746241117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:18:11 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-1fcc4bff-f0cb-4775-8922-72293639aa7f tempest-GroupSnapshotsV319Test-746241117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:18:11 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-1fcc4bff-f0cb-4775-8922-72293639aa7f tempest-GroupSnapshotsV319Test-746241117 None] Creating offline snapshot 66cdfed6-2e96-4f96-a3ff-e9a3a56e8486 of volume 4a80e623-6e10-4120-ae23-1373b273645e {{(pid=87747) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 03:18:11 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c418052-71e2-46bf-9322-cc7dbbd0beae]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:18:11 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-1fcc4bff-f0cb-4775-8922-72293639aa7f tempest-GroupSnapshotsV319Test-746241117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4a80e623-6e10-4120-ae23-1373b273645e {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:18:11 devstack sudo[92866]: pam_unix(sudo:session): session closed for user root Jul 22 03:18:11 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-c78b525d-19b8-4711-ad06-9aa24e4db2f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1903463103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-de523893-a856-49be-8e55-2f85cce1e244" returned: 0 in 0.345s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:18:11 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-c78b525d-19b8-4711-ad06-9aa24e4db2f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1903463103 None] Lock "cinder-quobyte-de523893-a856-49be-8e55-2f85cce1e244" released by "delete_volume" :: held 0.906s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:18:11 devstack sudo[92868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4a80e623-6e10-4120-ae23-1373b273645e Jul 22 03:18:11 devstack sudo[92868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:18:11 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-c78b525d-19b8-4711-ad06-9aa24e4db2f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1903463103 None] Created reservations ['a64e06f6-5832-4d82-ac40-09d5e11f5c83', '1f54ec83-eb08-4292-b309-df14bf2c2db8', '5d3c9284-4e4b-4516-a76c-4da4c6c14b01', 'ff70988a-6571-42f2-8f91-896d3a28e07c'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:18:11 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-c78b525d-19b8-4711-ad06-9aa24e4db2f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1903463103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:18:11 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-c78b525d-19b8-4711-ad06-9aa24e4db2f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1903463103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:18:11 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-c78b525d-19b8-4711-ad06-9aa24e4db2f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1903463103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:18:11 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-c78b525d-19b8-4711-ad06-9aa24e4db2f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1903463103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:18:11 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-c78b525d-19b8-4711-ad06-9aa24e4db2f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1903463103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:18:11 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-c78b525d-19b8-4711-ad06-9aa24e4db2f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1903463103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:18:11 devstack sudo[92872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:18:11 devstack sudo[92872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:18:11 devstack sudo[92868]: pam_unix(sudo:session): session closed for user root Jul 22 03:18:11 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-1fcc4bff-f0cb-4775-8922-72293639aa7f tempest-GroupSnapshotsV319Test-746241117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4a80e623-6e10-4120-ae23-1373b273645e" returned: 0 in 0.489s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:18:11 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-1fcc4bff-f0cb-4775-8922-72293639aa7f tempest-GroupSnapshotsV319Test-746241117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4a80e623-6e10-4120-ae23-1373b273645e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4a80e623-6e10-4120-ae23-1373b273645e.66cdfed6-2e96-4f96-a3ff-e9a3a56e8486 1G {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:18:11 devstack sudo[92877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4a80e623-6e10-4120-ae23-1373b273645e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4a80e623-6e10-4120-ae23-1373b273645e.66cdfed6-2e96-4f96-a3ff-e9a3a56e8486 1G Jul 22 03:18:11 devstack sudo[92877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:18:12 devstack sudo[92872]: pam_unix(sudo:session): session closed for user root Jul 22 03:18:12 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-c78b525d-19b8-4711-ad06-9aa24e4db2f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1903463103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.296s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:18:12 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-c78b525d-19b8-4711-ad06-9aa24e4db2f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1903463103 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:18:12 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-c78b525d-19b8-4711-ad06-9aa24e4db2f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1903463103 None] Deleted volume successfully. Jul 22 03:18:12 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-c78b525d-19b8-4711-ad06-9aa24e4db2f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1903463103 None] Lock "cinder-de523893-a856-49be-8e55-2f85cce1e244-delete_volume" released by "delete_volume" :: held 1.517s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:18:12 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-4429c2ef-305b-4cfb-818f-c3725b55de88 tempest-BackendsCapabilitiesAdminTestsJSON-270419802 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757713317871, 'free_capacity_gb': 1775.757713317871, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87747) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 22 03:18:12 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-e666b777-8ed3-4963-a1b3-ed015e640e69 tempest-BackendsCapabilitiesAdminTestsJSON-270419802 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757713317871, 'free_capacity_gb': 1775.757713317871, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87747) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 22 03:18:12 devstack sudo[92877]: pam_unix(sudo:session): session closed for user root Jul 22 03:18:12 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-1fcc4bff-f0cb-4775-8922-72293639aa7f tempest-GroupSnapshotsV319Test-746241117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4a80e623-6e10-4120-ae23-1373b273645e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4a80e623-6e10-4120-ae23-1373b273645e.66cdfed6-2e96-4f96-a3ff-e9a3a56e8486 1G" returned: 0 in 0.464s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:18:12 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-1fcc4bff-f0cb-4775-8922-72293639aa7f tempest-GroupSnapshotsV319Test-746241117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a80e623-6e10-4120-ae23-1373b273645e -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4a80e623-6e10-4120-ae23-1373b273645e.66cdfed6-2e96-4f96-a3ff-e9a3a56e8486 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:18:12 devstack sudo[92884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a80e623-6e10-4120-ae23-1373b273645e -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4a80e623-6e10-4120-ae23-1373b273645e.66cdfed6-2e96-4f96-a3ff-e9a3a56e8486 Jul 22 03:18:12 devstack sudo[92884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:18:12 devstack sudo[92884]: pam_unix(sudo:session): session closed for user root Jul 22 03:18:12 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-1fcc4bff-f0cb-4775-8922-72293639aa7f tempest-GroupSnapshotsV319Test-746241117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a80e623-6e10-4120-ae23-1373b273645e -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4a80e623-6e10-4120-ae23-1373b273645e.66cdfed6-2e96-4f96-a3ff-e9a3a56e8486" returned: 0 in 0.340s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:18:12 devstack cinder-volume[87747]: WARNING cinder.volume.drivers.remotefs [None req-1fcc4bff-f0cb-4775-8922-72293639aa7f tempest-GroupSnapshotsV319Test-746241117 None] /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4a80e623-6e10-4120-ae23-1373b273645e.66cdfed6-2e96-4f96-a3ff-e9a3a56e8486 is being set with open permissions: ugo+rw: NotImplementedError Jul 22 03:18:12 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-1fcc4bff-f0cb-4775-8922-72293639aa7f tempest-GroupSnapshotsV319Test-746241117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4a80e623-6e10-4120-ae23-1373b273645e.66cdfed6-2e96-4f96-a3ff-e9a3a56e8486 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:18:12 devstack sudo[92891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4a80e623-6e10-4120-ae23-1373b273645e.66cdfed6-2e96-4f96-a3ff-e9a3a56e8486 Jul 22 03:18:12 devstack sudo[92891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:18:12 devstack sudo[92891]: pam_unix(sudo:session): session closed for user root Jul 22 03:18:12 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-1fcc4bff-f0cb-4775-8922-72293639aa7f tempest-GroupSnapshotsV319Test-746241117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4a80e623-6e10-4120-ae23-1373b273645e.66cdfed6-2e96-4f96-a3ff-e9a3a56e8486" returned: 0 in 0.279s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:18:13 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-1fcc4bff-f0cb-4775-8922-72293639aa7f tempest-GroupSnapshotsV319Test-746241117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4a80e623-6e10-4120-ae23-1373b273645e.info {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:18:13 devstack sudo[92894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4a80e623-6e10-4120-ae23-1373b273645e.info Jul 22 03:18:13 devstack sudo[92894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:18:13 devstack sudo[92894]: pam_unix(sudo:session): session closed for user root Jul 22 03:18:13 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-1fcc4bff-f0cb-4775-8922-72293639aa7f tempest-GroupSnapshotsV319Test-746241117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4a80e623-6e10-4120-ae23-1373b273645e.info" returned: 0 in 0.322s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:18:13 devstack cinder-volume[87747]: WARNING cinder.volume.drivers.remotefs [None req-1fcc4bff-f0cb-4775-8922-72293639aa7f tempest-GroupSnapshotsV319Test-746241117 None] /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4a80e623-6e10-4120-ae23-1373b273645e.info is being set with open permissions: ugo+rw: NotImplementedError Jul 22 03:18:13 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-1fcc4bff-f0cb-4775-8922-72293639aa7f tempest-GroupSnapshotsV319Test-746241117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4a80e623-6e10-4120-ae23-1373b273645e.info {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:18:13 devstack sudo[92899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4a80e623-6e10-4120-ae23-1373b273645e.info Jul 22 03:18:13 devstack sudo[92899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:18:13 devstack sudo[92899]: pam_unix(sudo:session): session closed for user root Jul 22 03:18:13 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-1fcc4bff-f0cb-4775-8922-72293639aa7f tempest-GroupSnapshotsV319Test-746241117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4a80e623-6e10-4120-ae23-1373b273645e.info" returned: 0 in 0.340s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:18:13 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-1fcc4bff-f0cb-4775-8922-72293639aa7f tempest-GroupSnapshotsV319Test-746241117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.325s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:18:13 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-1fcc4bff-f0cb-4775-8922-72293639aa7f tempest-GroupSnapshotsV319Test-746241117 None] group_snapshot dadff30e-8180-4e11-ab9e-7cd75256a781: created successfully Jul 22 03:18:15 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-cad1a6e8-fa99-4cf1-a8f4-2ddc00600e43 tempest-GroupSnapshotsV319Test-746241117 None] group_snapshot dadff30e-8180-4e11-ab9e-7cd75256a781: deleting Jul 22 03:18:15 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-cad1a6e8-fa99-4cf1-a8f4-2ddc00600e43 tempest-GroupSnapshotsV319Test-746241117 None] group_snapshot dadff30e-8180-4e11-ab9e-7cd75256a781: deleting {{(pid=87747) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 22 03:18:15 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-cad1a6e8-fa99-4cf1-a8f4-2ddc00600e43 tempest-GroupSnapshotsV319Test-746241117 None] Acquiring lock "cinder-quobyte-4a80e623-6e10-4120-ae23-1373b273645e" by "delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:18:15 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-cad1a6e8-fa99-4cf1-a8f4-2ddc00600e43 tempest-GroupSnapshotsV319Test-746241117 None] Lock "cinder-quobyte-4a80e623-6e10-4120-ae23-1373b273645e" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:18:15 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-cad1a6e8-fa99-4cf1-a8f4-2ddc00600e43 tempest-GroupSnapshotsV319Test-746241117 None] Acquiring lock "cinder-quobyte-66cdfed6-2e96-4f96-a3ff-e9a3a56e8486" by "_delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:18:15 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-cad1a6e8-fa99-4cf1-a8f4-2ddc00600e43 tempest-GroupSnapshotsV319Test-746241117 None] Lock "cinder-quobyte-66cdfed6-2e96-4f96-a3ff-e9a3a56e8486" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:18:15 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-cad1a6e8-fa99-4cf1-a8f4-2ddc00600e43 tempest-GroupSnapshotsV319Test-746241117 None] Deleting offline snapshot 66cdfed6-2e96-4f96-a3ff-e9a3a56e8486 of volume 4a80e623-6e10-4120-ae23-1373b273645e {{(pid=87747) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 03:18:15 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-cad1a6e8-fa99-4cf1-a8f4-2ddc00600e43 tempest-GroupSnapshotsV319Test-746241117 None] snapshot_file for this snap is: volume-4a80e623-6e10-4120-ae23-1373b273645e.66cdfed6-2e96-4f96-a3ff-e9a3a56e8486 {{(pid=87747) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 03:18:15 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[31db0591-622f-43e5-8f5d-f3e429425ed0]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:18:15 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-cad1a6e8-fa99-4cf1-a8f4-2ddc00600e43 tempest-GroupSnapshotsV319Test-746241117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4a80e623-6e10-4120-ae23-1373b273645e.66cdfed6-2e96-4f96-a3ff-e9a3a56e8486 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:18:15 devstack sudo[92903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4a80e623-6e10-4120-ae23-1373b273645e.66cdfed6-2e96-4f96-a3ff-e9a3a56e8486 Jul 22 03:18:15 devstack sudo[92903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:18:15 devstack sudo[92903]: pam_unix(sudo:session): session closed for user root Jul 22 03:18:15 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-cad1a6e8-fa99-4cf1-a8f4-2ddc00600e43 tempest-GroupSnapshotsV319Test-746241117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4a80e623-6e10-4120-ae23-1373b273645e.66cdfed6-2e96-4f96-a3ff-e9a3a56e8486" returned: 0 in 0.476s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:18:15 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-cad1a6e8-fa99-4cf1-a8f4-2ddc00600e43 tempest-GroupSnapshotsV319Test-746241117 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4a80e623-6e10-4120-ae23-1373b273645e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87747) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 03:18:15 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[56781c09-f6be-4264-b02c-3329b25f3959]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:18:15 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-cad1a6e8-fa99-4cf1-a8f4-2ddc00600e43 tempest-GroupSnapshotsV319Test-746241117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4a80e623-6e10-4120-ae23-1373b273645e {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:18:15 devstack sudo[92908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4a80e623-6e10-4120-ae23-1373b273645e Jul 22 03:18:15 devstack sudo[92908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:18:16 devstack sudo[92908]: pam_unix(sudo:session): session closed for user root Jul 22 03:18:16 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-cad1a6e8-fa99-4cf1-a8f4-2ddc00600e43 tempest-GroupSnapshotsV319Test-746241117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4a80e623-6e10-4120-ae23-1373b273645e" returned: 0 in 0.430s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:18:16 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-cad1a6e8-fa99-4cf1-a8f4-2ddc00600e43 tempest-GroupSnapshotsV319Test-746241117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4a80e623-6e10-4120-ae23-1373b273645e.66cdfed6-2e96-4f96-a3ff-e9a3a56e8486 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:18:16 devstack sudo[92913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4a80e623-6e10-4120-ae23-1373b273645e.66cdfed6-2e96-4f96-a3ff-e9a3a56e8486 Jul 22 03:18:16 devstack sudo[92913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:18:16 devstack sudo[92913]: pam_unix(sudo:session): session closed for user root Jul 22 03:18:16 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-cad1a6e8-fa99-4cf1-a8f4-2ddc00600e43 tempest-GroupSnapshotsV319Test-746241117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4a80e623-6e10-4120-ae23-1373b273645e.66cdfed6-2e96-4f96-a3ff-e9a3a56e8486" returned: 0 in 0.475s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:18:16 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-cad1a6e8-fa99-4cf1-a8f4-2ddc00600e43 tempest-GroupSnapshotsV319Test-746241117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4a80e623-6e10-4120-ae23-1373b273645e.66cdfed6-2e96-4f96-a3ff-e9a3a56e8486 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:18:16 devstack sudo[92919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4a80e623-6e10-4120-ae23-1373b273645e.66cdfed6-2e96-4f96-a3ff-e9a3a56e8486 Jul 22 03:18:16 devstack sudo[92919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:18:17 devstack sudo[92919]: pam_unix(sudo:session): session closed for user root Jul 22 03:18:17 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-cad1a6e8-fa99-4cf1-a8f4-2ddc00600e43 tempest-GroupSnapshotsV319Test-746241117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4a80e623-6e10-4120-ae23-1373b273645e.66cdfed6-2e96-4f96-a3ff-e9a3a56e8486" returned: 0 in 0.335s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:18:17 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-cad1a6e8-fa99-4cf1-a8f4-2ddc00600e43 tempest-GroupSnapshotsV319Test-746241117 None] Lock "cinder-quobyte-66cdfed6-2e96-4f96-a3ff-e9a3a56e8486" released by "_delete_snapshot" :: held 1.863s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:18:17 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-cad1a6e8-fa99-4cf1-a8f4-2ddc00600e43 tempest-GroupSnapshotsV319Test-746241117 None] Lock "cinder-quobyte-4a80e623-6e10-4120-ae23-1373b273645e" released by "delete_snapshot" :: held 1.896s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:18:17 devstack cinder-volume[87747]: WARNING cinder.quota [None req-cad1a6e8-fa99-4cf1-a8f4-2ddc00600e43 tempest-GroupSnapshotsV319Test-746241117 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1300980870 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1300980870, it is now deprecated. Please use the default quota class for default quota. Jul 22 03:18:17 devstack cinder-volume[87747]: WARNING cinder.quota [None req-cad1a6e8-fa99-4cf1-a8f4-2ddc00600e43 tempest-GroupSnapshotsV319Test-746241117 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1300980870 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1300980870, it is now deprecated. Please use the default quota class for default quota. Jul 22 03:18:17 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-cad1a6e8-fa99-4cf1-a8f4-2ddc00600e43 tempest-GroupSnapshotsV319Test-746241117 None] Created reservations ['ec2fe49a-2e72-469e-bb23-93e49e71623f', '9953e4ad-266c-46f4-93c8-681689794503', 'c1e6d43d-d71d-47ed-b983-2f3f32c5cf36', '5b4fc04f-141f-407d-8915-3a6e303789d6'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:18:17 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-cad1a6e8-fa99-4cf1-a8f4-2ddc00600e43 tempest-GroupSnapshotsV319Test-746241117 None] group_snapshot dadff30e-8180-4e11-ab9e-7cd75256a781: deleted successfully Jul 22 03:18:17 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-2ad68502-b133-405e-a73c-832c32bd4226 tempest-GroupSnapshotsV319Test-746241117 None] Acquiring lock "cinder-quobyte-4a80e623-6e10-4120-ae23-1373b273645e" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:18:17 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-2ad68502-b133-405e-a73c-832c32bd4226 tempest-GroupSnapshotsV319Test-746241117 None] Lock "cinder-quobyte-4a80e623-6e10-4120-ae23-1373b273645e" acquired by "delete_volume" :: waited 0.027s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:18:17 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2753402-cb7e-45a4-b5b2-7f7c90287620]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:18:17 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2ad68502-b133-405e-a73c-832c32bd4226 tempest-GroupSnapshotsV319Test-746241117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4a80e623-6e10-4120-ae23-1373b273645e {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:18:18 devstack sudo[92922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4a80e623-6e10-4120-ae23-1373b273645e Jul 22 03:18:18 devstack sudo[92922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:18:18 devstack sudo[92922]: pam_unix(sudo:session): session closed for user root Jul 22 03:18:18 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2ad68502-b133-405e-a73c-832c32bd4226 tempest-GroupSnapshotsV319Test-746241117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4a80e623-6e10-4120-ae23-1373b273645e" returned: 0 in 0.466s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:18:18 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2ad68502-b133-405e-a73c-832c32bd4226 tempest-GroupSnapshotsV319Test-746241117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4a80e623-6e10-4120-ae23-1373b273645e {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:18:18 devstack sudo[92927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4a80e623-6e10-4120-ae23-1373b273645e Jul 22 03:18:18 devstack sudo[92927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:18:18 devstack sudo[92927]: pam_unix(sudo:session): session closed for user root Jul 22 03:18:18 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2ad68502-b133-405e-a73c-832c32bd4226 tempest-GroupSnapshotsV319Test-746241117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4a80e623-6e10-4120-ae23-1373b273645e" returned: 0 in 0.311s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:18:18 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-2ad68502-b133-405e-a73c-832c32bd4226 tempest-GroupSnapshotsV319Test-746241117 None] Lock "cinder-quobyte-4a80e623-6e10-4120-ae23-1373b273645e" released by "delete_volume" :: held 0.884s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:18:18 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-2ad68502-b133-405e-a73c-832c32bd4226 tempest-GroupSnapshotsV319Test-746241117 None] Created reservations ['56edb270-b212-4cb9-b674-8f35f84c4c7f'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:18:18 devstack cinder-volume[87747]: WARNING cinder.quota [None req-2ad68502-b133-405e-a73c-832c32bd4226 tempest-GroupSnapshotsV319Test-746241117 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1300980870 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1300980870, it is now deprecated. Please use the default quota class for default quota. Jul 22 03:18:18 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-2ad68502-b133-405e-a73c-832c32bd4226 tempest-GroupSnapshotsV319Test-746241117 None] Created reservations ['bb48def0-cbc2-4269-9b93-b2136bf02e5e', 'a0785084-b90f-4ed8-bb3b-6d01e3417cde', 'afcd498c-56ac-4402-a8ef-1be3cd16ada4', '2b6edf8b-71cd-471f-852a-1c07520f4440'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:18:19 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-2ad68502-b133-405e-a73c-832c32bd4226 tempest-GroupSnapshotsV319Test-746241117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:18:19 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-2ad68502-b133-405e-a73c-832c32bd4226 tempest-GroupSnapshotsV319Test-746241117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:18:19 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-2ad68502-b133-405e-a73c-832c32bd4226 tempest-GroupSnapshotsV319Test-746241117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:18:19 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-2ad68502-b133-405e-a73c-832c32bd4226 tempest-GroupSnapshotsV319Test-746241117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:18:19 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-2ad68502-b133-405e-a73c-832c32bd4226 tempest-GroupSnapshotsV319Test-746241117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:18:19 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2ad68502-b133-405e-a73c-832c32bd4226 tempest-GroupSnapshotsV319Test-746241117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:18:19 devstack sudo[92930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:18:19 devstack sudo[92930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:18:19 devstack sudo[92930]: pam_unix(sudo:session): session closed for user root Jul 22 03:18:19 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2ad68502-b133-405e-a73c-832c32bd4226 tempest-GroupSnapshotsV319Test-746241117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.391s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:18:19 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-2ad68502-b133-405e-a73c-832c32bd4226 tempest-GroupSnapshotsV319Test-746241117 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:18:19 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-2ad68502-b133-405e-a73c-832c32bd4226 tempest-GroupSnapshotsV319Test-746241117 None] Delete group completed successfully. Jul 22 03:18:22 devstack cinder-volume[87747]: DEBUG oslo_service.periodic_task [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87747) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 03:18:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:18:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:18:22 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:18:22 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:18:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:18:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:18:22 devstack sudo[92933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:18:22 devstack sudo[92933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:18:22 devstack sudo[92933]: pam_unix(sudo:session): session closed for user root Jul 22 03:18:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.337s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:18:22 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:18:22 devstack cinder-volume[87747]: DEBUG oslo_service.periodic_task [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Running periodic task VolumeManager._thread_info {{(pid=87747) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 03:18:22 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] thread count: 8 {{(pid=87747) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 22 03:18:22 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] thread info: [<_MainThread(MainThread, started 132775275860096)>, , , , , , , ] {{(pid=87747) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 22 03:18:29 devstack cinder-volume[87747]: DEBUG dbcounter [-] [87747] Writing DB stats cinder:SELECT=37,cinder:UPDATE=39,cinder:INSERT=6,cinder:DELETE=1 {{(pid=87747) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 03:18:29 devstack cinder-volume[87747]: DEBUG dbcounter [-] [87747] Writing DB stats cinder:INSERT=16,cinder:UPDATE=47,cinder:SELECT=40,cinder:DELETE=3 {{(pid=87747) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 03:18:30 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-f1191d2a-9b61-4167-bf1d-58c980fc45bd tempest-GroupsTest-221042037 None] Group tempest-Group1-1829050210: creating Jul 22 03:18:30 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-f1191d2a-9b61-4167-bf1d-58c980fc45bd tempest-GroupsTest-221042037 None] Group tempest-Group1-1829050210: created successfully Jul 22 03:18:30 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-f1191d2a-9b61-4167-bf1d-58c980fc45bd tempest-GroupsTest-221042037 None] Create group completed successfully. Jul 22 03:18:32 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-f5719bcc-6c4f-4871-9717-f9e59fea851e tempest-GroupsTest-221042037 None] Group tempest-Group2-258163031: creating Jul 22 03:18:32 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-f5719bcc-6c4f-4871-9717-f9e59fea851e tempest-GroupsTest-221042037 None] Group tempest-Group2-258163031: created successfully Jul 22 03:18:32 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-f5719bcc-6c4f-4871-9717-f9e59fea851e tempest-GroupsTest-221042037 None] Create group completed successfully. Jul 22 03:18:32 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-c79414d5-e9c2-420b-90bf-47501e61bad1 tempest-GroupsV320Test-1721748167 None] Group tempest-GroupsV320Test-Group-1164499119: creating Jul 22 03:18:32 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-c79414d5-e9c2-420b-90bf-47501e61bad1 tempest-GroupsV320Test-1721748167 None] Group tempest-GroupsV320Test-Group-1164499119: created successfully Jul 22 03:18:32 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-c79414d5-e9c2-420b-90bf-47501e61bad1 tempest-GroupsV320Test-1721748167 None] Create group completed successfully. Jul 22 03:18:33 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-30c6fc9d-4165-4aa9-8135-1a899828aaf4 tempest-GroupsTest-221042037 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:18:33 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-30c6fc9d-4165-4aa9-8135-1a899828aaf4 tempest-GroupsTest-221042037 None] Flow 'volume_create_manager' (28b611ba-efb7-4106-aad7-1fe9ddda8c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:18:33 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-30c6fc9d-4165-4aa9-8135-1a899828aaf4 tempest-GroupsTest-221042037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3473293-e2e6-454b-9ce5-9e51d7bb1587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:18:33 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-30c6fc9d-4165-4aa9-8135-1a899828aaf4 tempest-GroupsTest-221042037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3473293-e2e6-454b-9ce5-9e51d7bb1587) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:18:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1380250465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=28215407-83c7-4634-8ad6-f49a92da250c,host='devstack@QuobyteHD#QuobyteHD',id=fa7aa324-6ef6-46b4-906f-985063da96e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dc1e6c9aa5948e3800b81005b10bf45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:18:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:18:34Z,use_quota=True,user_id='ec068e693b414697953e70bb0b0a9d1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9a9448b-4d16-44ee-a04a-f885f253323a),volume_type_id=a9a9448b-4d16-44ee-a04a-f885f253323a)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:18:33 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-30c6fc9d-4165-4aa9-8135-1a899828aaf4 tempest-GroupsTest-221042037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3aec8184-56fb-400a-bf17-29b9ab4c3466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:18:33 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-30c6fc9d-4165-4aa9-8135-1a899828aaf4 tempest-GroupsTest-221042037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3aec8184-56fb-400a-bf17-29b9ab4c3466) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:18:33 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-30c6fc9d-4165-4aa9-8135-1a899828aaf4 tempest-GroupsTest-221042037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf809b14-927f-458e-8251-850d64660134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:18:33 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-30c6fc9d-4165-4aa9-8135-1a899828aaf4 tempest-GroupsTest-221042037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf809b14-927f-458e-8251-850d64660134) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa7aa324-6ef6-46b4-906f-985063da96e2', 'volume_name': 'volume-fa7aa324-6ef6-46b4-906f-985063da96e2', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:18:33 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-30c6fc9d-4165-4aa9-8135-1a899828aaf4 tempest-GroupsTest-221042037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efec59f9-a0fe-4c96-96ec-196f530b262d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:18:33 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-30c6fc9d-4165-4aa9-8135-1a899828aaf4 tempest-GroupsTest-221042037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efec59f9-a0fe-4c96-96ec-196f530b262d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:18:33 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-30c6fc9d-4165-4aa9-8135-1a899828aaf4 tempest-GroupsTest-221042037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d817855-1751-4e12-8a26-779cb677143b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:18:33 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-30c6fc9d-4165-4aa9-8135-1a899828aaf4 tempest-GroupsTest-221042037 None] Volume fa7aa324-6ef6-46b4-906f-985063da96e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa7aa324-6ef6-46b4-906f-985063da96e2', 'volume_size': 1} Jul 22 03:18:33 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-30c6fc9d-4165-4aa9-8135-1a899828aaf4 tempest-GroupsTest-221042037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:18:33 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-30c6fc9d-4165-4aa9-8135-1a899828aaf4 tempest-GroupsTest-221042037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:18:33 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-30c6fc9d-4165-4aa9-8135-1a899828aaf4 tempest-GroupsTest-221042037 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=28215407-83c7-4634-8ad6-f49a92da250c,created_at=2026-07-22T01:18:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1380250465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=28215407-83c7-4634-8ad6-f49a92da250c,host='devstack@QuobyteHD#QuobyteHD',id=fa7aa324-6ef6-46b4-906f-985063da96e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dc1e6c9aa5948e3800b81005b10bf45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:18:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:18:34Z,use_quota=True,user_id='ec068e693b414697953e70bb0b0a9d1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9a9448b-4d16-44ee-a04a-f885f253323a),volume_type_id=a9a9448b-4d16-44ee-a04a-f885f253323a)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:18:33 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-30c6fc9d-4165-4aa9-8135-1a899828aaf4 tempest-GroupsTest-221042037 None] Creating volume fa7aa324-6ef6-46b4-906f-985063da96e2 {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:18:33 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-30c6fc9d-4165-4aa9-8135-1a899828aaf4 tempest-GroupsTest-221042037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:18:33 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-30c6fc9d-4165-4aa9-8135-1a899828aaf4 tempest-GroupsTest-221042037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:18:33 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-30c6fc9d-4165-4aa9-8135-1a899828aaf4 tempest-GroupsTest-221042037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:18:33 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-30c6fc9d-4165-4aa9-8135-1a899828aaf4 tempest-GroupsTest-221042037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:18:33 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-30c6fc9d-4165-4aa9-8135-1a899828aaf4 tempest-GroupsTest-221042037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:18:33 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-30c6fc9d-4165-4aa9-8135-1a899828aaf4 tempest-GroupsTest-221042037 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:18:33 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-30c6fc9d-4165-4aa9-8135-1a899828aaf4 tempest-GroupsTest-221042037 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:18:33 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-30c6fc9d-4165-4aa9-8135-1a899828aaf4 tempest-GroupsTest-221042037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-fa7aa324-6ef6-46b4-906f-985063da96e2 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:18:33 devstack sudo[92978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-fa7aa324-6ef6-46b4-906f-985063da96e2 1073741824 Jul 22 03:18:33 devstack sudo[92978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:18:34 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-4b2b5887-fc0b-43e6-9ba1-c775ca686b65 tempest-GroupsV320Test-1721748167 None] Created reservations ['b6f85a37-1c70-4b22-a95f-a9338d9bc712'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:18:34 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-4b2b5887-fc0b-43e6-9ba1-c775ca686b65 tempest-GroupsV320Test-1721748167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:18:34 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-4b2b5887-fc0b-43e6-9ba1-c775ca686b65 tempest-GroupsV320Test-1721748167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:18:34 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-4b2b5887-fc0b-43e6-9ba1-c775ca686b65 tempest-GroupsV320Test-1721748167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:18:34 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-4b2b5887-fc0b-43e6-9ba1-c775ca686b65 tempest-GroupsV320Test-1721748167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:18:34 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-4b2b5887-fc0b-43e6-9ba1-c775ca686b65 tempest-GroupsV320Test-1721748167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:18:34 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-4b2b5887-fc0b-43e6-9ba1-c775ca686b65 tempest-GroupsV320Test-1721748167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:18:34 devstack sudo[92980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:18:34 devstack sudo[92980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:18:34 devstack sudo[92980]: pam_unix(sudo:session): session closed for user root Jul 22 03:18:34 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-4b2b5887-fc0b-43e6-9ba1-c775ca686b65 tempest-GroupsV320Test-1721748167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.293s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:18:34 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-4b2b5887-fc0b-43e6-9ba1-c775ca686b65 tempest-GroupsV320Test-1721748167 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:18:34 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-4b2b5887-fc0b-43e6-9ba1-c775ca686b65 tempest-GroupsV320Test-1721748167 None] Delete group completed successfully. Jul 22 03:18:34 devstack sudo[92978]: pam_unix(sudo:session): session closed for user root Jul 22 03:18:34 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-30c6fc9d-4165-4aa9-8135-1a899828aaf4 tempest-GroupsTest-221042037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-fa7aa324-6ef6-46b4-906f-985063da96e2 1073741824" returned: 0 in 0.527s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:18:34 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-30c6fc9d-4165-4aa9-8135-1a899828aaf4 tempest-GroupsTest-221042037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-fa7aa324-6ef6-46b4-906f-985063da96e2 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:18:34 devstack sudo[92987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-fa7aa324-6ef6-46b4-906f-985063da96e2 Jul 22 03:18:34 devstack sudo[92987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:18:34 devstack sudo[92987]: pam_unix(sudo:session): session closed for user root Jul 22 03:18:34 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-30c6fc9d-4165-4aa9-8135-1a899828aaf4 tempest-GroupsTest-221042037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-fa7aa324-6ef6-46b4-906f-985063da96e2" returned: 0 in 0.370s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:18:34 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-30c6fc9d-4165-4aa9-8135-1a899828aaf4 tempest-GroupsTest-221042037 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:18:34 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-30c6fc9d-4165-4aa9-8135-1a899828aaf4 tempest-GroupsTest-221042037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:18:34 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-30c6fc9d-4165-4aa9-8135-1a899828aaf4 tempest-GroupsTest-221042037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d817855-1751-4e12-8a26-779cb677143b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa7aa324-6ef6-46b4-906f-985063da96e2', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:18:34 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-30c6fc9d-4165-4aa9-8135-1a899828aaf4 tempest-GroupsTest-221042037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c72b6d93-f71a-46e0-ad52-934b614a388d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:18:34 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-30c6fc9d-4165-4aa9-8135-1a899828aaf4 tempest-GroupsTest-221042037 None] Volume volume-fa7aa324-6ef6-46b4-906f-985063da96e2 (fa7aa324-6ef6-46b4-906f-985063da96e2): created successfully Jul 22 03:18:34 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-30c6fc9d-4165-4aa9-8135-1a899828aaf4 tempest-GroupsTest-221042037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c72b6d93-f71a-46e0-ad52-934b614a388d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:18:35 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-30c6fc9d-4165-4aa9-8135-1a899828aaf4 tempest-GroupsTest-221042037 None] Flow 'volume_create_manager' (28b611ba-efb7-4106-aad7-1fe9ddda8c75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:18:35 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-30c6fc9d-4165-4aa9-8135-1a899828aaf4 tempest-GroupsTest-221042037 None] Created volume successfully. Jul 22 03:18:37 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-93dba027-07af-48d5-b6bf-f2cb0d817281 tempest-GroupsTest-221042037 None] Acquiring lock "cinder-quobyte-fa7aa324-6ef6-46b4-906f-985063da96e2" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:18:37 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-93dba027-07af-48d5-b6bf-f2cb0d817281 tempest-GroupsTest-221042037 None] Lock "cinder-quobyte-fa7aa324-6ef6-46b4-906f-985063da96e2" acquired by "delete_volume" :: waited 0.029s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:18:37 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[23bf511f-942a-4001-913b-802962f90905]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:18:37 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-93dba027-07af-48d5-b6bf-f2cb0d817281 tempest-GroupsTest-221042037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-fa7aa324-6ef6-46b4-906f-985063da96e2 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:18:37 devstack sudo[93008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-fa7aa324-6ef6-46b4-906f-985063da96e2 Jul 22 03:18:37 devstack sudo[93008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:18:37 devstack sudo[93008]: pam_unix(sudo:session): session closed for user root Jul 22 03:18:37 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-93dba027-07af-48d5-b6bf-f2cb0d817281 tempest-GroupsTest-221042037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-fa7aa324-6ef6-46b4-906f-985063da96e2" returned: 0 in 0.518s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:18:37 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-93dba027-07af-48d5-b6bf-f2cb0d817281 tempest-GroupsTest-221042037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-fa7aa324-6ef6-46b4-906f-985063da96e2 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:18:37 devstack sudo[93013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-fa7aa324-6ef6-46b4-906f-985063da96e2 Jul 22 03:18:37 devstack sudo[93013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:18:38 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-93dba027-07af-48d5-b6bf-f2cb0d817281 tempest-GroupsTest-221042037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-fa7aa324-6ef6-46b4-906f-985063da96e2" returned: 0 in 0.410s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:18:38 devstack sudo[93013]: pam_unix(sudo:session): session closed for user root Jul 22 03:18:38 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-93dba027-07af-48d5-b6bf-f2cb0d817281 tempest-GroupsTest-221042037 None] Lock "cinder-quobyte-fa7aa324-6ef6-46b4-906f-985063da96e2" released by "delete_volume" :: held 1.023s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:18:38 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-93dba027-07af-48d5-b6bf-f2cb0d817281 tempest-GroupsTest-221042037 None] Created reservations ['4670d40b-797f-49eb-b744-f9518320d102'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:18:38 devstack cinder-volume[87747]: WARNING cinder.quota [None req-93dba027-07af-48d5-b6bf-f2cb0d817281 tempest-GroupsTest-221042037 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1747634088 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1747634088, it is now deprecated. Please use the default quota class for default quota. Jul 22 03:18:38 devstack cinder-volume[87747]: WARNING cinder.quota [None req-93dba027-07af-48d5-b6bf-f2cb0d817281 tempest-GroupsTest-221042037 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1747634088 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1747634088, it is now deprecated. Please use the default quota class for default quota. Jul 22 03:18:38 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-93dba027-07af-48d5-b6bf-f2cb0d817281 tempest-GroupsTest-221042037 None] Created reservations ['72543cf9-403c-49cc-8550-638d9ee17736', '4daeaac2-1163-4fdd-8527-bfeb890cecd0', '2497755d-2f6f-4197-bf27-a78aa999174a', '6d59cab7-2302-4996-8302-a308ba763ca1'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:18:38 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-93dba027-07af-48d5-b6bf-f2cb0d817281 tempest-GroupsTest-221042037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:18:38 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-93dba027-07af-48d5-b6bf-f2cb0d817281 tempest-GroupsTest-221042037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:18:38 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-93dba027-07af-48d5-b6bf-f2cb0d817281 tempest-GroupsTest-221042037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:18:38 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-93dba027-07af-48d5-b6bf-f2cb0d817281 tempest-GroupsTest-221042037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:18:38 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-93dba027-07af-48d5-b6bf-f2cb0d817281 tempest-GroupsTest-221042037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:18:38 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-93dba027-07af-48d5-b6bf-f2cb0d817281 tempest-GroupsTest-221042037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:18:38 devstack sudo[93056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:18:38 devstack sudo[93056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:18:39 devstack sudo[93056]: pam_unix(sudo:session): session closed for user root Jul 22 03:18:39 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-93dba027-07af-48d5-b6bf-f2cb0d817281 tempest-GroupsTest-221042037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.478s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:18:39 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-93dba027-07af-48d5-b6bf-f2cb0d817281 tempest-GroupsTest-221042037 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:18:39 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-93dba027-07af-48d5-b6bf-f2cb0d817281 tempest-GroupsTest-221042037 None] Delete group completed successfully. Jul 22 03:18:40 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-2fdaf8ee-ddf5-43af-a066-9389250736a8 tempest-GroupsTest-221042037 None] Created reservations ['4e146b36-0cac-4265-bc4c-d5a593907180'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:18:40 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbd07cc3-0b5f-4ab9-ae19-10af11c174a0 tempest-VolumesTransfersV355Test-1377510410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:18:40 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-dbd07cc3-0b5f-4ab9-ae19-10af11c174a0 tempest-VolumesTransfersV355Test-1377510410 None] Flow 'volume_create_manager' (064f35f6-2ebf-4019-81c7-be0f49f9e61a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:18:40 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-dbd07cc3-0b5f-4ab9-ae19-10af11c174a0 tempest-VolumesTransfersV355Test-1377510410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23cc903d-ac0b-4b1a-885c-b7bdafe90870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:18:40 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-dbd07cc3-0b5f-4ab9-ae19-10af11c174a0 tempest-VolumesTransfersV355Test-1377510410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23cc903d-ac0b-4b1a-885c-b7bdafe90870) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:18:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1267447210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6322929a-a6d0-4c48-93dc-34168b741588,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77caecafdd824a448b4001ebb4773700',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:18:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:18:40Z,use_quota=True,user_id='9a0c0860ae22417eb55df3e859c6613f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:18:40 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-dbd07cc3-0b5f-4ab9-ae19-10af11c174a0 tempest-VolumesTransfersV355Test-1377510410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d096d6d-dedd-4dfe-acb1-abb84cf1a79d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:18:40 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-dbd07cc3-0b5f-4ab9-ae19-10af11c174a0 tempest-VolumesTransfersV355Test-1377510410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d096d6d-dedd-4dfe-acb1-abb84cf1a79d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:18:40 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-dbd07cc3-0b5f-4ab9-ae19-10af11c174a0 tempest-VolumesTransfersV355Test-1377510410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (553f801a-309a-4a72-9f70-0ef186087f00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:18:40 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-dbd07cc3-0b5f-4ab9-ae19-10af11c174a0 tempest-VolumesTransfersV355Test-1377510410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (553f801a-309a-4a72-9f70-0ef186087f00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6322929a-a6d0-4c48-93dc-34168b741588', 'volume_name': 'volume-6322929a-a6d0-4c48-93dc-34168b741588', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:18:40 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-dbd07cc3-0b5f-4ab9-ae19-10af11c174a0 tempest-VolumesTransfersV355Test-1377510410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c79fb374-4e76-422a-b2e9-513d32e70452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:18:40 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-dbd07cc3-0b5f-4ab9-ae19-10af11c174a0 tempest-VolumesTransfersV355Test-1377510410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c79fb374-4e76-422a-b2e9-513d32e70452) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:18:40 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-dbd07cc3-0b5f-4ab9-ae19-10af11c174a0 tempest-VolumesTransfersV355Test-1377510410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (084ac77c-e064-4977-be13-9f53f4ca4fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:18:40 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-dbd07cc3-0b5f-4ab9-ae19-10af11c174a0 tempest-VolumesTransfersV355Test-1377510410 None] Volume 6322929a-a6d0-4c48-93dc-34168b741588: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6322929a-a6d0-4c48-93dc-34168b741588', 'volume_size': 1} Jul 22 03:18:40 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-dbd07cc3-0b5f-4ab9-ae19-10af11c174a0 tempest-VolumesTransfersV355Test-1377510410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:18:40 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-dbd07cc3-0b5f-4ab9-ae19-10af11c174a0 tempest-VolumesTransfersV355Test-1377510410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:18:40 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-dbd07cc3-0b5f-4ab9-ae19-10af11c174a0 tempest-VolumesTransfersV355Test-1377510410 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:18:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1267447210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6322929a-a6d0-4c48-93dc-34168b741588,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77caecafdd824a448b4001ebb4773700',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:18:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:18:40Z,use_quota=True,user_id='9a0c0860ae22417eb55df3e859c6613f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:18:40 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-dbd07cc3-0b5f-4ab9-ae19-10af11c174a0 tempest-VolumesTransfersV355Test-1377510410 None] Creating volume 6322929a-a6d0-4c48-93dc-34168b741588 {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:18:40 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-dbd07cc3-0b5f-4ab9-ae19-10af11c174a0 tempest-VolumesTransfersV355Test-1377510410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:18:40 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-dbd07cc3-0b5f-4ab9-ae19-10af11c174a0 tempest-VolumesTransfersV355Test-1377510410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:18:40 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-dbd07cc3-0b5f-4ab9-ae19-10af11c174a0 tempest-VolumesTransfersV355Test-1377510410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:18:40 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-dbd07cc3-0b5f-4ab9-ae19-10af11c174a0 tempest-VolumesTransfersV355Test-1377510410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:18:40 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-dbd07cc3-0b5f-4ab9-ae19-10af11c174a0 tempest-VolumesTransfersV355Test-1377510410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:18:40 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-dbd07cc3-0b5f-4ab9-ae19-10af11c174a0 tempest-VolumesTransfersV355Test-1377510410 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:18:40 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-dbd07cc3-0b5f-4ab9-ae19-10af11c174a0 tempest-VolumesTransfersV355Test-1377510410 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:18:40 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-dbd07cc3-0b5f-4ab9-ae19-10af11c174a0 tempest-VolumesTransfersV355Test-1377510410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-6322929a-a6d0-4c48-93dc-34168b741588 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:18:40 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-2fdaf8ee-ddf5-43af-a066-9389250736a8 tempest-GroupsTest-221042037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:18:40 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-2fdaf8ee-ddf5-43af-a066-9389250736a8 tempest-GroupsTest-221042037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:18:40 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-2fdaf8ee-ddf5-43af-a066-9389250736a8 tempest-GroupsTest-221042037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:18:40 devstack sudo[93087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-6322929a-a6d0-4c48-93dc-34168b741588 1073741824 Jul 22 03:18:40 devstack sudo[93087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:18:40 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-2fdaf8ee-ddf5-43af-a066-9389250736a8 tempest-GroupsTest-221042037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:18:40 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-2fdaf8ee-ddf5-43af-a066-9389250736a8 tempest-GroupsTest-221042037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:18:40 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2fdaf8ee-ddf5-43af-a066-9389250736a8 tempest-GroupsTest-221042037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:18:40 devstack sudo[93089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:18:40 devstack sudo[93089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:18:40 devstack sudo[93089]: pam_unix(sudo:session): session closed for user root Jul 22 03:18:40 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2fdaf8ee-ddf5-43af-a066-9389250736a8 tempest-GroupsTest-221042037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.397s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:18:40 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-2fdaf8ee-ddf5-43af-a066-9389250736a8 tempest-GroupsTest-221042037 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:18:40 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-2fdaf8ee-ddf5-43af-a066-9389250736a8 tempest-GroupsTest-221042037 None] Delete group completed successfully. Jul 22 03:18:40 devstack sudo[93087]: pam_unix(sudo:session): session closed for user root Jul 22 03:18:41 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-dbd07cc3-0b5f-4ab9-ae19-10af11c174a0 tempest-VolumesTransfersV355Test-1377510410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-6322929a-a6d0-4c48-93dc-34168b741588 1073741824" returned: 0 in 0.683s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:18:41 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-dbd07cc3-0b5f-4ab9-ae19-10af11c174a0 tempest-VolumesTransfersV355Test-1377510410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-6322929a-a6d0-4c48-93dc-34168b741588 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:18:41 devstack sudo[93096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-6322929a-a6d0-4c48-93dc-34168b741588 Jul 22 03:18:41 devstack sudo[93096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:18:41 devstack sudo[93096]: pam_unix(sudo:session): session closed for user root Jul 22 03:18:41 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-dbd07cc3-0b5f-4ab9-ae19-10af11c174a0 tempest-VolumesTransfersV355Test-1377510410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-6322929a-a6d0-4c48-93dc-34168b741588" returned: 0 in 0.375s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:18:41 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-dbd07cc3-0b5f-4ab9-ae19-10af11c174a0 tempest-VolumesTransfersV355Test-1377510410 None] <== create_volume: return (1131ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:18:41 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-dbd07cc3-0b5f-4ab9-ae19-10af11c174a0 tempest-VolumesTransfersV355Test-1377510410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.136s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:18:41 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-dbd07cc3-0b5f-4ab9-ae19-10af11c174a0 tempest-VolumesTransfersV355Test-1377510410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (084ac77c-e064-4977-be13-9f53f4ca4fda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6322929a-a6d0-4c48-93dc-34168b741588', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:18:41 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-dbd07cc3-0b5f-4ab9-ae19-10af11c174a0 tempest-VolumesTransfersV355Test-1377510410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71d1c80c-16f6-4d62-9107-0d771ee14b36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:18:41 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-dbd07cc3-0b5f-4ab9-ae19-10af11c174a0 tempest-VolumesTransfersV355Test-1377510410 None] Volume volume-6322929a-a6d0-4c48-93dc-34168b741588 (6322929a-a6d0-4c48-93dc-34168b741588): created successfully Jul 22 03:18:41 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-dbd07cc3-0b5f-4ab9-ae19-10af11c174a0 tempest-VolumesTransfersV355Test-1377510410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71d1c80c-16f6-4d62-9107-0d771ee14b36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:18:41 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-dbd07cc3-0b5f-4ab9-ae19-10af11c174a0 tempest-VolumesTransfersV355Test-1377510410 None] Flow 'volume_create_manager' (064f35f6-2ebf-4019-81c7-be0f49f9e61a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:18:41 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-dbd07cc3-0b5f-4ab9-ae19-10af11c174a0 tempest-VolumesTransfersV355Test-1377510410 None] Created volume successfully. Jul 22 03:18:41 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-503701d9-566d-49d3-ac29-61c95aa4af31 tempest-GroupsTest-221042037 None] Group tempest-GroupsTest-Group-1834779054: creating Jul 22 03:18:41 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-503701d9-566d-49d3-ac29-61c95aa4af31 tempest-GroupsTest-221042037 None] Group tempest-GroupsTest-Group-1834779054: created successfully Jul 22 03:18:41 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-503701d9-566d-49d3-ac29-61c95aa4af31 tempest-GroupsTest-221042037 None] Create group completed successfully. Jul 22 03:18:43 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-d35e2b25-bd85-461f-ae52-83d9624844dc tempest-VolumesTransfersV355Test-737762553 None] Transfer volume completed successfully. Jul 22 03:18:44 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-43fb9c87-16ad-449f-88e6-4d7b5e1bc3f4 tempest-GroupsTest-221042037 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:18:44 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-43fb9c87-16ad-449f-88e6-4d7b5e1bc3f4 tempest-GroupsTest-221042037 None] Flow 'volume_create_manager' (97e470b5-be18-4c3c-adf8-82ce41e537bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:18:44 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-43fb9c87-16ad-449f-88e6-4d7b5e1bc3f4 tempest-GroupsTest-221042037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa0cc9d6-e294-4bff-a502-bde364ff6a62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:18:44 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-43fb9c87-16ad-449f-88e6-4d7b5e1bc3f4 tempest-GroupsTest-221042037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa0cc9d6-e294-4bff-a502-bde364ff6a62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:18:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1976666873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d7d24b49-ce9e-45fb-8c8f-a92a46d80254,host='devstack@QuobyteHD#QuobyteHD',id=54d23ee3-1aa8-434f-a72e-083fad77c759,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dc1e6c9aa5948e3800b81005b10bf45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:18:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:18:44Z,use_quota=True,user_id='ec068e693b414697953e70bb0b0a9d1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ffe2f962-b34a-446c-91c8-f60d1a6ff632),volume_type_id=ffe2f962-b34a-446c-91c8-f60d1a6ff632)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:18:44 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-43fb9c87-16ad-449f-88e6-4d7b5e1bc3f4 tempest-GroupsTest-221042037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8976e194-6383-452f-af91-989054fb9fbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:18:44 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-43fb9c87-16ad-449f-88e6-4d7b5e1bc3f4 tempest-GroupsTest-221042037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8976e194-6383-452f-af91-989054fb9fbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:18:44 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-43fb9c87-16ad-449f-88e6-4d7b5e1bc3f4 tempest-GroupsTest-221042037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc75b2e0-a530-4962-bff5-2dfed28d359b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:18:44 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-43fb9c87-16ad-449f-88e6-4d7b5e1bc3f4 tempest-GroupsTest-221042037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc75b2e0-a530-4962-bff5-2dfed28d359b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54d23ee3-1aa8-434f-a72e-083fad77c759', 'volume_name': 'volume-54d23ee3-1aa8-434f-a72e-083fad77c759', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:18:44 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-43fb9c87-16ad-449f-88e6-4d7b5e1bc3f4 tempest-GroupsTest-221042037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2469b7d9-0ae5-4b61-9166-287b41eae36f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:18:44 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-43fb9c87-16ad-449f-88e6-4d7b5e1bc3f4 tempest-GroupsTest-221042037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2469b7d9-0ae5-4b61-9166-287b41eae36f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:18:44 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-43fb9c87-16ad-449f-88e6-4d7b5e1bc3f4 tempest-GroupsTest-221042037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08731d14-f968-480d-a09d-3ef448869485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:18:44 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-43fb9c87-16ad-449f-88e6-4d7b5e1bc3f4 tempest-GroupsTest-221042037 None] Volume 54d23ee3-1aa8-434f-a72e-083fad77c759: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54d23ee3-1aa8-434f-a72e-083fad77c759', 'volume_size': 1} Jul 22 03:18:44 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-43fb9c87-16ad-449f-88e6-4d7b5e1bc3f4 tempest-GroupsTest-221042037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:18:44 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-43fb9c87-16ad-449f-88e6-4d7b5e1bc3f4 tempest-GroupsTest-221042037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:18:44 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-43fb9c87-16ad-449f-88e6-4d7b5e1bc3f4 tempest-GroupsTest-221042037 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d7d24b49-ce9e-45fb-8c8f-a92a46d80254,created_at=2026-07-22T01:18:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1976666873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d7d24b49-ce9e-45fb-8c8f-a92a46d80254,host='devstack@QuobyteHD#QuobyteHD',id=54d23ee3-1aa8-434f-a72e-083fad77c759,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dc1e6c9aa5948e3800b81005b10bf45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:18:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:18:44Z,use_quota=True,user_id='ec068e693b414697953e70bb0b0a9d1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ffe2f962-b34a-446c-91c8-f60d1a6ff632),volume_type_id=ffe2f962-b34a-446c-91c8-f60d1a6ff632)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:18:44 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-43fb9c87-16ad-449f-88e6-4d7b5e1bc3f4 tempest-GroupsTest-221042037 None] Creating volume 54d23ee3-1aa8-434f-a72e-083fad77c759 {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:18:44 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-43fb9c87-16ad-449f-88e6-4d7b5e1bc3f4 tempest-GroupsTest-221042037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:18:44 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-43fb9c87-16ad-449f-88e6-4d7b5e1bc3f4 tempest-GroupsTest-221042037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:18:44 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-43fb9c87-16ad-449f-88e6-4d7b5e1bc3f4 tempest-GroupsTest-221042037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:18:44 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-43fb9c87-16ad-449f-88e6-4d7b5e1bc3f4 tempest-GroupsTest-221042037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:18:44 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-43fb9c87-16ad-449f-88e6-4d7b5e1bc3f4 tempest-GroupsTest-221042037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:18:44 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-43fb9c87-16ad-449f-88e6-4d7b5e1bc3f4 tempest-GroupsTest-221042037 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:18:44 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-43fb9c87-16ad-449f-88e6-4d7b5e1bc3f4 tempest-GroupsTest-221042037 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:18:44 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-43fb9c87-16ad-449f-88e6-4d7b5e1bc3f4 tempest-GroupsTest-221042037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-54d23ee3-1aa8-434f-a72e-083fad77c759 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:18:44 devstack sudo[93109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-54d23ee3-1aa8-434f-a72e-083fad77c759 1073741824 Jul 22 03:18:44 devstack sudo[93109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:18:44 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-b800e20c-c58e-456f-918c-1a9ccb99c879 tempest-VolumeQuotasNegativeTestJSON-408155366 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:18:44 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b800e20c-c58e-456f-918c-1a9ccb99c879 tempest-VolumeQuotasNegativeTestJSON-408155366 None] Flow 'volume_create_manager' (054c148b-4833-42b6-9ced-7539c4910245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:18:44 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b800e20c-c58e-456f-918c-1a9ccb99c879 tempest-VolumeQuotasNegativeTestJSON-408155366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfd71308-6569-4fd6-bfcf-6722934182d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:18:44 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-9bcade31-5630-4c0c-8183-53a0309913e8 tempest-VolumesTransfersV355Test-134581344 None] Acquiring lock "cinder-6322929a-a6d0-4c48-93dc-34168b741588-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:18:44 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b800e20c-c58e-456f-918c-1a9ccb99c879 tempest-VolumeQuotasNegativeTestJSON-408155366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfd71308-6569-4fd6-bfcf-6722934182d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:18:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-530983136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e37ff72-9a35-41d6-9f0e-e798032dd92d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77acdbd3c76c4e109c95e68e2629e2f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:18:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:18:44Z,use_quota=True,user_id='f6a2790beef7463982f2c6a3a7e94c28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:18:44 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b800e20c-c58e-456f-918c-1a9ccb99c879 tempest-VolumeQuotasNegativeTestJSON-408155366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83a72c03-88bb-411c-8a5e-df5427629cf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:18:44 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b800e20c-c58e-456f-918c-1a9ccb99c879 tempest-VolumeQuotasNegativeTestJSON-408155366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83a72c03-88bb-411c-8a5e-df5427629cf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:18:44 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b800e20c-c58e-456f-918c-1a9ccb99c879 tempest-VolumeQuotasNegativeTestJSON-408155366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8c76dbf-4aaf-4535-b8ab-85172d1351b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:18:44 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b800e20c-c58e-456f-918c-1a9ccb99c879 tempest-VolumeQuotasNegativeTestJSON-408155366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8c76dbf-4aaf-4535-b8ab-85172d1351b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e37ff72-9a35-41d6-9f0e-e798032dd92d', 'volume_name': 'volume-9e37ff72-9a35-41d6-9f0e-e798032dd92d', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:18:44 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b800e20c-c58e-456f-918c-1a9ccb99c879 tempest-VolumeQuotasNegativeTestJSON-408155366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01b5a06d-19b3-46c6-ba8f-243a36d6d2de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:18:44 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b800e20c-c58e-456f-918c-1a9ccb99c879 tempest-VolumeQuotasNegativeTestJSON-408155366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01b5a06d-19b3-46c6-ba8f-243a36d6d2de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:18:44 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b800e20c-c58e-456f-918c-1a9ccb99c879 tempest-VolumeQuotasNegativeTestJSON-408155366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9b49fdf-e26c-4b01-b970-6f76babf648f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:18:44 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-b800e20c-c58e-456f-918c-1a9ccb99c879 tempest-VolumeQuotasNegativeTestJSON-408155366 None] Volume 9e37ff72-9a35-41d6-9f0e-e798032dd92d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e37ff72-9a35-41d6-9f0e-e798032dd92d', 'volume_size': 1} Jul 22 03:18:44 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b800e20c-c58e-456f-918c-1a9ccb99c879 tempest-VolumeQuotasNegativeTestJSON-408155366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:18:44 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-9bcade31-5630-4c0c-8183-53a0309913e8 tempest-VolumesTransfersV355Test-134581344 None] Lock "cinder-6322929a-a6d0-4c48-93dc-34168b741588-delete_volume" acquired by "delete_volume" :: waited 0.126s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:18:44 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-9bcade31-5630-4c0c-8183-53a0309913e8 tempest-VolumesTransfersV355Test-134581344 None] Acquiring lock "cinder-quobyte-6322929a-a6d0-4c48-93dc-34168b741588" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:18:44 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-9bcade31-5630-4c0c-8183-53a0309913e8 tempest-VolumesTransfersV355Test-134581344 None] Lock "cinder-quobyte-6322929a-a6d0-4c48-93dc-34168b741588" acquired by "delete_volume" :: waited 0.025s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:18:44 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[004f3009-9566-4547-8192-8b9aaa56ac0e]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:18:44 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-9bcade31-5630-4c0c-8183-53a0309913e8 tempest-VolumesTransfersV355Test-134581344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-6322929a-a6d0-4c48-93dc-34168b741588 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:18:44 devstack sudo[93114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-6322929a-a6d0-4c48-93dc-34168b741588 Jul 22 03:18:44 devstack sudo[93114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:18:44 devstack sudo[93109]: pam_unix(sudo:session): session closed for user root Jul 22 03:18:44 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-43fb9c87-16ad-449f-88e6-4d7b5e1bc3f4 tempest-GroupsTest-221042037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-54d23ee3-1aa8-434f-a72e-083fad77c759 1073741824" returned: 0 in 0.593s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:18:44 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-43fb9c87-16ad-449f-88e6-4d7b5e1bc3f4 tempest-GroupsTest-221042037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-54d23ee3-1aa8-434f-a72e-083fad77c759 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:18:44 devstack sudo[93117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-54d23ee3-1aa8-434f-a72e-083fad77c759 Jul 22 03:18:44 devstack sudo[93117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:18:45 devstack sudo[93114]: pam_unix(sudo:session): session closed for user root Jul 22 03:18:45 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-9bcade31-5630-4c0c-8183-53a0309913e8 tempest-VolumesTransfersV355Test-134581344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-6322929a-a6d0-4c48-93dc-34168b741588" returned: 0 in 0.384s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:18:45 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-9bcade31-5630-4c0c-8183-53a0309913e8 tempest-VolumesTransfersV355Test-134581344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-6322929a-a6d0-4c48-93dc-34168b741588 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:18:45 devstack sudo[93122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-6322929a-a6d0-4c48-93dc-34168b741588 Jul 22 03:18:45 devstack sudo[93122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:18:45 devstack sudo[93117]: pam_unix(sudo:session): session closed for user root Jul 22 03:18:45 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-43fb9c87-16ad-449f-88e6-4d7b5e1bc3f4 tempest-GroupsTest-221042037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-54d23ee3-1aa8-434f-a72e-083fad77c759" returned: 0 in 0.273s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:18:45 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-43fb9c87-16ad-449f-88e6-4d7b5e1bc3f4 tempest-GroupsTest-221042037 None] <== create_volume: return (917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:18:45 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-43fb9c87-16ad-449f-88e6-4d7b5e1bc3f4 tempest-GroupsTest-221042037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:18:45 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b800e20c-c58e-456f-918c-1a9ccb99c879 tempest-VolumeQuotasNegativeTestJSON-408155366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.603s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:18:45 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-b800e20c-c58e-456f-918c-1a9ccb99c879 tempest-VolumeQuotasNegativeTestJSON-408155366 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:18:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-530983136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e37ff72-9a35-41d6-9f0e-e798032dd92d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77acdbd3c76c4e109c95e68e2629e2f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:18:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:18:44Z,use_quota=True,user_id='f6a2790beef7463982f2c6a3a7e94c28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:18:45 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-b800e20c-c58e-456f-918c-1a9ccb99c879 tempest-VolumeQuotasNegativeTestJSON-408155366 None] Creating volume 9e37ff72-9a35-41d6-9f0e-e798032dd92d {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:18:45 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b800e20c-c58e-456f-918c-1a9ccb99c879 tempest-VolumeQuotasNegativeTestJSON-408155366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:18:45 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b800e20c-c58e-456f-918c-1a9ccb99c879 tempest-VolumeQuotasNegativeTestJSON-408155366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:18:45 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-b800e20c-c58e-456f-918c-1a9ccb99c879 tempest-VolumeQuotasNegativeTestJSON-408155366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:18:45 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-b800e20c-c58e-456f-918c-1a9ccb99c879 tempest-VolumeQuotasNegativeTestJSON-408155366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:18:45 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b800e20c-c58e-456f-918c-1a9ccb99c879 tempest-VolumeQuotasNegativeTestJSON-408155366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:18:45 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-b800e20c-c58e-456f-918c-1a9ccb99c879 tempest-VolumeQuotasNegativeTestJSON-408155366 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:18:45 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-b800e20c-c58e-456f-918c-1a9ccb99c879 tempest-VolumeQuotasNegativeTestJSON-408155366 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:18:45 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b800e20c-c58e-456f-918c-1a9ccb99c879 tempest-VolumeQuotasNegativeTestJSON-408155366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9e37ff72-9a35-41d6-9f0e-e798032dd92d 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:18:45 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-43fb9c87-16ad-449f-88e6-4d7b5e1bc3f4 tempest-GroupsTest-221042037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08731d14-f968-480d-a09d-3ef448869485) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54d23ee3-1aa8-434f-a72e-083fad77c759', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:18:45 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-43fb9c87-16ad-449f-88e6-4d7b5e1bc3f4 tempest-GroupsTest-221042037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (392a05a2-939a-42ed-ac04-45f1f0c63ff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:18:45 devstack sudo[93125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9e37ff72-9a35-41d6-9f0e-e798032dd92d 1073741824 Jul 22 03:18:45 devstack sudo[93125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:18:45 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-43fb9c87-16ad-449f-88e6-4d7b5e1bc3f4 tempest-GroupsTest-221042037 None] Volume volume-54d23ee3-1aa8-434f-a72e-083fad77c759 (54d23ee3-1aa8-434f-a72e-083fad77c759): created successfully Jul 22 03:18:45 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-43fb9c87-16ad-449f-88e6-4d7b5e1bc3f4 tempest-GroupsTest-221042037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (392a05a2-939a-42ed-ac04-45f1f0c63ff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:18:45 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-43fb9c87-16ad-449f-88e6-4d7b5e1bc3f4 tempest-GroupsTest-221042037 None] Flow 'volume_create_manager' (97e470b5-be18-4c3c-adf8-82ce41e537bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:18:45 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-43fb9c87-16ad-449f-88e6-4d7b5e1bc3f4 tempest-GroupsTest-221042037 None] Created volume successfully. Jul 22 03:18:45 devstack sudo[93122]: pam_unix(sudo:session): session closed for user root Jul 22 03:18:45 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-9bcade31-5630-4c0c-8183-53a0309913e8 tempest-VolumesTransfersV355Test-134581344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-6322929a-a6d0-4c48-93dc-34168b741588" returned: 0 in 0.291s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:18:45 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-9bcade31-5630-4c0c-8183-53a0309913e8 tempest-VolumesTransfersV355Test-134581344 None] Lock "cinder-quobyte-6322929a-a6d0-4c48-93dc-34168b741588" released by "delete_volume" :: held 0.722s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:18:45 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-9bcade31-5630-4c0c-8183-53a0309913e8 tempest-VolumesTransfersV355Test-134581344 None] Created reservations ['37a1b6c6-1777-43bf-8533-6460fa82b457', '49932459-0b25-4edb-96ad-a5cedcd4b0bd', '837b673d-61e6-45ee-9511-478e458da676', '09b24492-450c-4a3e-a52a-47c7afc33d36'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:18:45 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-9bcade31-5630-4c0c-8183-53a0309913e8 tempest-VolumesTransfersV355Test-134581344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:18:45 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-9bcade31-5630-4c0c-8183-53a0309913e8 tempest-VolumesTransfersV355Test-134581344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:18:45 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-9bcade31-5630-4c0c-8183-53a0309913e8 tempest-VolumesTransfersV355Test-134581344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:18:45 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-9bcade31-5630-4c0c-8183-53a0309913e8 tempest-VolumesTransfersV355Test-134581344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:18:45 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-9bcade31-5630-4c0c-8183-53a0309913e8 tempest-VolumesTransfersV355Test-134581344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:18:45 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-9bcade31-5630-4c0c-8183-53a0309913e8 tempest-VolumesTransfersV355Test-134581344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:18:45 devstack sudo[93131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:18:45 devstack sudo[93131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:18:45 devstack sudo[93125]: pam_unix(sudo:session): session closed for user root Jul 22 03:18:45 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b800e20c-c58e-456f-918c-1a9ccb99c879 tempest-VolumeQuotasNegativeTestJSON-408155366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9e37ff72-9a35-41d6-9f0e-e798032dd92d 1073741824" returned: 0 in 0.556s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:18:45 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b800e20c-c58e-456f-918c-1a9ccb99c879 tempest-VolumeQuotasNegativeTestJSON-408155366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9e37ff72-9a35-41d6-9f0e-e798032dd92d {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:18:45 devstack sudo[93134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9e37ff72-9a35-41d6-9f0e-e798032dd92d Jul 22 03:18:45 devstack sudo[93134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:18:45 devstack sudo[93131]: pam_unix(sudo:session): session closed for user root Jul 22 03:18:45 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-9bcade31-5630-4c0c-8183-53a0309913e8 tempest-VolumesTransfersV355Test-134581344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.375s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:18:45 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-9bcade31-5630-4c0c-8183-53a0309913e8 tempest-VolumesTransfersV355Test-134581344 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:18:45 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-9bcade31-5630-4c0c-8183-53a0309913e8 tempest-VolumesTransfersV355Test-134581344 None] Deleted volume successfully. Jul 22 03:18:46 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-9bcade31-5630-4c0c-8183-53a0309913e8 tempest-VolumesTransfersV355Test-134581344 None] Lock "cinder-6322929a-a6d0-4c48-93dc-34168b741588-delete_volume" released by "delete_volume" :: held 1.424s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:18:46 devstack sudo[93134]: pam_unix(sudo:session): session closed for user root Jul 22 03:18:46 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b800e20c-c58e-456f-918c-1a9ccb99c879 tempest-VolumeQuotasNegativeTestJSON-408155366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9e37ff72-9a35-41d6-9f0e-e798032dd92d" returned: 0 in 0.402s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:18:46 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-b800e20c-c58e-456f-918c-1a9ccb99c879 tempest-VolumeQuotasNegativeTestJSON-408155366 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:18:46 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b800e20c-c58e-456f-918c-1a9ccb99c879 tempest-VolumeQuotasNegativeTestJSON-408155366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.035s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:18:46 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b800e20c-c58e-456f-918c-1a9ccb99c879 tempest-VolumeQuotasNegativeTestJSON-408155366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9b49fdf-e26c-4b01-b970-6f76babf648f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e37ff72-9a35-41d6-9f0e-e798032dd92d', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:18:46 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b800e20c-c58e-456f-918c-1a9ccb99c879 tempest-VolumeQuotasNegativeTestJSON-408155366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00018515-cb0a-4165-a263-203e49f3bcac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:18:46 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-b800e20c-c58e-456f-918c-1a9ccb99c879 tempest-VolumeQuotasNegativeTestJSON-408155366 None] Volume volume-9e37ff72-9a35-41d6-9f0e-e798032dd92d (9e37ff72-9a35-41d6-9f0e-e798032dd92d): created successfully Jul 22 03:18:46 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b800e20c-c58e-456f-918c-1a9ccb99c879 tempest-VolumeQuotasNegativeTestJSON-408155366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00018515-cb0a-4165-a263-203e49f3bcac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:18:46 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b800e20c-c58e-456f-918c-1a9ccb99c879 tempest-VolumeQuotasNegativeTestJSON-408155366 None] Flow 'volume_create_manager' (054c148b-4833-42b6-9ced-7539c4910245) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:18:46 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-b800e20c-c58e-456f-918c-1a9ccb99c879 tempest-VolumeQuotasNegativeTestJSON-408155366 None] Created volume successfully. Jul 22 03:18:46 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a862ef4-1cf9-4749-a5d6-80fa799f89ef tempest-GroupsTest-221042037 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:18:46 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-0a862ef4-1cf9-4749-a5d6-80fa799f89ef tempest-GroupsTest-221042037 None] Flow 'volume_create_manager' (0cd3f6a0-5537-4f03-99d1-6a5a566fc330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:18:46 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-0a862ef4-1cf9-4749-a5d6-80fa799f89ef tempest-GroupsTest-221042037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1eca3156-991e-4042-ace6-b20b9c3197a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:18:46 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-0a862ef4-1cf9-4749-a5d6-80fa799f89ef tempest-GroupsTest-221042037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1eca3156-991e-4042-ace6-b20b9c3197a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:18:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-965532002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d7d24b49-ce9e-45fb-8c8f-a92a46d80254,host='devstack@QuobyteHD#QuobyteHD',id=6d8e42d8-3fa4-48a0-8242-a1df153d7142,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dc1e6c9aa5948e3800b81005b10bf45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:18:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:18:46Z,use_quota=True,user_id='ec068e693b414697953e70bb0b0a9d1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ffe2f962-b34a-446c-91c8-f60d1a6ff632),volume_type_id=ffe2f962-b34a-446c-91c8-f60d1a6ff632)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:18:46 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-0a862ef4-1cf9-4749-a5d6-80fa799f89ef tempest-GroupsTest-221042037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd504299-53f3-4679-8329-fa014c9f474d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:18:46 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-0a862ef4-1cf9-4749-a5d6-80fa799f89ef tempest-GroupsTest-221042037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd504299-53f3-4679-8329-fa014c9f474d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:18:46 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-0a862ef4-1cf9-4749-a5d6-80fa799f89ef tempest-GroupsTest-221042037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15dd8ab4-1ea8-40f4-afcd-a60476c67289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:18:46 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-0a862ef4-1cf9-4749-a5d6-80fa799f89ef tempest-GroupsTest-221042037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15dd8ab4-1ea8-40f4-afcd-a60476c67289) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d8e42d8-3fa4-48a0-8242-a1df153d7142', 'volume_name': 'volume-6d8e42d8-3fa4-48a0-8242-a1df153d7142', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:18:46 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-0a862ef4-1cf9-4749-a5d6-80fa799f89ef tempest-GroupsTest-221042037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05024d97-0ea3-4ad1-b325-035afd1ba061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:18:46 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-0a862ef4-1cf9-4749-a5d6-80fa799f89ef tempest-GroupsTest-221042037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05024d97-0ea3-4ad1-b325-035afd1ba061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:18:46 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-0a862ef4-1cf9-4749-a5d6-80fa799f89ef tempest-GroupsTest-221042037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a70cbc5c-655a-4989-bc7b-da1b85c3f5d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:18:46 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-0a862ef4-1cf9-4749-a5d6-80fa799f89ef tempest-GroupsTest-221042037 None] Volume 6d8e42d8-3fa4-48a0-8242-a1df153d7142: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d8e42d8-3fa4-48a0-8242-a1df153d7142', 'volume_size': 1} Jul 22 03:18:46 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-0a862ef4-1cf9-4749-a5d6-80fa799f89ef tempest-GroupsTest-221042037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:18:46 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-0a862ef4-1cf9-4749-a5d6-80fa799f89ef tempest-GroupsTest-221042037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:18:46 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-0a862ef4-1cf9-4749-a5d6-80fa799f89ef tempest-GroupsTest-221042037 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d7d24b49-ce9e-45fb-8c8f-a92a46d80254,created_at=2026-07-22T01:18:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-965532002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d7d24b49-ce9e-45fb-8c8f-a92a46d80254,host='devstack@QuobyteHD#QuobyteHD',id=6d8e42d8-3fa4-48a0-8242-a1df153d7142,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dc1e6c9aa5948e3800b81005b10bf45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:18:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:18:46Z,use_quota=True,user_id='ec068e693b414697953e70bb0b0a9d1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ffe2f962-b34a-446c-91c8-f60d1a6ff632),volume_type_id=ffe2f962-b34a-446c-91c8-f60d1a6ff632)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:18:46 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-0a862ef4-1cf9-4749-a5d6-80fa799f89ef tempest-GroupsTest-221042037 None] Creating volume 6d8e42d8-3fa4-48a0-8242-a1df153d7142 {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:18:46 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-0a862ef4-1cf9-4749-a5d6-80fa799f89ef tempest-GroupsTest-221042037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:18:46 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-0a862ef4-1cf9-4749-a5d6-80fa799f89ef tempest-GroupsTest-221042037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:18:46 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-0a862ef4-1cf9-4749-a5d6-80fa799f89ef tempest-GroupsTest-221042037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:18:46 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-0a862ef4-1cf9-4749-a5d6-80fa799f89ef tempest-GroupsTest-221042037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:18:46 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-0a862ef4-1cf9-4749-a5d6-80fa799f89ef tempest-GroupsTest-221042037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:18:46 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-0a862ef4-1cf9-4749-a5d6-80fa799f89ef tempest-GroupsTest-221042037 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:18:46 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-0a862ef4-1cf9-4749-a5d6-80fa799f89ef tempest-GroupsTest-221042037 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:18:46 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-0a862ef4-1cf9-4749-a5d6-80fa799f89ef tempest-GroupsTest-221042037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-6d8e42d8-3fa4-48a0-8242-a1df153d7142 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:18:46 devstack sudo[93138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-6d8e42d8-3fa4-48a0-8242-a1df153d7142 1073741824 Jul 22 03:18:46 devstack sudo[93138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:18:46 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f1ac441-c386-4ed4-9a82-be976171fece tempest-VolumesTransfersV355Test-1377510410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:18:46 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2f1ac441-c386-4ed4-9a82-be976171fece tempest-VolumesTransfersV355Test-1377510410 None] Flow 'volume_create_manager' (97defe2a-ad41-4012-b164-d9e11fadd323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:18:46 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2f1ac441-c386-4ed4-9a82-be976171fece tempest-VolumesTransfersV355Test-1377510410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52992649-5d01-4c41-8a5d-cb8f72541019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:18:46 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2f1ac441-c386-4ed4-9a82-be976171fece tempest-VolumesTransfersV355Test-1377510410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52992649-5d01-4c41-8a5d-cb8f72541019) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:18:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1013317524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5756dd8b-fba3-4115-a25c-37aa517a266d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77caecafdd824a448b4001ebb4773700',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:18:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:18:47Z,use_quota=True,user_id='9a0c0860ae22417eb55df3e859c6613f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:18:46 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2f1ac441-c386-4ed4-9a82-be976171fece tempest-VolumesTransfersV355Test-1377510410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bf77fd5-e858-48ca-8e59-569c4f30e12e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:18:46 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2f1ac441-c386-4ed4-9a82-be976171fece tempest-VolumesTransfersV355Test-1377510410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bf77fd5-e858-48ca-8e59-569c4f30e12e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:18:46 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2f1ac441-c386-4ed4-9a82-be976171fece tempest-VolumesTransfersV355Test-1377510410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bf909ec-0540-4875-bd6c-2277ec75e635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:18:46 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2f1ac441-c386-4ed4-9a82-be976171fece tempest-VolumesTransfersV355Test-1377510410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bf909ec-0540-4875-bd6c-2277ec75e635) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5756dd8b-fba3-4115-a25c-37aa517a266d', 'volume_name': 'volume-5756dd8b-fba3-4115-a25c-37aa517a266d', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:18:46 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2f1ac441-c386-4ed4-9a82-be976171fece tempest-VolumesTransfersV355Test-1377510410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6197c82a-9959-4654-909b-ae2bc63465fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:18:46 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2f1ac441-c386-4ed4-9a82-be976171fece tempest-VolumesTransfersV355Test-1377510410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6197c82a-9959-4654-909b-ae2bc63465fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:18:46 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2f1ac441-c386-4ed4-9a82-be976171fece tempest-VolumesTransfersV355Test-1377510410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7fd40ea-6222-451c-bd1a-d7b7b98ff3b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:18:46 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-2f1ac441-c386-4ed4-9a82-be976171fece tempest-VolumesTransfersV355Test-1377510410 None] Volume 5756dd8b-fba3-4115-a25c-37aa517a266d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5756dd8b-fba3-4115-a25c-37aa517a266d', 'volume_size': 1} Jul 22 03:18:46 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-2f1ac441-c386-4ed4-9a82-be976171fece tempest-VolumesTransfersV355Test-1377510410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:18:47 devstack sudo[93138]: pam_unix(sudo:session): session closed for user root Jul 22 03:18:47 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-0a862ef4-1cf9-4749-a5d6-80fa799f89ef tempest-GroupsTest-221042037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-6d8e42d8-3fa4-48a0-8242-a1df153d7142 1073741824" returned: 0 in 0.459s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:18:47 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-0a862ef4-1cf9-4749-a5d6-80fa799f89ef tempest-GroupsTest-221042037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-6d8e42d8-3fa4-48a0-8242-a1df153d7142 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:18:47 devstack sudo[93143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-6d8e42d8-3fa4-48a0-8242-a1df153d7142 Jul 22 03:18:47 devstack sudo[93143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:18:47 devstack sudo[93143]: pam_unix(sudo:session): session closed for user root Jul 22 03:18:47 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-0a862ef4-1cf9-4749-a5d6-80fa799f89ef tempest-GroupsTest-221042037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-6d8e42d8-3fa4-48a0-8242-a1df153d7142" returned: 0 in 0.254s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:18:47 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-0a862ef4-1cf9-4749-a5d6-80fa799f89ef tempest-GroupsTest-221042037 None] <== create_volume: return (765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:18:47 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-0a862ef4-1cf9-4749-a5d6-80fa799f89ef tempest-GroupsTest-221042037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:18:47 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-2f1ac441-c386-4ed4-9a82-be976171fece tempest-VolumesTransfersV355Test-1377510410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.553s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:18:47 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-2f1ac441-c386-4ed4-9a82-be976171fece tempest-VolumesTransfersV355Test-1377510410 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:18:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1013317524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5756dd8b-fba3-4115-a25c-37aa517a266d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77caecafdd824a448b4001ebb4773700',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:18:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:18:47Z,use_quota=True,user_id='9a0c0860ae22417eb55df3e859c6613f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:18:47 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-2f1ac441-c386-4ed4-9a82-be976171fece tempest-VolumesTransfersV355Test-1377510410 None] Creating volume 5756dd8b-fba3-4115-a25c-37aa517a266d {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:18:47 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-2f1ac441-c386-4ed4-9a82-be976171fece tempest-VolumesTransfersV355Test-1377510410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:18:47 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-2f1ac441-c386-4ed4-9a82-be976171fece tempest-VolumesTransfersV355Test-1377510410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:18:47 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-2f1ac441-c386-4ed4-9a82-be976171fece tempest-VolumesTransfersV355Test-1377510410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:18:47 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-2f1ac441-c386-4ed4-9a82-be976171fece tempest-VolumesTransfersV355Test-1377510410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:18:47 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-2f1ac441-c386-4ed4-9a82-be976171fece tempest-VolumesTransfersV355Test-1377510410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:18:47 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-2f1ac441-c386-4ed4-9a82-be976171fece tempest-VolumesTransfersV355Test-1377510410 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:18:47 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-2f1ac441-c386-4ed4-9a82-be976171fece tempest-VolumesTransfersV355Test-1377510410 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:18:47 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2f1ac441-c386-4ed4-9a82-be976171fece tempest-VolumesTransfersV355Test-1377510410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-5756dd8b-fba3-4115-a25c-37aa517a266d 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:18:47 devstack sudo[93146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-5756dd8b-fba3-4115-a25c-37aa517a266d 1073741824 Jul 22 03:18:47 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-0a862ef4-1cf9-4749-a5d6-80fa799f89ef tempest-GroupsTest-221042037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a70cbc5c-655a-4989-bc7b-da1b85c3f5d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d8e42d8-3fa4-48a0-8242-a1df153d7142', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:18:47 devstack sudo[93146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:18:47 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-0a862ef4-1cf9-4749-a5d6-80fa799f89ef tempest-GroupsTest-221042037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2cc0733-afe3-4b50-adc5-d0b335584d6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:18:47 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-0a862ef4-1cf9-4749-a5d6-80fa799f89ef tempest-GroupsTest-221042037 None] Volume volume-6d8e42d8-3fa4-48a0-8242-a1df153d7142 (6d8e42d8-3fa4-48a0-8242-a1df153d7142): created successfully Jul 22 03:18:47 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-0a862ef4-1cf9-4749-a5d6-80fa799f89ef tempest-GroupsTest-221042037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2cc0733-afe3-4b50-adc5-d0b335584d6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:18:47 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-0a862ef4-1cf9-4749-a5d6-80fa799f89ef tempest-GroupsTest-221042037 None] Flow 'volume_create_manager' (0cd3f6a0-5537-4f03-99d1-6a5a566fc330) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:18:47 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-0a862ef4-1cf9-4749-a5d6-80fa799f89ef tempest-GroupsTest-221042037 None] Created volume successfully. Jul 22 03:18:47 devstack sudo[93146]: pam_unix(sudo:session): session closed for user root Jul 22 03:18:47 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2f1ac441-c386-4ed4-9a82-be976171fece tempest-VolumesTransfersV355Test-1377510410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-5756dd8b-fba3-4115-a25c-37aa517a266d 1073741824" returned: 0 in 0.541s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:18:47 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2f1ac441-c386-4ed4-9a82-be976171fece tempest-VolumesTransfersV355Test-1377510410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-5756dd8b-fba3-4115-a25c-37aa517a266d {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:18:47 devstack sudo[93152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-5756dd8b-fba3-4115-a25c-37aa517a266d Jul 22 03:18:47 devstack sudo[93152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:18:48 devstack sudo[93152]: pam_unix(sudo:session): session closed for user root Jul 22 03:18:48 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2f1ac441-c386-4ed4-9a82-be976171fece tempest-VolumesTransfersV355Test-1377510410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-5756dd8b-fba3-4115-a25c-37aa517a266d" returned: 0 in 0.246s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:18:48 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-2f1ac441-c386-4ed4-9a82-be976171fece tempest-VolumesTransfersV355Test-1377510410 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:18:48 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-2f1ac441-c386-4ed4-9a82-be976171fece tempest-VolumesTransfersV355Test-1377510410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.833s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:18:48 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2f1ac441-c386-4ed4-9a82-be976171fece tempest-VolumesTransfersV355Test-1377510410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7fd40ea-6222-451c-bd1a-d7b7b98ff3b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5756dd8b-fba3-4115-a25c-37aa517a266d', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:18:48 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2f1ac441-c386-4ed4-9a82-be976171fece tempest-VolumesTransfersV355Test-1377510410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b1a74b2-7af0-491b-92e2-afe4f1149ce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:18:48 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-2f1ac441-c386-4ed4-9a82-be976171fece tempest-VolumesTransfersV355Test-1377510410 None] Volume volume-5756dd8b-fba3-4115-a25c-37aa517a266d (5756dd8b-fba3-4115-a25c-37aa517a266d): created successfully Jul 22 03:18:48 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2f1ac441-c386-4ed4-9a82-be976171fece tempest-VolumesTransfersV355Test-1377510410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b1a74b2-7af0-491b-92e2-afe4f1149ce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:18:48 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2f1ac441-c386-4ed4-9a82-be976171fece tempest-VolumesTransfersV355Test-1377510410 None] Flow 'volume_create_manager' (97defe2a-ad41-4012-b164-d9e11fadd323) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:18:48 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-2f1ac441-c386-4ed4-9a82-be976171fece tempest-VolumesTransfersV355Test-1377510410 None] Created volume successfully. Jul 22 03:18:48 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-d705dde4-29f4-4538-91b2-17413d329024 tempest-VolumeQuotasNegativeTestJSON-408155366 None] Acquiring lock "cinder-9e37ff72-9a35-41d6-9f0e-e798032dd92d-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:18:48 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-d705dde4-29f4-4538-91b2-17413d329024 tempest-VolumeQuotasNegativeTestJSON-408155366 None] Lock "cinder-9e37ff72-9a35-41d6-9f0e-e798032dd92d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:18:48 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-d705dde4-29f4-4538-91b2-17413d329024 tempest-VolumeQuotasNegativeTestJSON-408155366 None] Acquiring lock "cinder-quobyte-9e37ff72-9a35-41d6-9f0e-e798032dd92d" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:18:48 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-d705dde4-29f4-4538-91b2-17413d329024 tempest-VolumeQuotasNegativeTestJSON-408155366 None] Lock "cinder-quobyte-9e37ff72-9a35-41d6-9f0e-e798032dd92d" acquired by "delete_volume" :: waited 0.018s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:18:48 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[b74df9c0-b6cf-4d5c-8f17-0281084c8453]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:18:48 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d705dde4-29f4-4538-91b2-17413d329024 tempest-VolumeQuotasNegativeTestJSON-408155366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9e37ff72-9a35-41d6-9f0e-e798032dd92d {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:18:48 devstack sudo[93155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9e37ff72-9a35-41d6-9f0e-e798032dd92d Jul 22 03:18:48 devstack sudo[93155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:18:48 devstack sudo[93155]: pam_unix(sudo:session): session closed for user root Jul 22 03:18:48 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d705dde4-29f4-4538-91b2-17413d329024 tempest-VolumeQuotasNegativeTestJSON-408155366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9e37ff72-9a35-41d6-9f0e-e798032dd92d" returned: 0 in 0.405s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:18:48 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d705dde4-29f4-4538-91b2-17413d329024 tempest-VolumeQuotasNegativeTestJSON-408155366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9e37ff72-9a35-41d6-9f0e-e798032dd92d {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:18:48 devstack sudo[93160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9e37ff72-9a35-41d6-9f0e-e798032dd92d Jul 22 03:18:48 devstack sudo[93160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:18:48 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-5c7ab572-dcb0-4dff-b720-4b7fa88c2331 tempest-GroupsTest-221042037 None] Update group completed successfully. Jul 22 03:18:49 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-5823901a-64f3-4fa8-88a4-b013f5aa4611 tempest-VolumesTransfersV355Test-134581344 None] Acquiring lock "cinder-5756dd8b-fba3-4115-a25c-37aa517a266d-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:18:49 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-5823901a-64f3-4fa8-88a4-b013f5aa4611 tempest-VolumesTransfersV355Test-134581344 None] Lock "cinder-5756dd8b-fba3-4115-a25c-37aa517a266d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:18:49 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-5823901a-64f3-4fa8-88a4-b013f5aa4611 tempest-VolumesTransfersV355Test-134581344 None] Acquiring lock "cinder-quobyte-5756dd8b-fba3-4115-a25c-37aa517a266d" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:18:49 devstack sudo[93160]: pam_unix(sudo:session): session closed for user root Jul 22 03:18:49 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d705dde4-29f4-4538-91b2-17413d329024 tempest-VolumeQuotasNegativeTestJSON-408155366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9e37ff72-9a35-41d6-9f0e-e798032dd92d" returned: 0 in 0.351s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:18:49 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-5823901a-64f3-4fa8-88a4-b013f5aa4611 tempest-VolumesTransfersV355Test-134581344 None] Lock "cinder-quobyte-5756dd8b-fba3-4115-a25c-37aa517a266d" acquired by "delete_volume" :: waited 0.021s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:18:49 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-d705dde4-29f4-4538-91b2-17413d329024 tempest-VolumeQuotasNegativeTestJSON-408155366 None] Lock "cinder-quobyte-9e37ff72-9a35-41d6-9f0e-e798032dd92d" released by "delete_volume" :: held 0.802s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:18:49 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfde2060-f4fe-4fc6-9a22-c42a7ff3aaf9]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:18:49 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5823901a-64f3-4fa8-88a4-b013f5aa4611 tempest-VolumesTransfersV355Test-134581344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-5756dd8b-fba3-4115-a25c-37aa517a266d {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:18:49 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-d705dde4-29f4-4538-91b2-17413d329024 tempest-VolumeQuotasNegativeTestJSON-408155366 None] Created reservations ['b1cf5941-903c-4b3c-b196-e59643d79167', 'e0eb3dbe-7df2-48b5-a62b-f19d238b3751', 'e79b3f05-5251-4f40-8dfc-756ed86ad199', '5d3a9d27-b02e-42d3-9c72-3df3e81f8dc6'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:18:49 devstack sudo[93163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-5756dd8b-fba3-4115-a25c-37aa517a266d Jul 22 03:18:49 devstack sudo[93163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:18:49 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-d705dde4-29f4-4538-91b2-17413d329024 tempest-VolumeQuotasNegativeTestJSON-408155366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:18:49 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-d705dde4-29f4-4538-91b2-17413d329024 tempest-VolumeQuotasNegativeTestJSON-408155366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:18:49 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-d705dde4-29f4-4538-91b2-17413d329024 tempest-VolumeQuotasNegativeTestJSON-408155366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:18:49 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-d705dde4-29f4-4538-91b2-17413d329024 tempest-VolumeQuotasNegativeTestJSON-408155366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:18:49 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-d705dde4-29f4-4538-91b2-17413d329024 tempest-VolumeQuotasNegativeTestJSON-408155366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:18:49 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d705dde4-29f4-4538-91b2-17413d329024 tempest-VolumeQuotasNegativeTestJSON-408155366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:18:49 devstack sudo[93165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:18:49 devstack sudo[93165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:18:49 devstack sudo[93163]: pam_unix(sudo:session): session closed for user root Jul 22 03:18:49 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5823901a-64f3-4fa8-88a4-b013f5aa4611 tempest-VolumesTransfersV355Test-134581344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-5756dd8b-fba3-4115-a25c-37aa517a266d" returned: 0 in 0.397s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:18:49 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5823901a-64f3-4fa8-88a4-b013f5aa4611 tempest-VolumesTransfersV355Test-134581344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-5756dd8b-fba3-4115-a25c-37aa517a266d {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:18:49 devstack sudo[93171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-5756dd8b-fba3-4115-a25c-37aa517a266d Jul 22 03:18:49 devstack sudo[93171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:18:49 devstack sudo[93165]: pam_unix(sudo:session): session closed for user root Jul 22 03:18:49 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d705dde4-29f4-4538-91b2-17413d329024 tempest-VolumeQuotasNegativeTestJSON-408155366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.356s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:18:49 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-d705dde4-29f4-4538-91b2-17413d329024 tempest-VolumeQuotasNegativeTestJSON-408155366 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:18:49 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-d705dde4-29f4-4538-91b2-17413d329024 tempest-VolumeQuotasNegativeTestJSON-408155366 None] Deleted volume successfully. Jul 22 03:18:49 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-d705dde4-29f4-4538-91b2-17413d329024 tempest-VolumeQuotasNegativeTestJSON-408155366 None] Lock "cinder-9e37ff72-9a35-41d6-9f0e-e798032dd92d-delete_volume" released by "delete_volume" :: held 1.397s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:18:49 devstack sudo[93171]: pam_unix(sudo:session): session closed for user root Jul 22 03:18:49 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5823901a-64f3-4fa8-88a4-b013f5aa4611 tempest-VolumesTransfersV355Test-134581344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-5756dd8b-fba3-4115-a25c-37aa517a266d" returned: 0 in 0.329s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:18:50 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-5823901a-64f3-4fa8-88a4-b013f5aa4611 tempest-VolumesTransfersV355Test-134581344 None] Lock "cinder-quobyte-5756dd8b-fba3-4115-a25c-37aa517a266d" released by "delete_volume" :: held 0.780s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:18:50 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-5823901a-64f3-4fa8-88a4-b013f5aa4611 tempest-VolumesTransfersV355Test-134581344 None] Created reservations ['f10dac07-f1a2-45c6-a6fc-bbe9a6b3d016', '40374d0b-5f82-440c-9c96-068fab02dec7', '0cf0ede3-2d9e-4e3d-be71-8d13e1a4f22c', '60e2f30e-585e-438b-a2f8-919d5176d752'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:18:50 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-5823901a-64f3-4fa8-88a4-b013f5aa4611 tempest-VolumesTransfersV355Test-134581344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:18:50 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-5823901a-64f3-4fa8-88a4-b013f5aa4611 tempest-VolumesTransfersV355Test-134581344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:18:50 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-5823901a-64f3-4fa8-88a4-b013f5aa4611 tempest-VolumesTransfersV355Test-134581344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:18:50 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-5823901a-64f3-4fa8-88a4-b013f5aa4611 tempest-VolumesTransfersV355Test-134581344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:18:50 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-5823901a-64f3-4fa8-88a4-b013f5aa4611 tempest-VolumesTransfersV355Test-134581344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:18:50 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5823901a-64f3-4fa8-88a4-b013f5aa4611 tempest-VolumesTransfersV355Test-134581344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:18:50 devstack sudo[93175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:18:50 devstack sudo[93175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:18:50 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-a53101fb-ac07-4903-95e2-71ecc4914a63 tempest-GroupsTest-221042037 None] Update group completed successfully. Jul 22 03:18:50 devstack sudo[93175]: pam_unix(sudo:session): session closed for user root Jul 22 03:18:50 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5823901a-64f3-4fa8-88a4-b013f5aa4611 tempest-VolumesTransfersV355Test-134581344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.476s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:18:50 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-5823901a-64f3-4fa8-88a4-b013f5aa4611 tempest-VolumesTransfersV355Test-134581344 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:18:50 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-5823901a-64f3-4fa8-88a4-b013f5aa4611 tempest-VolumesTransfersV355Test-134581344 None] Deleted volume successfully. Jul 22 03:18:50 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-5823901a-64f3-4fa8-88a4-b013f5aa4611 tempest-VolumesTransfersV355Test-134581344 None] Lock "cinder-5756dd8b-fba3-4115-a25c-37aa517a266d-delete_volume" released by "delete_volume" :: held 1.533s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:18:52 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-40342846-bda3-43c4-880b-49c4110b9720 tempest-GroupsTest-221042037 None] Acquiring lock "cinder-quobyte-54d23ee3-1aa8-434f-a72e-083fad77c759" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:18:52 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-40342846-bda3-43c4-880b-49c4110b9720 tempest-GroupsTest-221042037 None] Lock "cinder-quobyte-54d23ee3-1aa8-434f-a72e-083fad77c759" acquired by "delete_volume" :: waited 0.033s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:18:52 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea2c7e33-913c-4dd1-8583-03c3afc35735]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:18:52 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-40342846-bda3-43c4-880b-49c4110b9720 tempest-GroupsTest-221042037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-54d23ee3-1aa8-434f-a72e-083fad77c759 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:18:52 devstack sudo[93196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-54d23ee3-1aa8-434f-a72e-083fad77c759 Jul 22 03:18:52 devstack sudo[93196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:18:53 devstack sudo[93196]: pam_unix(sudo:session): session closed for user root Jul 22 03:18:53 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-40342846-bda3-43c4-880b-49c4110b9720 tempest-GroupsTest-221042037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-54d23ee3-1aa8-434f-a72e-083fad77c759" returned: 0 in 0.555s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:18:53 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-40342846-bda3-43c4-880b-49c4110b9720 tempest-GroupsTest-221042037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-54d23ee3-1aa8-434f-a72e-083fad77c759 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:18:53 devstack sudo[93202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-54d23ee3-1aa8-434f-a72e-083fad77c759 Jul 22 03:18:53 devstack sudo[93202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:18:53 devstack sudo[93202]: pam_unix(sudo:session): session closed for user root Jul 22 03:18:53 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-40342846-bda3-43c4-880b-49c4110b9720 tempest-GroupsTest-221042037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-54d23ee3-1aa8-434f-a72e-083fad77c759" returned: 0 in 0.296s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:18:53 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-40342846-bda3-43c4-880b-49c4110b9720 tempest-GroupsTest-221042037 None] Lock "cinder-quobyte-54d23ee3-1aa8-434f-a72e-083fad77c759" released by "delete_volume" :: held 0.920s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:18:53 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-40342846-bda3-43c4-880b-49c4110b9720 tempest-GroupsTest-221042037 None] Acquiring lock "cinder-quobyte-6d8e42d8-3fa4-48a0-8242-a1df153d7142" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:18:53 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-40342846-bda3-43c4-880b-49c4110b9720 tempest-GroupsTest-221042037 None] Lock "cinder-quobyte-6d8e42d8-3fa4-48a0-8242-a1df153d7142" acquired by "delete_volume" :: waited 0.023s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:18:53 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f79b2ea-2790-4c72-8ef7-edfd42f06b04]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:18:53 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-40342846-bda3-43c4-880b-49c4110b9720 tempest-GroupsTest-221042037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-6d8e42d8-3fa4-48a0-8242-a1df153d7142 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:18:53 devstack sudo[93205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-6d8e42d8-3fa4-48a0-8242-a1df153d7142 Jul 22 03:18:53 devstack sudo[93205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:18:53 devstack sudo[93205]: pam_unix(sudo:session): session closed for user root Jul 22 03:18:53 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-40342846-bda3-43c4-880b-49c4110b9720 tempest-GroupsTest-221042037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-6d8e42d8-3fa4-48a0-8242-a1df153d7142" returned: 0 in 0.412s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:18:53 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-40342846-bda3-43c4-880b-49c4110b9720 tempest-GroupsTest-221042037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-6d8e42d8-3fa4-48a0-8242-a1df153d7142 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:18:53 devstack sudo[93210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-6d8e42d8-3fa4-48a0-8242-a1df153d7142 Jul 22 03:18:53 devstack sudo[93210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:18:54 devstack sudo[93210]: pam_unix(sudo:session): session closed for user root Jul 22 03:18:54 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-40342846-bda3-43c4-880b-49c4110b9720 tempest-GroupsTest-221042037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-6d8e42d8-3fa4-48a0-8242-a1df153d7142" returned: 0 in 0.307s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:18:54 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-40342846-bda3-43c4-880b-49c4110b9720 tempest-GroupsTest-221042037 None] Lock "cinder-quobyte-6d8e42d8-3fa4-48a0-8242-a1df153d7142" released by "delete_volume" :: held 0.785s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:18:54 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-40342846-bda3-43c4-880b-49c4110b9720 tempest-GroupsTest-221042037 None] Created reservations ['163e82b1-3304-4ef7-ac3b-dfb76cf3520d'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:18:54 devstack cinder-volume[87747]: WARNING cinder.quota [None req-40342846-bda3-43c4-880b-49c4110b9720 tempest-GroupsTest-221042037 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-307951475 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-307951475, it is now deprecated. Please use the default quota class for default quota. Jul 22 03:18:54 devstack cinder-volume[87747]: WARNING cinder.quota [None req-40342846-bda3-43c4-880b-49c4110b9720 tempest-GroupsTest-221042037 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-307951475 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-307951475, it is now deprecated. Please use the default quota class for default quota. Jul 22 03:18:54 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-40342846-bda3-43c4-880b-49c4110b9720 tempest-GroupsTest-221042037 None] Created reservations ['f97a953b-733f-49ec-9cd0-c407c751bb00', 'a46743f6-e4c1-48a0-83c7-072a3bb9c2e4', 'd17096fb-2cd9-4038-b4cd-94e24bd420e6', '87ebf7ee-c852-49b2-8446-8d24e17321ea'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:18:54 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-40342846-bda3-43c4-880b-49c4110b9720 tempest-GroupsTest-221042037 None] Created reservations ['df8da999-c47d-4551-a8e0-029eb7c3d60b', '6a88a3bb-1455-4cb7-a965-1208f2580c3f', '74c52fff-719b-4f38-9666-fd39f0279183', '9db1052f-90bc-47df-a0cd-e77c56356bdc'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:18:54 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-40342846-bda3-43c4-880b-49c4110b9720 tempest-GroupsTest-221042037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:18:54 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-40342846-bda3-43c4-880b-49c4110b9720 tempest-GroupsTest-221042037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:18:54 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-40342846-bda3-43c4-880b-49c4110b9720 tempest-GroupsTest-221042037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:18:54 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-40342846-bda3-43c4-880b-49c4110b9720 tempest-GroupsTest-221042037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:18:54 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-40342846-bda3-43c4-880b-49c4110b9720 tempest-GroupsTest-221042037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:18:54 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-40342846-bda3-43c4-880b-49c4110b9720 tempest-GroupsTest-221042037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:18:54 devstack sudo[93213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:18:54 devstack sudo[93213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:18:54 devstack sudo[93213]: pam_unix(sudo:session): session closed for user root Jul 22 03:18:54 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-40342846-bda3-43c4-880b-49c4110b9720 tempest-GroupsTest-221042037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.277s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:18:54 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-40342846-bda3-43c4-880b-49c4110b9720 tempest-GroupsTest-221042037 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:18:54 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-40342846-bda3-43c4-880b-49c4110b9720 tempest-GroupsTest-221042037 None] Delete group completed successfully. Jul 22 03:18:58 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d2186fa-5f5c-41da-8e2f-3afe2d266820 tempest-VolumeTypesAccessTest-7635681 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:18:58 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-5d2186fa-5f5c-41da-8e2f-3afe2d266820 tempest-VolumeTypesAccessTest-7635681 None] Flow 'volume_create_manager' (2d0e7423-8483-43f2-916b-7ed341b674c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:18:58 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-5d2186fa-5f5c-41da-8e2f-3afe2d266820 tempest-VolumeTypesAccessTest-7635681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e70a3c0-0169-4947-9ed3-eb3ba4f36bc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:18:58 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-5d2186fa-5f5c-41da-8e2f-3afe2d266820 tempest-VolumeTypesAccessTest-7635681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e70a3c0-0169-4947-9ed3-eb3ba4f36bc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:18:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1156084153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bfa5fe3-9424-49ac-8ab8-e404fd50f58d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a77cbfb782ba40ca859f5893e7eb2ee1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:18:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:18:58Z,use_quota=True,user_id='67abe922305d4c2992b5524b4b7ab4df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2a7e11a-65fa-4c5c-b64c-f875c0ed81ff),volume_type_id=b2a7e11a-65fa-4c5c-b64c-f875c0ed81ff)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:18:58 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-5d2186fa-5f5c-41da-8e2f-3afe2d266820 tempest-VolumeTypesAccessTest-7635681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56b78d48-563f-4635-8690-4cd4a5164a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:18:58 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-5d2186fa-5f5c-41da-8e2f-3afe2d266820 tempest-VolumeTypesAccessTest-7635681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56b78d48-563f-4635-8690-4cd4a5164a93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:18:58 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-5d2186fa-5f5c-41da-8e2f-3afe2d266820 tempest-VolumeTypesAccessTest-7635681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40a7d017-e61b-4903-b1c0-00aa99450e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:18:58 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-5d2186fa-5f5c-41da-8e2f-3afe2d266820 tempest-VolumeTypesAccessTest-7635681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40a7d017-e61b-4903-b1c0-00aa99450e97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4bfa5fe3-9424-49ac-8ab8-e404fd50f58d', 'volume_name': 'volume-4bfa5fe3-9424-49ac-8ab8-e404fd50f58d', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:18:58 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-5d2186fa-5f5c-41da-8e2f-3afe2d266820 tempest-VolumeTypesAccessTest-7635681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f5dd7d3-ae71-4d11-bddc-b8cbec839445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:18:58 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-5d2186fa-5f5c-41da-8e2f-3afe2d266820 tempest-VolumeTypesAccessTest-7635681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f5dd7d3-ae71-4d11-bddc-b8cbec839445) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:18:58 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-5d2186fa-5f5c-41da-8e2f-3afe2d266820 tempest-VolumeTypesAccessTest-7635681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47bdab1f-73d8-465e-9442-4804a7a47f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:18:58 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-5d2186fa-5f5c-41da-8e2f-3afe2d266820 tempest-VolumeTypesAccessTest-7635681 None] Volume 4bfa5fe3-9424-49ac-8ab8-e404fd50f58d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4bfa5fe3-9424-49ac-8ab8-e404fd50f58d', 'volume_size': 1} Jul 22 03:18:58 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-5d2186fa-5f5c-41da-8e2f-3afe2d266820 tempest-VolumeTypesAccessTest-7635681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:18:58 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-5d2186fa-5f5c-41da-8e2f-3afe2d266820 tempest-VolumeTypesAccessTest-7635681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:18:58 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-5d2186fa-5f5c-41da-8e2f-3afe2d266820 tempest-VolumeTypesAccessTest-7635681 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:18:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1156084153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bfa5fe3-9424-49ac-8ab8-e404fd50f58d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a77cbfb782ba40ca859f5893e7eb2ee1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:18:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:18:58Z,use_quota=True,user_id='67abe922305d4c2992b5524b4b7ab4df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2a7e11a-65fa-4c5c-b64c-f875c0ed81ff),volume_type_id=b2a7e11a-65fa-4c5c-b64c-f875c0ed81ff)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:18:58 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-5d2186fa-5f5c-41da-8e2f-3afe2d266820 tempest-VolumeTypesAccessTest-7635681 None] Creating volume 4bfa5fe3-9424-49ac-8ab8-e404fd50f58d {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:18:58 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-5d2186fa-5f5c-41da-8e2f-3afe2d266820 tempest-VolumeTypesAccessTest-7635681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:18:58 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-5d2186fa-5f5c-41da-8e2f-3afe2d266820 tempest-VolumeTypesAccessTest-7635681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:18:58 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-5d2186fa-5f5c-41da-8e2f-3afe2d266820 tempest-VolumeTypesAccessTest-7635681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:18:58 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-5d2186fa-5f5c-41da-8e2f-3afe2d266820 tempest-VolumeTypesAccessTest-7635681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:18:58 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-5d2186fa-5f5c-41da-8e2f-3afe2d266820 tempest-VolumeTypesAccessTest-7635681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:18:58 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-5d2186fa-5f5c-41da-8e2f-3afe2d266820 tempest-VolumeTypesAccessTest-7635681 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:18:58 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-5d2186fa-5f5c-41da-8e2f-3afe2d266820 tempest-VolumeTypesAccessTest-7635681 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:18:58 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5d2186fa-5f5c-41da-8e2f-3afe2d266820 tempest-VolumeTypesAccessTest-7635681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4bfa5fe3-9424-49ac-8ab8-e404fd50f58d 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:18:58 devstack sudo[93217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4bfa5fe3-9424-49ac-8ab8-e404fd50f58d 1073741824 Jul 22 03:18:58 devstack sudo[93217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:18:59 devstack sudo[93217]: pam_unix(sudo:session): session closed for user root Jul 22 03:18:59 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5d2186fa-5f5c-41da-8e2f-3afe2d266820 tempest-VolumeTypesAccessTest-7635681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4bfa5fe3-9424-49ac-8ab8-e404fd50f58d 1073741824" returned: 0 in 0.571s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:18:59 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5d2186fa-5f5c-41da-8e2f-3afe2d266820 tempest-VolumeTypesAccessTest-7635681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4bfa5fe3-9424-49ac-8ab8-e404fd50f58d {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:18:59 devstack sudo[93225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4bfa5fe3-9424-49ac-8ab8-e404fd50f58d Jul 22 03:18:59 devstack sudo[93225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:18:59 devstack sudo[93225]: pam_unix(sudo:session): session closed for user root Jul 22 03:18:59 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5d2186fa-5f5c-41da-8e2f-3afe2d266820 tempest-VolumeTypesAccessTest-7635681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4bfa5fe3-9424-49ac-8ab8-e404fd50f58d" returned: 0 in 0.323s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:18:59 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-5d2186fa-5f5c-41da-8e2f-3afe2d266820 tempest-VolumeTypesAccessTest-7635681 None] <== create_volume: return (954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:18:59 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-5d2186fa-5f5c-41da-8e2f-3afe2d266820 tempest-VolumeTypesAccessTest-7635681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:18:59 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-5d2186fa-5f5c-41da-8e2f-3afe2d266820 tempest-VolumeTypesAccessTest-7635681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47bdab1f-73d8-465e-9442-4804a7a47f92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4bfa5fe3-9424-49ac-8ab8-e404fd50f58d', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:18:59 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-5d2186fa-5f5c-41da-8e2f-3afe2d266820 tempest-VolumeTypesAccessTest-7635681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71a001f2-9f1e-4150-9a8d-6afc5e110c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:18:59 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-5d2186fa-5f5c-41da-8e2f-3afe2d266820 tempest-VolumeTypesAccessTest-7635681 None] Volume volume-4bfa5fe3-9424-49ac-8ab8-e404fd50f58d (4bfa5fe3-9424-49ac-8ab8-e404fd50f58d): created successfully Jul 22 03:18:59 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-5d2186fa-5f5c-41da-8e2f-3afe2d266820 tempest-VolumeTypesAccessTest-7635681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71a001f2-9f1e-4150-9a8d-6afc5e110c7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:18:59 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-5d2186fa-5f5c-41da-8e2f-3afe2d266820 tempest-VolumeTypesAccessTest-7635681 None] Flow 'volume_create_manager' (2d0e7423-8483-43f2-916b-7ed341b674c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:18:59 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-5d2186fa-5f5c-41da-8e2f-3afe2d266820 tempest-VolumeTypesAccessTest-7635681 None] Created volume successfully. Jul 22 03:18:59 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-8dda3ed7-e6bb-4c9b-99e5-eaefdaa72bdc tempest-VolumesTransfersV357Test-245312544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:18:59 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-8dda3ed7-e6bb-4c9b-99e5-eaefdaa72bdc tempest-VolumesTransfersV357Test-245312544 None] Flow 'volume_create_manager' (a5765bde-d42b-45ec-ab32-37cbadf0e7b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:18:59 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-8dda3ed7-e6bb-4c9b-99e5-eaefdaa72bdc tempest-VolumesTransfersV357Test-245312544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (974227fd-6d6e-4371-9426-b83ee8b3f505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:18:59 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-8dda3ed7-e6bb-4c9b-99e5-eaefdaa72bdc tempest-VolumesTransfersV357Test-245312544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (974227fd-6d6e-4371-9426-b83ee8b3f505) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:18:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1456318582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b8daf9f-e169-4fd9-a7c5-4048b6fe3f74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddb5eb2f06e34f84b8362dcbcf0ed82f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:19:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:19:00Z,use_quota=True,user_id='07284f3ec55148a1ae1f0fbd36980530',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:18:59 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-8dda3ed7-e6bb-4c9b-99e5-eaefdaa72bdc tempest-VolumesTransfersV357Test-245312544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96870166-bb07-47f0-8920-a85ca72e7341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:18:59 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-8dda3ed7-e6bb-4c9b-99e5-eaefdaa72bdc tempest-VolumesTransfersV357Test-245312544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96870166-bb07-47f0-8920-a85ca72e7341) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:18:59 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-8dda3ed7-e6bb-4c9b-99e5-eaefdaa72bdc tempest-VolumesTransfersV357Test-245312544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b69ba97f-4d8a-4739-a3d7-a655a1d3e4b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:18:59 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-8dda3ed7-e6bb-4c9b-99e5-eaefdaa72bdc tempest-VolumesTransfersV357Test-245312544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b69ba97f-4d8a-4739-a3d7-a655a1d3e4b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b8daf9f-e169-4fd9-a7c5-4048b6fe3f74', 'volume_name': 'volume-0b8daf9f-e169-4fd9-a7c5-4048b6fe3f74', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:18:59 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-8dda3ed7-e6bb-4c9b-99e5-eaefdaa72bdc tempest-VolumesTransfersV357Test-245312544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02332e2e-f316-42cd-8474-328a07f106ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:18:59 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-8dda3ed7-e6bb-4c9b-99e5-eaefdaa72bdc tempest-VolumesTransfersV357Test-245312544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02332e2e-f316-42cd-8474-328a07f106ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:18:59 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-8dda3ed7-e6bb-4c9b-99e5-eaefdaa72bdc tempest-VolumesTransfersV357Test-245312544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db7c4acc-4d33-4312-911b-c19102f117a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:18:59 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-8dda3ed7-e6bb-4c9b-99e5-eaefdaa72bdc tempest-VolumesTransfersV357Test-245312544 None] Volume 0b8daf9f-e169-4fd9-a7c5-4048b6fe3f74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b8daf9f-e169-4fd9-a7c5-4048b6fe3f74', 'volume_size': 1} Jul 22 03:18:59 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-8dda3ed7-e6bb-4c9b-99e5-eaefdaa72bdc tempest-VolumesTransfersV357Test-245312544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:18:59 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-8dda3ed7-e6bb-4c9b-99e5-eaefdaa72bdc tempest-VolumesTransfersV357Test-245312544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:18:59 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-8dda3ed7-e6bb-4c9b-99e5-eaefdaa72bdc tempest-VolumesTransfersV357Test-245312544 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:18:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1456318582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b8daf9f-e169-4fd9-a7c5-4048b6fe3f74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddb5eb2f06e34f84b8362dcbcf0ed82f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:19:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:19:00Z,use_quota=True,user_id='07284f3ec55148a1ae1f0fbd36980530',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:18:59 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-8dda3ed7-e6bb-4c9b-99e5-eaefdaa72bdc tempest-VolumesTransfersV357Test-245312544 None] Creating volume 0b8daf9f-e169-4fd9-a7c5-4048b6fe3f74 {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:18:59 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-8dda3ed7-e6bb-4c9b-99e5-eaefdaa72bdc tempest-VolumesTransfersV357Test-245312544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:18:59 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-8dda3ed7-e6bb-4c9b-99e5-eaefdaa72bdc tempest-VolumesTransfersV357Test-245312544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:18:59 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-8dda3ed7-e6bb-4c9b-99e5-eaefdaa72bdc tempest-VolumesTransfersV357Test-245312544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:18:59 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-8dda3ed7-e6bb-4c9b-99e5-eaefdaa72bdc tempest-VolumesTransfersV357Test-245312544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:18:59 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-8dda3ed7-e6bb-4c9b-99e5-eaefdaa72bdc tempest-VolumesTransfersV357Test-245312544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:18:59 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-8dda3ed7-e6bb-4c9b-99e5-eaefdaa72bdc tempest-VolumesTransfersV357Test-245312544 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:18:59 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-8dda3ed7-e6bb-4c9b-99e5-eaefdaa72bdc tempest-VolumesTransfersV357Test-245312544 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:18:59 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-8dda3ed7-e6bb-4c9b-99e5-eaefdaa72bdc tempest-VolumesTransfersV357Test-245312544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0b8daf9f-e169-4fd9-a7c5-4048b6fe3f74 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:18:59 devstack sudo[93228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0b8daf9f-e169-4fd9-a7c5-4048b6fe3f74 1073741824 Jul 22 03:18:59 devstack sudo[93228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:19:00 devstack sudo[93228]: pam_unix(sudo:session): session closed for user root Jul 22 03:19:00 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-8dda3ed7-e6bb-4c9b-99e5-eaefdaa72bdc tempest-VolumesTransfersV357Test-245312544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0b8daf9f-e169-4fd9-a7c5-4048b6fe3f74 1073741824" returned: 0 in 0.455s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:19:00 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-8dda3ed7-e6bb-4c9b-99e5-eaefdaa72bdc tempest-VolumesTransfersV357Test-245312544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0b8daf9f-e169-4fd9-a7c5-4048b6fe3f74 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:19:00 devstack sudo[93234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0b8daf9f-e169-4fd9-a7c5-4048b6fe3f74 Jul 22 03:19:00 devstack sudo[93234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:19:00 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-32b9f5b2-2b0d-4732-9301-18e60f5f064c tempest-VolumeTypesAccessTest-7635681 None] Acquiring lock "cinder-4bfa5fe3-9424-49ac-8ab8-e404fd50f58d-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:19:00 devstack sudo[93234]: pam_unix(sudo:session): session closed for user root Jul 22 03:19:00 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-8dda3ed7-e6bb-4c9b-99e5-eaefdaa72bdc tempest-VolumesTransfersV357Test-245312544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0b8daf9f-e169-4fd9-a7c5-4048b6fe3f74" returned: 0 in 0.337s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:19:00 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-8dda3ed7-e6bb-4c9b-99e5-eaefdaa72bdc tempest-VolumesTransfersV357Test-245312544 None] <== create_volume: return (834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:19:00 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-8dda3ed7-e6bb-4c9b-99e5-eaefdaa72bdc tempest-VolumesTransfersV357Test-245312544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.836s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:19:00 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-32b9f5b2-2b0d-4732-9301-18e60f5f064c tempest-VolumeTypesAccessTest-7635681 None] Lock "cinder-4bfa5fe3-9424-49ac-8ab8-e404fd50f58d-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:19:00 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-8dda3ed7-e6bb-4c9b-99e5-eaefdaa72bdc tempest-VolumesTransfersV357Test-245312544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db7c4acc-4d33-4312-911b-c19102f117a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b8daf9f-e169-4fd9-a7c5-4048b6fe3f74', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:19:00 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-8dda3ed7-e6bb-4c9b-99e5-eaefdaa72bdc tempest-VolumesTransfersV357Test-245312544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f27a20c-2476-413d-b53c-9822ff049197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:19:00 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-8dda3ed7-e6bb-4c9b-99e5-eaefdaa72bdc tempest-VolumesTransfersV357Test-245312544 None] Volume volume-0b8daf9f-e169-4fd9-a7c5-4048b6fe3f74 (0b8daf9f-e169-4fd9-a7c5-4048b6fe3f74): created successfully Jul 22 03:19:00 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-8dda3ed7-e6bb-4c9b-99e5-eaefdaa72bdc tempest-VolumesTransfersV357Test-245312544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f27a20c-2476-413d-b53c-9822ff049197) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:19:00 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-8dda3ed7-e6bb-4c9b-99e5-eaefdaa72bdc tempest-VolumesTransfersV357Test-245312544 None] Flow 'volume_create_manager' (a5765bde-d42b-45ec-ab32-37cbadf0e7b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:19:00 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-32b9f5b2-2b0d-4732-9301-18e60f5f064c tempest-VolumeTypesAccessTest-7635681 None] Acquiring lock "cinder-quobyte-4bfa5fe3-9424-49ac-8ab8-e404fd50f58d" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:19:00 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-8dda3ed7-e6bb-4c9b-99e5-eaefdaa72bdc tempest-VolumesTransfersV357Test-245312544 None] Created volume successfully. Jul 22 03:19:00 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-32b9f5b2-2b0d-4732-9301-18e60f5f064c tempest-VolumeTypesAccessTest-7635681 None] Lock "cinder-quobyte-4bfa5fe3-9424-49ac-8ab8-e404fd50f58d" acquired by "delete_volume" :: waited 0.032s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:19:00 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a93ce7e-067c-4492-89dc-3f84e01cdb64]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:19:00 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-32b9f5b2-2b0d-4732-9301-18e60f5f064c tempest-VolumeTypesAccessTest-7635681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4bfa5fe3-9424-49ac-8ab8-e404fd50f58d {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:19:01 devstack sudo[93237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4bfa5fe3-9424-49ac-8ab8-e404fd50f58d Jul 22 03:19:01 devstack sudo[93237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:19:01 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-ebc25fb9-b12f-497c-be7b-65503a76ea27 tempest-GroupsV314Test-154076591 None] Group tempest-GroupsV314Test-Group-47089272: creating Jul 22 03:19:01 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-ebc25fb9-b12f-497c-be7b-65503a76ea27 tempest-GroupsV314Test-154076591 None] Group tempest-GroupsV314Test-Group-47089272: created successfully Jul 22 03:19:01 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-ebc25fb9-b12f-497c-be7b-65503a76ea27 tempest-GroupsV314Test-154076591 None] Create group completed successfully. Jul 22 03:19:01 devstack sudo[93237]: pam_unix(sudo:session): session closed for user root Jul 22 03:19:01 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-32b9f5b2-2b0d-4732-9301-18e60f5f064c tempest-VolumeTypesAccessTest-7635681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4bfa5fe3-9424-49ac-8ab8-e404fd50f58d" returned: 0 in 0.409s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:19:01 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-32b9f5b2-2b0d-4732-9301-18e60f5f064c tempest-VolumeTypesAccessTest-7635681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4bfa5fe3-9424-49ac-8ab8-e404fd50f58d {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:19:01 devstack sudo[93242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4bfa5fe3-9424-49ac-8ab8-e404fd50f58d Jul 22 03:19:01 devstack sudo[93242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:19:01 devstack sudo[93242]: pam_unix(sudo:session): session closed for user root Jul 22 03:19:01 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-32b9f5b2-2b0d-4732-9301-18e60f5f064c tempest-VolumeTypesAccessTest-7635681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4bfa5fe3-9424-49ac-8ab8-e404fd50f58d" returned: 0 in 0.239s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:19:01 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-32b9f5b2-2b0d-4732-9301-18e60f5f064c tempest-VolumeTypesAccessTest-7635681 None] Lock "cinder-quobyte-4bfa5fe3-9424-49ac-8ab8-e404fd50f58d" released by "delete_volume" :: held 0.697s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:19:01 devstack cinder-volume[87747]: WARNING cinder.quota [None req-32b9f5b2-2b0d-4732-9301-18e60f5f064c tempest-VolumeTypesAccessTest-7635681 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1053882107 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1053882107, it is now deprecated. Please use the default quota class for default quota. Jul 22 03:19:01 devstack cinder-volume[87747]: WARNING cinder.quota [None req-32b9f5b2-2b0d-4732-9301-18e60f5f064c tempest-VolumeTypesAccessTest-7635681 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1053882107 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1053882107, it is now deprecated. Please use the default quota class for default quota. Jul 22 03:19:01 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-32b9f5b2-2b0d-4732-9301-18e60f5f064c tempest-VolumeTypesAccessTest-7635681 None] Created reservations ['4b6f5177-1dbd-4e4b-a9f6-34e9d553006a', '6e622786-3347-483f-9057-ed73ef561cdd', '3ab1d831-accc-4dce-a5d6-0e066201ac6c', '42bffa05-6a72-4841-8aa0-5684b81bc00a'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:19:01 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-32b9f5b2-2b0d-4732-9301-18e60f5f064c tempest-VolumeTypesAccessTest-7635681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:19:01 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-32b9f5b2-2b0d-4732-9301-18e60f5f064c tempest-VolumeTypesAccessTest-7635681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:19:01 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-32b9f5b2-2b0d-4732-9301-18e60f5f064c tempest-VolumeTypesAccessTest-7635681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:19:01 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-32b9f5b2-2b0d-4732-9301-18e60f5f064c tempest-VolumeTypesAccessTest-7635681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:19:01 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-32b9f5b2-2b0d-4732-9301-18e60f5f064c tempest-VolumeTypesAccessTest-7635681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:19:01 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-32b9f5b2-2b0d-4732-9301-18e60f5f064c tempest-VolumeTypesAccessTest-7635681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:19:01 devstack sudo[93245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:19:01 devstack sudo[93245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:19:01 devstack sudo[93245]: pam_unix(sudo:session): session closed for user root Jul 22 03:19:01 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-32b9f5b2-2b0d-4732-9301-18e60f5f064c tempest-VolumeTypesAccessTest-7635681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.252s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:19:01 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-32b9f5b2-2b0d-4732-9301-18e60f5f064c tempest-VolumeTypesAccessTest-7635681 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:19:01 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-32b9f5b2-2b0d-4732-9301-18e60f5f064c tempest-VolumeTypesAccessTest-7635681 None] Deleted volume successfully. Jul 22 03:19:01 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-32b9f5b2-2b0d-4732-9301-18e60f5f064c tempest-VolumeTypesAccessTest-7635681 None] Lock "cinder-4bfa5fe3-9424-49ac-8ab8-e404fd50f58d-delete_volume" released by "delete_volume" :: held 1.242s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:19:02 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-9f2115b7-1147-4a14-aecb-d89bb1d52bb1 tempest-VolumesTransfersV357Test-2017773549 None] Transfer volume completed successfully. Jul 22 03:19:02 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-acea7ed2-8398-4e78-b33e-8794784530d3 tempest-GroupsV314Test-154076591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:19:02 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-acea7ed2-8398-4e78-b33e-8794784530d3 tempest-GroupsV314Test-154076591 None] Flow 'volume_create_manager' (44a4c1d9-0fb2-415c-adb6-f39c44c8ba2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:19:02 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-acea7ed2-8398-4e78-b33e-8794784530d3 tempest-GroupsV314Test-154076591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54b65053-68e5-4fed-b557-e12f15908e7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:19:02 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-acea7ed2-8398-4e78-b33e-8794784530d3 tempest-GroupsV314Test-154076591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54b65053-68e5-4fed-b557-e12f15908e7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:19:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1762118066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f3e3a4df-0e7e-4b76-89dc-1166909c3468,host='devstack@QuobyteHD#QuobyteHD',id=23d27957-0077-48d1-aea2-604362199892,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e60db17700f34767a79be32865cc72c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:19:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:19:03Z,use_quota=True,user_id='4edf4243d7c34e97bd92c0645ebc28fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fa70fd2-01db-455f-bc84-bff6495b5387),volume_type_id=4fa70fd2-01db-455f-bc84-bff6495b5387)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:19:02 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-acea7ed2-8398-4e78-b33e-8794784530d3 tempest-GroupsV314Test-154076591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (490fdddf-f347-421d-90cf-c584d86378ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:19:02 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-acea7ed2-8398-4e78-b33e-8794784530d3 tempest-GroupsV314Test-154076591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (490fdddf-f347-421d-90cf-c584d86378ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:19:02 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-acea7ed2-8398-4e78-b33e-8794784530d3 tempest-GroupsV314Test-154076591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3bdf922-e95c-41c3-a896-a0ec7deea585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:19:02 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-acea7ed2-8398-4e78-b33e-8794784530d3 tempest-GroupsV314Test-154076591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3bdf922-e95c-41c3-a896-a0ec7deea585) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23d27957-0077-48d1-aea2-604362199892', 'volume_name': 'volume-23d27957-0077-48d1-aea2-604362199892', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:19:02 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-acea7ed2-8398-4e78-b33e-8794784530d3 tempest-GroupsV314Test-154076591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1487af25-ce95-4324-a376-8c7e8085a8bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:19:02 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-acea7ed2-8398-4e78-b33e-8794784530d3 tempest-GroupsV314Test-154076591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1487af25-ce95-4324-a376-8c7e8085a8bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:19:02 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-acea7ed2-8398-4e78-b33e-8794784530d3 tempest-GroupsV314Test-154076591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (573722ff-6dc3-4cc0-9b52-902bea902c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:19:02 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-acea7ed2-8398-4e78-b33e-8794784530d3 tempest-GroupsV314Test-154076591 None] Volume 23d27957-0077-48d1-aea2-604362199892: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23d27957-0077-48d1-aea2-604362199892', 'volume_size': 1} Jul 22 03:19:02 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-acea7ed2-8398-4e78-b33e-8794784530d3 tempest-GroupsV314Test-154076591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:19:02 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-acea7ed2-8398-4e78-b33e-8794784530d3 tempest-GroupsV314Test-154076591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:19:02 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-acea7ed2-8398-4e78-b33e-8794784530d3 tempest-GroupsV314Test-154076591 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f3e3a4df-0e7e-4b76-89dc-1166909c3468,created_at=2026-07-22T01:19:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1762118066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f3e3a4df-0e7e-4b76-89dc-1166909c3468,host='devstack@QuobyteHD#QuobyteHD',id=23d27957-0077-48d1-aea2-604362199892,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e60db17700f34767a79be32865cc72c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:19:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:19:03Z,use_quota=True,user_id='4edf4243d7c34e97bd92c0645ebc28fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fa70fd2-01db-455f-bc84-bff6495b5387),volume_type_id=4fa70fd2-01db-455f-bc84-bff6495b5387)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:19:02 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-acea7ed2-8398-4e78-b33e-8794784530d3 tempest-GroupsV314Test-154076591 None] Creating volume 23d27957-0077-48d1-aea2-604362199892 {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:19:02 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-acea7ed2-8398-4e78-b33e-8794784530d3 tempest-GroupsV314Test-154076591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:19:02 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-acea7ed2-8398-4e78-b33e-8794784530d3 tempest-GroupsV314Test-154076591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:19:02 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-acea7ed2-8398-4e78-b33e-8794784530d3 tempest-GroupsV314Test-154076591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:19:02 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-acea7ed2-8398-4e78-b33e-8794784530d3 tempest-GroupsV314Test-154076591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:19:02 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-acea7ed2-8398-4e78-b33e-8794784530d3 tempest-GroupsV314Test-154076591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:19:02 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-acea7ed2-8398-4e78-b33e-8794784530d3 tempest-GroupsV314Test-154076591 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:19:02 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-acea7ed2-8398-4e78-b33e-8794784530d3 tempest-GroupsV314Test-154076591 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:19:02 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-acea7ed2-8398-4e78-b33e-8794784530d3 tempest-GroupsV314Test-154076591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-23d27957-0077-48d1-aea2-604362199892 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:19:02 devstack sudo[93249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-23d27957-0077-48d1-aea2-604362199892 1073741824 Jul 22 03:19:02 devstack sudo[93249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:19:03 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-2fa1e86e-c793-452a-8057-609b21c5782d tempest-VolumesTransfersV357Test-297992809 None] Acquiring lock "cinder-0b8daf9f-e169-4fd9-a7c5-4048b6fe3f74-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:19:03 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-2fa1e86e-c793-452a-8057-609b21c5782d tempest-VolumesTransfersV357Test-297992809 None] Lock "cinder-0b8daf9f-e169-4fd9-a7c5-4048b6fe3f74-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:19:03 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-2fa1e86e-c793-452a-8057-609b21c5782d tempest-VolumesTransfersV357Test-297992809 None] Acquiring lock "cinder-quobyte-0b8daf9f-e169-4fd9-a7c5-4048b6fe3f74" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:19:03 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-2fa1e86e-c793-452a-8057-609b21c5782d tempest-VolumesTransfersV357Test-297992809 None] Lock "cinder-quobyte-0b8daf9f-e169-4fd9-a7c5-4048b6fe3f74" acquired by "delete_volume" :: waited 0.022s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:19:03 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[0288ec25-2c73-4583-8042-a1bc3839f888]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:19:03 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2fa1e86e-c793-452a-8057-609b21c5782d tempest-VolumesTransfersV357Test-297992809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0b8daf9f-e169-4fd9-a7c5-4048b6fe3f74 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:19:03 devstack sudo[93249]: pam_unix(sudo:session): session closed for user root Jul 22 03:19:03 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-acea7ed2-8398-4e78-b33e-8794784530d3 tempest-GroupsV314Test-154076591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-23d27957-0077-48d1-aea2-604362199892 1073741824" returned: 0 in 0.528s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:19:03 devstack sudo[93255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0b8daf9f-e169-4fd9-a7c5-4048b6fe3f74 Jul 22 03:19:03 devstack sudo[93255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:19:03 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-acea7ed2-8398-4e78-b33e-8794784530d3 tempest-GroupsV314Test-154076591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-23d27957-0077-48d1-aea2-604362199892 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:19:03 devstack sudo[93257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-23d27957-0077-48d1-aea2-604362199892 Jul 22 03:19:03 devstack sudo[93257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:19:03 devstack sudo[93255]: pam_unix(sudo:session): session closed for user root Jul 22 03:19:03 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2fa1e86e-c793-452a-8057-609b21c5782d tempest-VolumesTransfersV357Test-297992809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0b8daf9f-e169-4fd9-a7c5-4048b6fe3f74" returned: 0 in 0.410s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:19:03 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2fa1e86e-c793-452a-8057-609b21c5782d tempest-VolumesTransfersV357Test-297992809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0b8daf9f-e169-4fd9-a7c5-4048b6fe3f74 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:19:03 devstack sudo[93265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0b8daf9f-e169-4fd9-a7c5-4048b6fe3f74 Jul 22 03:19:03 devstack sudo[93265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:19:03 devstack sudo[93257]: pam_unix(sudo:session): session closed for user root Jul 22 03:19:03 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-acea7ed2-8398-4e78-b33e-8794784530d3 tempest-GroupsV314Test-154076591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-23d27957-0077-48d1-aea2-604362199892" returned: 0 in 0.312s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:19:03 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-acea7ed2-8398-4e78-b33e-8794784530d3 tempest-GroupsV314Test-154076591 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:19:03 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-acea7ed2-8398-4e78-b33e-8794784530d3 tempest-GroupsV314Test-154076591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:19:03 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-acea7ed2-8398-4e78-b33e-8794784530d3 tempest-GroupsV314Test-154076591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (573722ff-6dc3-4cc0-9b52-902bea902c7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23d27957-0077-48d1-aea2-604362199892', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:19:03 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-acea7ed2-8398-4e78-b33e-8794784530d3 tempest-GroupsV314Test-154076591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b36c1859-587f-4a29-8177-5ede4f26edd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:19:03 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-acea7ed2-8398-4e78-b33e-8794784530d3 tempest-GroupsV314Test-154076591 None] Volume volume-23d27957-0077-48d1-aea2-604362199892 (23d27957-0077-48d1-aea2-604362199892): created successfully Jul 22 03:19:03 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-acea7ed2-8398-4e78-b33e-8794784530d3 tempest-GroupsV314Test-154076591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b36c1859-587f-4a29-8177-5ede4f26edd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:19:03 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-acea7ed2-8398-4e78-b33e-8794784530d3 tempest-GroupsV314Test-154076591 None] Flow 'volume_create_manager' (44a4c1d9-0fb2-415c-adb6-f39c44c8ba2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:19:03 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-acea7ed2-8398-4e78-b33e-8794784530d3 tempest-GroupsV314Test-154076591 None] Created volume successfully. Jul 22 03:19:04 devstack sudo[93265]: pam_unix(sudo:session): session closed for user root Jul 22 03:19:04 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2fa1e86e-c793-452a-8057-609b21c5782d tempest-VolumesTransfersV357Test-297992809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0b8daf9f-e169-4fd9-a7c5-4048b6fe3f74" returned: 0 in 0.359s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:19:04 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-2fa1e86e-c793-452a-8057-609b21c5782d tempest-VolumesTransfersV357Test-297992809 None] Lock "cinder-quobyte-0b8daf9f-e169-4fd9-a7c5-4048b6fe3f74" released by "delete_volume" :: held 0.831s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:19:04 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-2fa1e86e-c793-452a-8057-609b21c5782d tempest-VolumesTransfersV357Test-297992809 None] Created reservations ['36286961-fb1e-4c1d-a80f-36812c8965d0', 'a9783b80-5a73-47a1-862a-3b3409585d2e', '2ac915fe-9a21-4b19-8454-f7ac3a8e7677', 'c8f68adf-7e22-4b4d-8498-be19edb3fed8'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:19:04 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-2fa1e86e-c793-452a-8057-609b21c5782d tempest-VolumesTransfersV357Test-297992809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:19:04 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-2fa1e86e-c793-452a-8057-609b21c5782d tempest-VolumesTransfersV357Test-297992809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:19:04 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-2fa1e86e-c793-452a-8057-609b21c5782d tempest-VolumesTransfersV357Test-297992809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:19:04 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-2fa1e86e-c793-452a-8057-609b21c5782d tempest-VolumesTransfersV357Test-297992809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:19:04 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-2fa1e86e-c793-452a-8057-609b21c5782d tempest-VolumesTransfersV357Test-297992809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:19:04 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2fa1e86e-c793-452a-8057-609b21c5782d tempest-VolumesTransfersV357Test-297992809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:19:04 devstack sudo[93268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:19:04 devstack sudo[93268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:19:04 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-bcae91cb-9ee9-4610-a36d-5bbf1a5bac3a tempest-AttachVolumeShelveTestJSON-597292271 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:19:04 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-bcae91cb-9ee9-4610-a36d-5bbf1a5bac3a tempest-AttachVolumeShelveTestJSON-597292271 None] Flow 'volume_create_manager' (6bee20ed-c317-4873-93a3-b926aed1b711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:19:04 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-bcae91cb-9ee9-4610-a36d-5bbf1a5bac3a tempest-AttachVolumeShelveTestJSON-597292271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6a9a111-3c79-4de1-8c54-2630f12a2951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:19:04 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-bcae91cb-9ee9-4610-a36d-5bbf1a5bac3a tempest-AttachVolumeShelveTestJSON-597292271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6a9a111-3c79-4de1-8c54-2630f12a2951) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:19:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-244680260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1719ff05-ee15-4be4-9d6d-8c5532022bda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='532049b9d396498bb6c429896864ed5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:19:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:19:04Z,use_quota=True,user_id='fcf4a550e6c84e7ba2d9f951b1036365',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:19:04 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-bcae91cb-9ee9-4610-a36d-5bbf1a5bac3a tempest-AttachVolumeShelveTestJSON-597292271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4602aa1c-68d9-49b3-9482-8a01be886241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:19:04 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-bcae91cb-9ee9-4610-a36d-5bbf1a5bac3a tempest-AttachVolumeShelveTestJSON-597292271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4602aa1c-68d9-49b3-9482-8a01be886241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:19:04 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-bcae91cb-9ee9-4610-a36d-5bbf1a5bac3a tempest-AttachVolumeShelveTestJSON-597292271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (944097f4-673c-4cb4-a26b-f65a93184806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:19:04 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-bcae91cb-9ee9-4610-a36d-5bbf1a5bac3a tempest-AttachVolumeShelveTestJSON-597292271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (944097f4-673c-4cb4-a26b-f65a93184806) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1719ff05-ee15-4be4-9d6d-8c5532022bda', 'volume_name': 'volume-1719ff05-ee15-4be4-9d6d-8c5532022bda', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:19:04 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-bcae91cb-9ee9-4610-a36d-5bbf1a5bac3a tempest-AttachVolumeShelveTestJSON-597292271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94ae40f7-7cc5-443c-bca1-f44b254a8713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:19:04 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-bcae91cb-9ee9-4610-a36d-5bbf1a5bac3a tempest-AttachVolumeShelveTestJSON-597292271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94ae40f7-7cc5-443c-bca1-f44b254a8713) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:19:04 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-bcae91cb-9ee9-4610-a36d-5bbf1a5bac3a tempest-AttachVolumeShelveTestJSON-597292271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (484496fb-4d56-48a5-8a68-62a65c16bbd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:19:04 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-bcae91cb-9ee9-4610-a36d-5bbf1a5bac3a tempest-AttachVolumeShelveTestJSON-597292271 None] Volume 1719ff05-ee15-4be4-9d6d-8c5532022bda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1719ff05-ee15-4be4-9d6d-8c5532022bda', 'volume_size': 1} Jul 22 03:19:04 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-bcae91cb-9ee9-4610-a36d-5bbf1a5bac3a tempest-AttachVolumeShelveTestJSON-597292271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:19:04 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-bcae91cb-9ee9-4610-a36d-5bbf1a5bac3a tempest-AttachVolumeShelveTestJSON-597292271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:19:04 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-bcae91cb-9ee9-4610-a36d-5bbf1a5bac3a tempest-AttachVolumeShelveTestJSON-597292271 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:19:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-244680260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1719ff05-ee15-4be4-9d6d-8c5532022bda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='532049b9d396498bb6c429896864ed5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:19:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:19:04Z,use_quota=True,user_id='fcf4a550e6c84e7ba2d9f951b1036365',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:19:04 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-bcae91cb-9ee9-4610-a36d-5bbf1a5bac3a tempest-AttachVolumeShelveTestJSON-597292271 None] Creating volume 1719ff05-ee15-4be4-9d6d-8c5532022bda {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:19:04 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-bcae91cb-9ee9-4610-a36d-5bbf1a5bac3a tempest-AttachVolumeShelveTestJSON-597292271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:19:04 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-bcae91cb-9ee9-4610-a36d-5bbf1a5bac3a tempest-AttachVolumeShelveTestJSON-597292271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:19:04 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-bcae91cb-9ee9-4610-a36d-5bbf1a5bac3a tempest-AttachVolumeShelveTestJSON-597292271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:19:04 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-bcae91cb-9ee9-4610-a36d-5bbf1a5bac3a tempest-AttachVolumeShelveTestJSON-597292271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:19:04 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-bcae91cb-9ee9-4610-a36d-5bbf1a5bac3a tempest-AttachVolumeShelveTestJSON-597292271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:19:04 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-bcae91cb-9ee9-4610-a36d-5bbf1a5bac3a tempest-AttachVolumeShelveTestJSON-597292271 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:19:04 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-bcae91cb-9ee9-4610-a36d-5bbf1a5bac3a tempest-AttachVolumeShelveTestJSON-597292271 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:19:04 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-bcae91cb-9ee9-4610-a36d-5bbf1a5bac3a tempest-AttachVolumeShelveTestJSON-597292271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1719ff05-ee15-4be4-9d6d-8c5532022bda 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:19:04 devstack sudo[93268]: pam_unix(sudo:session): session closed for user root Jul 22 03:19:04 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2fa1e86e-c793-452a-8057-609b21c5782d tempest-VolumesTransfersV357Test-297992809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.441s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:19:04 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-2fa1e86e-c793-452a-8057-609b21c5782d tempest-VolumesTransfersV357Test-297992809 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:19:04 devstack sudo[93271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1719ff05-ee15-4be4-9d6d-8c5532022bda 1073741824 Jul 22 03:19:04 devstack sudo[93271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:19:04 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-2fa1e86e-c793-452a-8057-609b21c5782d tempest-VolumesTransfersV357Test-297992809 None] Deleted volume successfully. Jul 22 03:19:04 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-2fa1e86e-c793-452a-8057-609b21c5782d tempest-VolumesTransfersV357Test-297992809 None] Lock "cinder-0b8daf9f-e169-4fd9-a7c5-4048b6fe3f74-delete_volume" released by "delete_volume" :: held 1.539s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:19:05 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-f16600f3-87b9-4931-a6c5-464e011e4521 tempest-GroupsV314Test-154076591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:19:05 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-4985295f-04ff-42d3-abf8-371681c617d1 tempest-VolumesTransfersV357Test-245312544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:19:05 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-4985295f-04ff-42d3-abf8-371681c617d1 tempest-VolumesTransfersV357Test-245312544 None] Flow 'volume_create_manager' (84efeef1-fc6b-4d70-9d81-48278c24b7e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:19:05 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-4985295f-04ff-42d3-abf8-371681c617d1 tempest-VolumesTransfersV357Test-245312544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf0d3d54-3a0f-4092-8a8a-4444df3f6145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:19:05 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-4985295f-04ff-42d3-abf8-371681c617d1 tempest-VolumesTransfersV357Test-245312544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf0d3d54-3a0f-4092-8a8a-4444df3f6145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:19:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-552277928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9496075e-f810-4949-99e0-f2119093fdda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddb5eb2f06e34f84b8362dcbcf0ed82f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:19:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:19:05Z,use_quota=True,user_id='07284f3ec55148a1ae1f0fbd36980530',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:19:05 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-4985295f-04ff-42d3-abf8-371681c617d1 tempest-VolumesTransfersV357Test-245312544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98eb0918-d1e5-4d51-9488-6f09fb5bac6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:19:05 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-4985295f-04ff-42d3-abf8-371681c617d1 tempest-VolumesTransfersV357Test-245312544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98eb0918-d1e5-4d51-9488-6f09fb5bac6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:19:05 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-4985295f-04ff-42d3-abf8-371681c617d1 tempest-VolumesTransfersV357Test-245312544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5999a36d-5268-4e54-9ba8-c2af6932ccf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:19:05 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-4985295f-04ff-42d3-abf8-371681c617d1 tempest-VolumesTransfersV357Test-245312544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5999a36d-5268-4e54-9ba8-c2af6932ccf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9496075e-f810-4949-99e0-f2119093fdda', 'volume_name': 'volume-9496075e-f810-4949-99e0-f2119093fdda', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:19:05 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-4985295f-04ff-42d3-abf8-371681c617d1 tempest-VolumesTransfersV357Test-245312544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1d645a9-e4ab-4540-a4e7-814ef19e8c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:19:05 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-4985295f-04ff-42d3-abf8-371681c617d1 tempest-VolumesTransfersV357Test-245312544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1d645a9-e4ab-4540-a4e7-814ef19e8c6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:19:05 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-4985295f-04ff-42d3-abf8-371681c617d1 tempest-VolumesTransfersV357Test-245312544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c36168e8-50f8-47b0-aa0d-707d1fa9124a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:19:05 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-4985295f-04ff-42d3-abf8-371681c617d1 tempest-VolumesTransfersV357Test-245312544 None] Volume 9496075e-f810-4949-99e0-f2119093fdda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9496075e-f810-4949-99e0-f2119093fdda', 'volume_size': 1} Jul 22 03:19:05 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-4985295f-04ff-42d3-abf8-371681c617d1 tempest-VolumesTransfersV357Test-245312544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:19:05 devstack sudo[93271]: pam_unix(sudo:session): session closed for user root Jul 22 03:19:05 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-bcae91cb-9ee9-4610-a36d-5bbf1a5bac3a tempest-AttachVolumeShelveTestJSON-597292271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1719ff05-ee15-4be4-9d6d-8c5532022bda 1073741824" returned: 0 in 0.606s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:19:05 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-bcae91cb-9ee9-4610-a36d-5bbf1a5bac3a tempest-AttachVolumeShelveTestJSON-597292271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1719ff05-ee15-4be4-9d6d-8c5532022bda {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:19:05 devstack sudo[93277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1719ff05-ee15-4be4-9d6d-8c5532022bda Jul 22 03:19:05 devstack sudo[93277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:19:05 devstack sudo[93277]: pam_unix(sudo:session): session closed for user root Jul 22 03:19:05 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-bcae91cb-9ee9-4610-a36d-5bbf1a5bac3a tempest-AttachVolumeShelveTestJSON-597292271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1719ff05-ee15-4be4-9d6d-8c5532022bda" returned: 0 in 0.266s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:19:05 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-bcae91cb-9ee9-4610-a36d-5bbf1a5bac3a tempest-AttachVolumeShelveTestJSON-597292271 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:19:05 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-bcae91cb-9ee9-4610-a36d-5bbf1a5bac3a tempest-AttachVolumeShelveTestJSON-597292271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:19:05 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-f16600f3-87b9-4931-a6c5-464e011e4521 tempest-GroupsV314Test-154076591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.540s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:19:05 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-f16600f3-87b9-4931-a6c5-464e011e4521 tempest-GroupsV314Test-154076591 None] Cloning volume 23d27957-0077-48d1-aea2-604362199892 to volume 7c5043f0-607f-4766-8a2e-3b0c7947cf10 Jul 22 03:19:05 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-bcae91cb-9ee9-4610-a36d-5bbf1a5bac3a tempest-AttachVolumeShelveTestJSON-597292271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (484496fb-4d56-48a5-8a68-62a65c16bbd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1719ff05-ee15-4be4-9d6d-8c5532022bda', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:19:05 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-bcae91cb-9ee9-4610-a36d-5bbf1a5bac3a tempest-AttachVolumeShelveTestJSON-597292271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c8d5760-ddc2-457c-a9d0-85377b88a28e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:19:05 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-bcae91cb-9ee9-4610-a36d-5bbf1a5bac3a tempest-AttachVolumeShelveTestJSON-597292271 None] Volume volume-1719ff05-ee15-4be4-9d6d-8c5532022bda (1719ff05-ee15-4be4-9d6d-8c5532022bda): created successfully Jul 22 03:19:05 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-bcae91cb-9ee9-4610-a36d-5bbf1a5bac3a tempest-AttachVolumeShelveTestJSON-597292271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c8d5760-ddc2-457c-a9d0-85377b88a28e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:19:05 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-bcae91cb-9ee9-4610-a36d-5bbf1a5bac3a tempest-AttachVolumeShelveTestJSON-597292271 None] Flow 'volume_create_manager' (6bee20ed-c317-4873-93a3-b926aed1b711) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:19:05 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-f16600f3-87b9-4931-a6c5-464e011e4521 tempest-GroupsV314Test-154076591 None] Creating offline snapshot 84294f57-ccb4-4349-9e21-4d6f6cc16c72 of volume 23d27957-0077-48d1-aea2-604362199892 {{(pid=87747) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 03:19:05 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-bcae91cb-9ee9-4610-a36d-5bbf1a5bac3a tempest-AttachVolumeShelveTestJSON-597292271 None] Created volume successfully. Jul 22 03:19:05 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[d98c5dcd-24f0-4bce-9016-2945be71ad76]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:19:05 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f16600f3-87b9-4931-a6c5-464e011e4521 tempest-GroupsV314Test-154076591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-23d27957-0077-48d1-aea2-604362199892 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:19:05 devstack sudo[93280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-23d27957-0077-48d1-aea2-604362199892 Jul 22 03:19:05 devstack sudo[93280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:19:06 devstack sudo[93280]: pam_unix(sudo:session): session closed for user root Jul 22 03:19:06 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f16600f3-87b9-4931-a6c5-464e011e4521 tempest-GroupsV314Test-154076591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-23d27957-0077-48d1-aea2-604362199892" returned: 0 in 0.385s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:19:06 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f16600f3-87b9-4931-a6c5-464e011e4521 tempest-GroupsV314Test-154076591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-23d27957-0077-48d1-aea2-604362199892,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-23d27957-0077-48d1-aea2-604362199892.84294f57-ccb4-4349-9e21-4d6f6cc16c72 1G {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:19:06 devstack sudo[93285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-23d27957-0077-48d1-aea2-604362199892,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-23d27957-0077-48d1-aea2-604362199892.84294f57-ccb4-4349-9e21-4d6f6cc16c72 1G Jul 22 03:19:06 devstack sudo[93285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:19:06 devstack sudo[93285]: pam_unix(sudo:session): session closed for user root Jul 22 03:19:06 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f16600f3-87b9-4931-a6c5-464e011e4521 tempest-GroupsV314Test-154076591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-23d27957-0077-48d1-aea2-604362199892,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-23d27957-0077-48d1-aea2-604362199892.84294f57-ccb4-4349-9e21-4d6f6cc16c72 1G" returned: 0 in 0.454s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:19:06 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f16600f3-87b9-4931-a6c5-464e011e4521 tempest-GroupsV314Test-154076591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23d27957-0077-48d1-aea2-604362199892 -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-23d27957-0077-48d1-aea2-604362199892.84294f57-ccb4-4349-9e21-4d6f6cc16c72 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:19:06 devstack sudo[93295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23d27957-0077-48d1-aea2-604362199892 -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-23d27957-0077-48d1-aea2-604362199892.84294f57-ccb4-4349-9e21-4d6f6cc16c72 Jul 22 03:19:06 devstack sudo[93295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:19:06 devstack sudo[93295]: pam_unix(sudo:session): session closed for user root Jul 22 03:19:06 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f16600f3-87b9-4931-a6c5-464e011e4521 tempest-GroupsV314Test-154076591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23d27957-0077-48d1-aea2-604362199892 -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-23d27957-0077-48d1-aea2-604362199892.84294f57-ccb4-4349-9e21-4d6f6cc16c72" returned: 0 in 0.356s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:19:06 devstack cinder-volume[87747]: WARNING cinder.volume.drivers.remotefs [None req-f16600f3-87b9-4931-a6c5-464e011e4521 tempest-GroupsV314Test-154076591 None] /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-23d27957-0077-48d1-aea2-604362199892.84294f57-ccb4-4349-9e21-4d6f6cc16c72 is being set with open permissions: ugo+rw: NotImplementedError Jul 22 03:19:06 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f16600f3-87b9-4931-a6c5-464e011e4521 tempest-GroupsV314Test-154076591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-23d27957-0077-48d1-aea2-604362199892.84294f57-ccb4-4349-9e21-4d6f6cc16c72 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:19:06 devstack sudo[93300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-23d27957-0077-48d1-aea2-604362199892.84294f57-ccb4-4349-9e21-4d6f6cc16c72 Jul 22 03:19:06 devstack sudo[93300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:19:07 devstack sudo[93300]: pam_unix(sudo:session): session closed for user root Jul 22 03:19:07 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f16600f3-87b9-4931-a6c5-464e011e4521 tempest-GroupsV314Test-154076591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-23d27957-0077-48d1-aea2-604362199892.84294f57-ccb4-4349-9e21-4d6f6cc16c72" returned: 0 in 0.264s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:19:07 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f16600f3-87b9-4931-a6c5-464e011e4521 tempest-GroupsV314Test-154076591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-23d27957-0077-48d1-aea2-604362199892.info {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:19:07 devstack sudo[93303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-23d27957-0077-48d1-aea2-604362199892.info Jul 22 03:19:07 devstack sudo[93303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:19:07 devstack sudo[93303]: pam_unix(sudo:session): session closed for user root Jul 22 03:19:07 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f16600f3-87b9-4931-a6c5-464e011e4521 tempest-GroupsV314Test-154076591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-23d27957-0077-48d1-aea2-604362199892.info" returned: 0 in 0.267s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:19:07 devstack cinder-volume[87747]: WARNING cinder.volume.drivers.remotefs [None req-f16600f3-87b9-4931-a6c5-464e011e4521 tempest-GroupsV314Test-154076591 None] /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-23d27957-0077-48d1-aea2-604362199892.info is being set with open permissions: ugo+rw: NotImplementedError Jul 22 03:19:07 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f16600f3-87b9-4931-a6c5-464e011e4521 tempest-GroupsV314Test-154076591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-23d27957-0077-48d1-aea2-604362199892.info {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:19:07 devstack sudo[93306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-23d27957-0077-48d1-aea2-604362199892.info Jul 22 03:19:07 devstack sudo[93306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:19:07 devstack sudo[93306]: pam_unix(sudo:session): session closed for user root Jul 22 03:19:07 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f16600f3-87b9-4931-a6c5-464e011e4521 tempest-GroupsV314Test-154076591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-23d27957-0077-48d1-aea2-604362199892.info" returned: 0 in 0.258s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:19:07 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-f16600f3-87b9-4931-a6c5-464e011e4521 tempest-GroupsV314Test-154076591 None] Acquiring lock "cinder-quobyte-7c5043f0-607f-4766-8a2e-3b0c7947cf10" by "_copy_volume_from_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:19:07 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-f16600f3-87b9-4931-a6c5-464e011e4521 tempest-GroupsV314Test-154076591 None] Lock "cinder-quobyte-7c5043f0-607f-4766-8a2e-3b0c7947cf10" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:19:07 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-f16600f3-87b9-4931-a6c5-464e011e4521 tempest-GroupsV314Test-154076591 None] snapshot: 84294f57-ccb4-4349-9e21-4d6f6cc16c72, volume: 7c5043f0-607f-4766-8a2e-3b0c7947cf10, {{(pid=87747) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 22 03:19:07 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-f16600f3-87b9-4931-a6c5-464e011e4521 tempest-GroupsV314Test-154076591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:19:07 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-f16600f3-87b9-4931-a6c5-464e011e4521 tempest-GroupsV314Test-154076591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:19:07 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-f16600f3-87b9-4931-a6c5-464e011e4521 tempest-GroupsV314Test-154076591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:19:07 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-f16600f3-87b9-4931-a6c5-464e011e4521 tempest-GroupsV314Test-154076591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:19:07 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-f16600f3-87b9-4931-a6c5-464e011e4521 tempest-GroupsV314Test-154076591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:19:07 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d9b4b55-8f87-49fa-ba13-93a07591be99]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:19:07 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f16600f3-87b9-4931-a6c5-464e011e4521 tempest-GroupsV314Test-154076591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-23d27957-0077-48d1-aea2-604362199892.84294f57-ccb4-4349-9e21-4d6f6cc16c72 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:19:07 devstack sudo[93309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-23d27957-0077-48d1-aea2-604362199892.84294f57-ccb4-4349-9e21-4d6f6cc16c72 Jul 22 03:19:07 devstack sudo[93309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:19:08 devstack sudo[93309]: pam_unix(sudo:session): session closed for user root Jul 22 03:19:08 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f16600f3-87b9-4931-a6c5-464e011e4521 tempest-GroupsV314Test-154076591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-23d27957-0077-48d1-aea2-604362199892.84294f57-ccb4-4349-9e21-4d6f6cc16c72" returned: 0 in 0.456s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:19:08 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-f16600f3-87b9-4931-a6c5-464e011e4521 tempest-GroupsV314Test-154076591 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-23d27957-0077-48d1-aea2-604362199892(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87747) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 03:19:08 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-f16600f3-87b9-4931-a6c5-464e011e4521 tempest-GroupsV314Test-154076591 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-23d27957-0077-48d1-aea2-604362199892 {{(pid=87747) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 22 03:19:08 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-f16600f3-87b9-4931-a6c5-464e011e4521 tempest-GroupsV314Test-154076591 None] Creating direct copy from snapshot {{(pid=87747) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 22 03:19:08 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[4425d286-e7ec-41f5-924f-72711ade2490]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:19:08 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f16600f3-87b9-4931-a6c5-464e011e4521 tempest-GroupsV314Test-154076591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-23d27957-0077-48d1-aea2-604362199892 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:19:08 devstack sudo[93318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-23d27957-0077-48d1-aea2-604362199892 Jul 22 03:19:08 devstack sudo[93318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:19:08 devstack sudo[93318]: pam_unix(sudo:session): session closed for user root Jul 22 03:19:08 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f16600f3-87b9-4931-a6c5-464e011e4521 tempest-GroupsV314Test-154076591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-23d27957-0077-48d1-aea2-604362199892" returned: 0 in 0.414s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:19:08 devstack cinder-volume[87747]: DEBUG cinder.utils [None req-f16600f3-87b9-4931-a6c5-464e011e4521 tempest-GroupsV314Test-154076591 None] Path /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-7c5043f0-607f-4766-8a2e-3b0c7947cf10 not found in is_blk_device check {{(pid=87747) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 22 03:19:08 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f16600f3-87b9-4931-a6c5-464e011e4521 tempest-GroupsV314Test-154076591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-23d27957-0077-48d1-aea2-604362199892 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-7c5043f0-607f-4766-8a2e-3b0c7947cf10 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:19:08 devstack sudo[93328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-23d27957-0077-48d1-aea2-604362199892 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-7c5043f0-607f-4766-8a2e-3b0c7947cf10 Jul 22 03:19:08 devstack sudo[93328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:19:14 devstack sudo[93328]: pam_unix(sudo:session): session closed for user root Jul 22 03:19:14 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f16600f3-87b9-4931-a6c5-464e011e4521 tempest-GroupsV314Test-154076591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-23d27957-0077-48d1-aea2-604362199892 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-7c5043f0-607f-4766-8a2e-3b0c7947cf10" returned: 0 in 6.005s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:19:14 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6bf4bfc-cd0a-4502-8705-c7ab15f566d6]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:19:14 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f16600f3-87b9-4931-a6c5-464e011e4521 tempest-GroupsV314Test-154076591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-23d27957-0077-48d1-aea2-604362199892 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:19:14 devstack sudo[93374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-23d27957-0077-48d1-aea2-604362199892 Jul 22 03:19:14 devstack sudo[93374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:19:15 devstack sudo[93374]: pam_unix(sudo:session): session closed for user root Jul 22 03:19:15 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f16600f3-87b9-4931-a6c5-464e011e4521 tempest-GroupsV314Test-154076591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-23d27957-0077-48d1-aea2-604362199892" returned: 0 in 0.595s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:19:15 devstack cinder-volume[87747]: DEBUG cinder.image.image_utils [None req-f16600f3-87b9-4931-a6c5-464e011e4521 tempest-GroupsV314Test-154076591 None] Image conversion details: src /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-23d27957-0077-48d1-aea2-604362199892, size 1024.00 MB, duration 6.01 sec, destination /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-7c5043f0-607f-4766-8a2e-3b0c7947cf10 {{(pid=87747) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 22 03:19:15 devstack cinder-volume[87747]: INFO cinder.image.image_utils [None req-f16600f3-87b9-4931-a6c5-464e011e4521 tempest-GroupsV314Test-154076591 None] Converted 1024.00 MB image at 170.48 MB/s Jul 22 03:19:15 devstack cinder-volume[87747]: WARNING cinder.volume.drivers.remotefs [None req-f16600f3-87b9-4931-a6c5-464e011e4521 tempest-GroupsV314Test-154076591 None] /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-7c5043f0-607f-4766-8a2e-3b0c7947cf10 is being set with open permissions: ugo+rw: NotImplementedError Jul 22 03:19:15 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f16600f3-87b9-4931-a6c5-464e011e4521 tempest-GroupsV314Test-154076591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-7c5043f0-607f-4766-8a2e-3b0c7947cf10 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:19:15 devstack sudo[93379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-7c5043f0-607f-4766-8a2e-3b0c7947cf10 Jul 22 03:19:15 devstack sudo[93379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:19:15 devstack sudo[93379]: pam_unix(sudo:session): session closed for user root Jul 22 03:19:15 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f16600f3-87b9-4931-a6c5-464e011e4521 tempest-GroupsV314Test-154076591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-7c5043f0-607f-4766-8a2e-3b0c7947cf10" returned: 0 in 0.260s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:19:15 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-f16600f3-87b9-4931-a6c5-464e011e4521 tempest-GroupsV314Test-154076591 None] Lock "cinder-quobyte-7c5043f0-607f-4766-8a2e-3b0c7947cf10" released by "_copy_volume_from_snapshot" :: held 7.847s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:19:15 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-f16600f3-87b9-4931-a6c5-464e011e4521 tempest-GroupsV314Test-154076591 None] Acquiring lock "cinder-quobyte-84294f57-ccb4-4349-9e21-4d6f6cc16c72" by "_delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:19:15 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-f16600f3-87b9-4931-a6c5-464e011e4521 tempest-GroupsV314Test-154076591 None] Lock "cinder-quobyte-84294f57-ccb4-4349-9e21-4d6f6cc16c72" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:19:15 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-f16600f3-87b9-4931-a6c5-464e011e4521 tempest-GroupsV314Test-154076591 None] Deleting offline snapshot 84294f57-ccb4-4349-9e21-4d6f6cc16c72 of volume 23d27957-0077-48d1-aea2-604362199892 {{(pid=87747) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 03:19:15 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-f16600f3-87b9-4931-a6c5-464e011e4521 tempest-GroupsV314Test-154076591 None] snapshot_file for this snap is: volume-23d27957-0077-48d1-aea2-604362199892.84294f57-ccb4-4349-9e21-4d6f6cc16c72 {{(pid=87747) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 03:19:15 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[40aa5d5b-91d4-4db5-ae8d-b3654c26abf0]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:19:15 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f16600f3-87b9-4931-a6c5-464e011e4521 tempest-GroupsV314Test-154076591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-23d27957-0077-48d1-aea2-604362199892.84294f57-ccb4-4349-9e21-4d6f6cc16c72 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:19:15 devstack sudo[93382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-23d27957-0077-48d1-aea2-604362199892.84294f57-ccb4-4349-9e21-4d6f6cc16c72 Jul 22 03:19:15 devstack sudo[93382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:19:16 devstack sudo[93382]: pam_unix(sudo:session): session closed for user root Jul 22 03:19:16 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f16600f3-87b9-4931-a6c5-464e011e4521 tempest-GroupsV314Test-154076591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-23d27957-0077-48d1-aea2-604362199892.84294f57-ccb4-4349-9e21-4d6f6cc16c72" returned: 0 in 0.399s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:19:16 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-f16600f3-87b9-4931-a6c5-464e011e4521 tempest-GroupsV314Test-154076591 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-23d27957-0077-48d1-aea2-604362199892(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87747) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 03:19:16 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7c79d9e-c7ca-4505-8650-2c0d63c01b3f]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:19:16 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f16600f3-87b9-4931-a6c5-464e011e4521 tempest-GroupsV314Test-154076591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-23d27957-0077-48d1-aea2-604362199892 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:19:16 devstack sudo[93388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-23d27957-0077-48d1-aea2-604362199892 Jul 22 03:19:16 devstack sudo[93388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:19:16 devstack sudo[93388]: pam_unix(sudo:session): session closed for user root Jul 22 03:19:16 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f16600f3-87b9-4931-a6c5-464e011e4521 tempest-GroupsV314Test-154076591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-23d27957-0077-48d1-aea2-604362199892" returned: 0 in 0.434s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:19:16 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f16600f3-87b9-4931-a6c5-464e011e4521 tempest-GroupsV314Test-154076591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-23d27957-0077-48d1-aea2-604362199892.84294f57-ccb4-4349-9e21-4d6f6cc16c72 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:19:16 devstack sudo[93393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-23d27957-0077-48d1-aea2-604362199892.84294f57-ccb4-4349-9e21-4d6f6cc16c72 Jul 22 03:19:16 devstack sudo[93393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:19:16 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-45efbfab-0b68-485c-afc4-ac65e1dcf185 tempest-AbsoluteLimitsTests-1362953827 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:19:16 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-45efbfab-0b68-485c-afc4-ac65e1dcf185 tempest-AbsoluteLimitsTests-1362953827 None] Flow 'volume_create_manager' (2d555785-58da-4437-af1c-7992b66195fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:19:16 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-45efbfab-0b68-485c-afc4-ac65e1dcf185 tempest-AbsoluteLimitsTests-1362953827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d91350b7-b6bc-426c-a501-fa67ef460c7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:19:16 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-45efbfab-0b68-485c-afc4-ac65e1dcf185 tempest-AbsoluteLimitsTests-1362953827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d91350b7-b6bc-426c-a501-fa67ef460c7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:19:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1642349305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cdbae99-9c97-46eb-9580-71b98eaaacdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bb6a587b90644008184b4f19bccf582',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:19:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:19:17Z,use_quota=True,user_id='3c986c60e2e94528a9fb30378aac0049',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:19:16 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-45efbfab-0b68-485c-afc4-ac65e1dcf185 tempest-AbsoluteLimitsTests-1362953827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b15afa09-43df-4030-9265-8b7356acd868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:19:16 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-45efbfab-0b68-485c-afc4-ac65e1dcf185 tempest-AbsoluteLimitsTests-1362953827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b15afa09-43df-4030-9265-8b7356acd868) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:19:16 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-45efbfab-0b68-485c-afc4-ac65e1dcf185 tempest-AbsoluteLimitsTests-1362953827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24a0088d-cc92-475e-a586-0be2c46d4959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:19:16 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-45efbfab-0b68-485c-afc4-ac65e1dcf185 tempest-AbsoluteLimitsTests-1362953827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24a0088d-cc92-475e-a586-0be2c46d4959) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1cdbae99-9c97-46eb-9580-71b98eaaacdb', 'volume_name': 'volume-1cdbae99-9c97-46eb-9580-71b98eaaacdb', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:19:16 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-45efbfab-0b68-485c-afc4-ac65e1dcf185 tempest-AbsoluteLimitsTests-1362953827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cf1cc1a-59f2-4ba4-bafa-b63e94cb9854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:19:16 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-45efbfab-0b68-485c-afc4-ac65e1dcf185 tempest-AbsoluteLimitsTests-1362953827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cf1cc1a-59f2-4ba4-bafa-b63e94cb9854) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:19:16 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-45efbfab-0b68-485c-afc4-ac65e1dcf185 tempest-AbsoluteLimitsTests-1362953827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d99a2a9-edac-46ce-b730-8e5e5ff024df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:19:16 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-45efbfab-0b68-485c-afc4-ac65e1dcf185 tempest-AbsoluteLimitsTests-1362953827 None] Volume 1cdbae99-9c97-46eb-9580-71b98eaaacdb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1cdbae99-9c97-46eb-9580-71b98eaaacdb', 'volume_size': 1} Jul 22 03:19:16 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-45efbfab-0b68-485c-afc4-ac65e1dcf185 tempest-AbsoluteLimitsTests-1362953827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:19:16 devstack sudo[93393]: pam_unix(sudo:session): session closed for user root Jul 22 03:19:16 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f16600f3-87b9-4931-a6c5-464e011e4521 tempest-GroupsV314Test-154076591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-23d27957-0077-48d1-aea2-604362199892.84294f57-ccb4-4349-9e21-4d6f6cc16c72" returned: 0 in 0.389s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:19:16 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f16600f3-87b9-4931-a6c5-464e011e4521 tempest-GroupsV314Test-154076591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-23d27957-0077-48d1-aea2-604362199892.84294f57-ccb4-4349-9e21-4d6f6cc16c72 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:19:16 devstack sudo[93398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-23d27957-0077-48d1-aea2-604362199892.84294f57-ccb4-4349-9e21-4d6f6cc16c72 Jul 22 03:19:16 devstack sudo[93398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:19:17 devstack sudo[93398]: pam_unix(sudo:session): session closed for user root Jul 22 03:19:17 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f16600f3-87b9-4931-a6c5-464e011e4521 tempest-GroupsV314Test-154076591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-23d27957-0077-48d1-aea2-604362199892.84294f57-ccb4-4349-9e21-4d6f6cc16c72" returned: 0 in 0.307s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:19:17 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-f16600f3-87b9-4931-a6c5-464e011e4521 tempest-GroupsV314Test-154076591 None] Lock "cinder-quobyte-84294f57-ccb4-4349-9e21-4d6f6cc16c72" released by "_delete_snapshot" :: held 1.685s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:19:17 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-f16600f3-87b9-4931-a6c5-464e011e4521 tempest-GroupsV314Test-154076591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.818s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:19:17 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-4985295f-04ff-42d3-abf8-371681c617d1 tempest-VolumesTransfersV357Test-245312544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.171s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:19:17 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-4985295f-04ff-42d3-abf8-371681c617d1 tempest-VolumesTransfersV357Test-245312544 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:19:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-552277928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9496075e-f810-4949-99e0-f2119093fdda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddb5eb2f06e34f84b8362dcbcf0ed82f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:19:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:19:05Z,use_quota=True,user_id='07284f3ec55148a1ae1f0fbd36980530',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:19:17 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-4985295f-04ff-42d3-abf8-371681c617d1 tempest-VolumesTransfersV357Test-245312544 None] Creating volume 9496075e-f810-4949-99e0-f2119093fdda {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:19:17 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-4985295f-04ff-42d3-abf8-371681c617d1 tempest-VolumesTransfersV357Test-245312544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:19:17 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-4985295f-04ff-42d3-abf8-371681c617d1 tempest-VolumesTransfersV357Test-245312544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:19:17 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-4985295f-04ff-42d3-abf8-371681c617d1 tempest-VolumesTransfersV357Test-245312544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:19:17 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-4985295f-04ff-42d3-abf8-371681c617d1 tempest-VolumesTransfersV357Test-245312544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:19:17 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-4985295f-04ff-42d3-abf8-371681c617d1 tempest-VolumesTransfersV357Test-245312544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:19:17 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-4985295f-04ff-42d3-abf8-371681c617d1 tempest-VolumesTransfersV357Test-245312544 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:19:17 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-4985295f-04ff-42d3-abf8-371681c617d1 tempest-VolumesTransfersV357Test-245312544 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:19:17 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-4985295f-04ff-42d3-abf8-371681c617d1 tempest-VolumesTransfersV357Test-245312544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9496075e-f810-4949-99e0-f2119093fdda 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:19:17 devstack sudo[93404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9496075e-f810-4949-99e0-f2119093fdda 1073741824 Jul 22 03:19:17 devstack sudo[93404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:19:17 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-f16600f3-87b9-4931-a6c5-464e011e4521 tempest-GroupsV314Test-154076591 None] Create group from source-group-f3e3a4df-0e7e-4b76-89dc-1166909c3468 completed successfully. Jul 22 03:19:17 devstack sudo[93404]: pam_unix(sudo:session): session closed for user root Jul 22 03:19:17 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-4985295f-04ff-42d3-abf8-371681c617d1 tempest-VolumesTransfersV357Test-245312544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9496075e-f810-4949-99e0-f2119093fdda 1073741824" returned: 0 in 0.602s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:19:18 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-4985295f-04ff-42d3-abf8-371681c617d1 tempest-VolumesTransfersV357Test-245312544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9496075e-f810-4949-99e0-f2119093fdda {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:19:18 devstack sudo[93426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9496075e-f810-4949-99e0-f2119093fdda Jul 22 03:19:18 devstack sudo[93426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:19:18 devstack sudo[93426]: pam_unix(sudo:session): session closed for user root Jul 22 03:19:18 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-4985295f-04ff-42d3-abf8-371681c617d1 tempest-VolumesTransfersV357Test-245312544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9496075e-f810-4949-99e0-f2119093fdda" returned: 0 in 0.258s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:19:18 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-4985295f-04ff-42d3-abf8-371681c617d1 tempest-VolumesTransfersV357Test-245312544 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:19:18 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-4985295f-04ff-42d3-abf8-371681c617d1 tempest-VolumesTransfersV357Test-245312544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:19:18 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-45efbfab-0b68-485c-afc4-ac65e1dcf185 tempest-AbsoluteLimitsTests-1362953827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.602s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:19:18 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-45efbfab-0b68-485c-afc4-ac65e1dcf185 tempest-AbsoluteLimitsTests-1362953827 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:19:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1642349305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cdbae99-9c97-46eb-9580-71b98eaaacdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bb6a587b90644008184b4f19bccf582',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:19:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:19:17Z,use_quota=True,user_id='3c986c60e2e94528a9fb30378aac0049',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:19:18 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-45efbfab-0b68-485c-afc4-ac65e1dcf185 tempest-AbsoluteLimitsTests-1362953827 None] Creating volume 1cdbae99-9c97-46eb-9580-71b98eaaacdb {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:19:18 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-45efbfab-0b68-485c-afc4-ac65e1dcf185 tempest-AbsoluteLimitsTests-1362953827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:19:18 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-45efbfab-0b68-485c-afc4-ac65e1dcf185 tempest-AbsoluteLimitsTests-1362953827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:19:18 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-45efbfab-0b68-485c-afc4-ac65e1dcf185 tempest-AbsoluteLimitsTests-1362953827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:19:18 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-45efbfab-0b68-485c-afc4-ac65e1dcf185 tempest-AbsoluteLimitsTests-1362953827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:19:18 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-45efbfab-0b68-485c-afc4-ac65e1dcf185 tempest-AbsoluteLimitsTests-1362953827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:19:18 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-45efbfab-0b68-485c-afc4-ac65e1dcf185 tempest-AbsoluteLimitsTests-1362953827 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:19:18 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-45efbfab-0b68-485c-afc4-ac65e1dcf185 tempest-AbsoluteLimitsTests-1362953827 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:19:18 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-45efbfab-0b68-485c-afc4-ac65e1dcf185 tempest-AbsoluteLimitsTests-1362953827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1cdbae99-9c97-46eb-9580-71b98eaaacdb 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:19:18 devstack sudo[93429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1cdbae99-9c97-46eb-9580-71b98eaaacdb 1073741824 Jul 22 03:19:18 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-4985295f-04ff-42d3-abf8-371681c617d1 tempest-VolumesTransfersV357Test-245312544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c36168e8-50f8-47b0-aa0d-707d1fa9124a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9496075e-f810-4949-99e0-f2119093fdda', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:19:18 devstack sudo[93429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:19:18 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-4985295f-04ff-42d3-abf8-371681c617d1 tempest-VolumesTransfersV357Test-245312544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15ba7f1e-cd6e-4d3b-a2ff-a5d078192f64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:19:18 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-4985295f-04ff-42d3-abf8-371681c617d1 tempest-VolumesTransfersV357Test-245312544 None] Volume volume-9496075e-f810-4949-99e0-f2119093fdda (9496075e-f810-4949-99e0-f2119093fdda): created successfully Jul 22 03:19:18 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-4985295f-04ff-42d3-abf8-371681c617d1 tempest-VolumesTransfersV357Test-245312544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15ba7f1e-cd6e-4d3b-a2ff-a5d078192f64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:19:18 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-4985295f-04ff-42d3-abf8-371681c617d1 tempest-VolumesTransfersV357Test-245312544 None] Flow 'volume_create_manager' (84efeef1-fc6b-4d70-9d81-48278c24b7e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:19:18 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-4985295f-04ff-42d3-abf8-371681c617d1 tempest-VolumesTransfersV357Test-245312544 None] Created volume successfully. Jul 22 03:19:18 devstack sudo[93429]: pam_unix(sudo:session): session closed for user root Jul 22 03:19:18 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-45efbfab-0b68-485c-afc4-ac65e1dcf185 tempest-AbsoluteLimitsTests-1362953827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1cdbae99-9c97-46eb-9580-71b98eaaacdb 1073741824" returned: 0 in 0.517s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:19:18 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-92532aac-6fef-49fc-85f7-9c870faab121 tempest-GroupsV314Test-154076591 None] Acquiring lock "cinder-quobyte-7c5043f0-607f-4766-8a2e-3b0c7947cf10" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:19:18 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-92532aac-6fef-49fc-85f7-9c870faab121 tempest-GroupsV314Test-154076591 None] Lock "cinder-quobyte-7c5043f0-607f-4766-8a2e-3b0c7947cf10" acquired by "delete_volume" :: waited 0.019s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:19:18 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8a34811-14e5-41a2-b11f-22aa0fdc7587]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:19:18 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-92532aac-6fef-49fc-85f7-9c870faab121 tempest-GroupsV314Test-154076591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-7c5043f0-607f-4766-8a2e-3b0c7947cf10 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:19:18 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-45efbfab-0b68-485c-afc4-ac65e1dcf185 tempest-AbsoluteLimitsTests-1362953827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1cdbae99-9c97-46eb-9580-71b98eaaacdb {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:19:18 devstack sudo[93436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1cdbae99-9c97-46eb-9580-71b98eaaacdb Jul 22 03:19:18 devstack sudo[93436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:19:19 devstack sudo[93435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-7c5043f0-607f-4766-8a2e-3b0c7947cf10 Jul 22 03:19:19 devstack sudo[93435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:19:19 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [req-d793bd7d-4c56-4768-a5fb-90d0d99e40de req-f216f492-7ae5-4ea7-8826-e1607f62765a tempest-AttachVolumeShelveTestJSON-597292271 None] No connector for attachment c1bf8af6-4122-4660-b062-8162f6dc7953; skipping storage backend terminate_connection call. {{(pid=87747) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 22 03:19:19 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [req-d793bd7d-4c56-4768-a5fb-90d0d99e40de req-f216f492-7ae5-4ea7-8826-e1607f62765a tempest-AttachVolumeShelveTestJSON-597292271 None] Deleting attachment c1bf8af6-4122-4660-b062-8162f6dc7953. {{(pid=87747) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 22 03:19:19 devstack sudo[93436]: pam_unix(sudo:session): session closed for user root Jul 22 03:19:19 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-45efbfab-0b68-485c-afc4-ac65e1dcf185 tempest-AbsoluteLimitsTests-1362953827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1cdbae99-9c97-46eb-9580-71b98eaaacdb" returned: 0 in 0.294s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:19:19 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-45efbfab-0b68-485c-afc4-ac65e1dcf185 tempest-AbsoluteLimitsTests-1362953827 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:19:19 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-45efbfab-0b68-485c-afc4-ac65e1dcf185 tempest-AbsoluteLimitsTests-1362953827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:19:19 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-45efbfab-0b68-485c-afc4-ac65e1dcf185 tempest-AbsoluteLimitsTests-1362953827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d99a2a9-edac-46ce-b730-8e5e5ff024df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1cdbae99-9c97-46eb-9580-71b98eaaacdb', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:19:19 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-45efbfab-0b68-485c-afc4-ac65e1dcf185 tempest-AbsoluteLimitsTests-1362953827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aff52162-b987-40d2-b045-dd6a6dcefbc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:19:19 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-45efbfab-0b68-485c-afc4-ac65e1dcf185 tempest-AbsoluteLimitsTests-1362953827 None] Volume volume-1cdbae99-9c97-46eb-9580-71b98eaaacdb (1cdbae99-9c97-46eb-9580-71b98eaaacdb): created successfully Jul 22 03:19:19 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-45efbfab-0b68-485c-afc4-ac65e1dcf185 tempest-AbsoluteLimitsTests-1362953827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aff52162-b987-40d2-b045-dd6a6dcefbc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:19:19 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-45efbfab-0b68-485c-afc4-ac65e1dcf185 tempest-AbsoluteLimitsTests-1362953827 None] Flow 'volume_create_manager' (2d555785-58da-4437-af1c-7992b66195fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:19:19 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-45efbfab-0b68-485c-afc4-ac65e1dcf185 tempest-AbsoluteLimitsTests-1362953827 None] Created volume successfully. Jul 22 03:19:19 devstack sudo[93435]: pam_unix(sudo:session): session closed for user root Jul 22 03:19:19 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-92532aac-6fef-49fc-85f7-9c870faab121 tempest-GroupsV314Test-154076591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-7c5043f0-607f-4766-8a2e-3b0c7947cf10" returned: 0 in 0.453s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:19:19 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-92532aac-6fef-49fc-85f7-9c870faab121 tempest-GroupsV314Test-154076591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-7c5043f0-607f-4766-8a2e-3b0c7947cf10 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:19:19 devstack sudo[93443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-7c5043f0-607f-4766-8a2e-3b0c7947cf10 Jul 22 03:19:19 devstack sudo[93443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:19:19 devstack sudo[93443]: pam_unix(sudo:session): session closed for user root Jul 22 03:19:19 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-92532aac-6fef-49fc-85f7-9c870faab121 tempest-GroupsV314Test-154076591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-7c5043f0-607f-4766-8a2e-3b0c7947cf10" returned: 0 in 0.300s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:19:19 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-92532aac-6fef-49fc-85f7-9c870faab121 tempest-GroupsV314Test-154076591 None] Lock "cinder-quobyte-7c5043f0-607f-4766-8a2e-3b0c7947cf10" released by "delete_volume" :: held 0.815s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:19:19 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-92532aac-6fef-49fc-85f7-9c870faab121 tempest-GroupsV314Test-154076591 None] Created reservations ['7aad0726-d7f6-4689-be78-9815f018b97f'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:19:19 devstack cinder-volume[87747]: WARNING cinder.quota [None req-92532aac-6fef-49fc-85f7-9c870faab121 tempest-GroupsV314Test-154076591 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-374304917 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-374304917, it is now deprecated. Please use the default quota class for default quota. Jul 22 03:19:19 devstack cinder-volume[87747]: WARNING cinder.quota [None req-92532aac-6fef-49fc-85f7-9c870faab121 tempest-GroupsV314Test-154076591 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-374304917 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-374304917, it is now deprecated. Please use the default quota class for default quota. Jul 22 03:19:19 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-92532aac-6fef-49fc-85f7-9c870faab121 tempest-GroupsV314Test-154076591 None] Created reservations ['3bdb6718-291d-4cc4-a09e-afd9a4fb4194', '8cb32926-5fc0-4ccb-9839-66fbc9bdf373', '06adb768-76a2-472e-9870-ff37101d4407', '983891ae-8b1a-4df6-88c3-ac8d64712e24'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:19:19 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-d918330b-a7fe-41df-a921-b0d0fa8d9ea2 tempest-VolumesTransfersV357Test-297992809 None] Acquiring lock "cinder-9496075e-f810-4949-99e0-f2119093fdda-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:19:19 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-d918330b-a7fe-41df-a921-b0d0fa8d9ea2 tempest-VolumesTransfersV357Test-297992809 None] Lock "cinder-9496075e-f810-4949-99e0-f2119093fdda-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:19:19 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-d918330b-a7fe-41df-a921-b0d0fa8d9ea2 tempest-VolumesTransfersV357Test-297992809 None] Acquiring lock "cinder-quobyte-9496075e-f810-4949-99e0-f2119093fdda" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:19:20 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-d918330b-a7fe-41df-a921-b0d0fa8d9ea2 tempest-VolumesTransfersV357Test-297992809 None] Lock "cinder-quobyte-9496075e-f810-4949-99e0-f2119093fdda" acquired by "delete_volume" :: waited 0.042s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:19:20 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-e22539b1-9d0e-4899-8bfb-10b49512a7bd tempest-AbsoluteLimitsTests-1362953827 None] Acquiring lock "cinder-1cdbae99-9c97-46eb-9580-71b98eaaacdb-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:19:20 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[94ab87c9-2d23-429b-b82f-620c258f0170]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:19:20 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d918330b-a7fe-41df-a921-b0d0fa8d9ea2 tempest-VolumesTransfersV357Test-297992809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9496075e-f810-4949-99e0-f2119093fdda {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:19:20 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-e22539b1-9d0e-4899-8bfb-10b49512a7bd tempest-AbsoluteLimitsTests-1362953827 None] Lock "cinder-1cdbae99-9c97-46eb-9580-71b98eaaacdb-delete_volume" acquired by "delete_volume" :: waited 0.082s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:19:20 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-92532aac-6fef-49fc-85f7-9c870faab121 tempest-GroupsV314Test-154076591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:19:20 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-92532aac-6fef-49fc-85f7-9c870faab121 tempest-GroupsV314Test-154076591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:19:20 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-92532aac-6fef-49fc-85f7-9c870faab121 tempest-GroupsV314Test-154076591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:19:20 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-92532aac-6fef-49fc-85f7-9c870faab121 tempest-GroupsV314Test-154076591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:19:20 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-92532aac-6fef-49fc-85f7-9c870faab121 tempest-GroupsV314Test-154076591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:19:20 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-92532aac-6fef-49fc-85f7-9c870faab121 tempest-GroupsV314Test-154076591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:19:20 devstack sudo[93448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:19:20 devstack sudo[93448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:19:20 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-e22539b1-9d0e-4899-8bfb-10b49512a7bd tempest-AbsoluteLimitsTests-1362953827 None] Acquiring lock "cinder-quobyte-1cdbae99-9c97-46eb-9580-71b98eaaacdb" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:19:20 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-e22539b1-9d0e-4899-8bfb-10b49512a7bd tempest-AbsoluteLimitsTests-1362953827 None] Lock "cinder-quobyte-1cdbae99-9c97-46eb-9580-71b98eaaacdb" acquired by "delete_volume" :: waited 0.031s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:19:20 devstack sudo[93447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9496075e-f810-4949-99e0-f2119093fdda Jul 22 03:19:20 devstack sudo[93447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:19:20 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[064a729f-dc51-445e-b540-2cb6b893494d]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:19:20 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-e22539b1-9d0e-4899-8bfb-10b49512a7bd tempest-AbsoluteLimitsTests-1362953827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1cdbae99-9c97-46eb-9580-71b98eaaacdb {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:19:20 devstack sudo[93451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1cdbae99-9c97-46eb-9580-71b98eaaacdb Jul 22 03:19:20 devstack sudo[93451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:19:20 devstack sudo[93448]: pam_unix(sudo:session): session closed for user root Jul 22 03:19:20 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-92532aac-6fef-49fc-85f7-9c870faab121 tempest-GroupsV314Test-154076591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.278s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:19:20 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-92532aac-6fef-49fc-85f7-9c870faab121 tempest-GroupsV314Test-154076591 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:19:20 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-92532aac-6fef-49fc-85f7-9c870faab121 tempest-GroupsV314Test-154076591 None] Delete group completed successfully. Jul 22 03:19:20 devstack sudo[93447]: pam_unix(sudo:session): session closed for user root Jul 22 03:19:20 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d918330b-a7fe-41df-a921-b0d0fa8d9ea2 tempest-VolumesTransfersV357Test-297992809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9496075e-f810-4949-99e0-f2119093fdda" returned: 0 in 0.435s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:19:20 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d918330b-a7fe-41df-a921-b0d0fa8d9ea2 tempest-VolumesTransfersV357Test-297992809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9496075e-f810-4949-99e0-f2119093fdda {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:19:20 devstack sudo[93460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9496075e-f810-4949-99e0-f2119093fdda Jul 22 03:19:20 devstack sudo[93460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:19:20 devstack sudo[93451]: pam_unix(sudo:session): session closed for user root Jul 22 03:19:20 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-e22539b1-9d0e-4899-8bfb-10b49512a7bd tempest-AbsoluteLimitsTests-1362953827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1cdbae99-9c97-46eb-9580-71b98eaaacdb" returned: 0 in 0.403s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:19:20 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-e22539b1-9d0e-4899-8bfb-10b49512a7bd tempest-AbsoluteLimitsTests-1362953827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1cdbae99-9c97-46eb-9580-71b98eaaacdb {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:19:20 devstack sudo[93465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1cdbae99-9c97-46eb-9580-71b98eaaacdb Jul 22 03:19:20 devstack sudo[93465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:19:20 devstack sudo[93460]: pam_unix(sudo:session): session closed for user root Jul 22 03:19:20 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d918330b-a7fe-41df-a921-b0d0fa8d9ea2 tempest-VolumesTransfersV357Test-297992809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9496075e-f810-4949-99e0-f2119093fdda" returned: 0 in 0.252s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:19:20 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-d918330b-a7fe-41df-a921-b0d0fa8d9ea2 tempest-VolumesTransfersV357Test-297992809 None] Lock "cinder-quobyte-9496075e-f810-4949-99e0-f2119093fdda" released by "delete_volume" :: held 0.801s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:19:20 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-d918330b-a7fe-41df-a921-b0d0fa8d9ea2 tempest-VolumesTransfersV357Test-297992809 None] Created reservations ['5ae85f9f-9ce2-4733-b654-4d77b9e5fa27', '58cf41ca-7c55-49ca-8e6f-d2e2a9d0c5b8', '6eb59535-e77b-4984-b47a-e571e786e7f6', '01a756f9-9a05-4eb3-8048-559d09b13fe1'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:19:20 devstack sudo[93465]: pam_unix(sudo:session): session closed for user root Jul 22 03:19:20 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-e22539b1-9d0e-4899-8bfb-10b49512a7bd tempest-AbsoluteLimitsTests-1362953827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1cdbae99-9c97-46eb-9580-71b98eaaacdb" returned: 0 in 0.278s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:19:20 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-e22539b1-9d0e-4899-8bfb-10b49512a7bd tempest-AbsoluteLimitsTests-1362953827 None] Lock "cinder-quobyte-1cdbae99-9c97-46eb-9580-71b98eaaacdb" released by "delete_volume" :: held 0.736s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:19:21 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-d918330b-a7fe-41df-a921-b0d0fa8d9ea2 tempest-VolumesTransfersV357Test-297992809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:19:21 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-d918330b-a7fe-41df-a921-b0d0fa8d9ea2 tempest-VolumesTransfersV357Test-297992809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:19:21 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-d918330b-a7fe-41df-a921-b0d0fa8d9ea2 tempest-VolumesTransfersV357Test-297992809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:19:21 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-d918330b-a7fe-41df-a921-b0d0fa8d9ea2 tempest-VolumesTransfersV357Test-297992809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:19:21 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-d918330b-a7fe-41df-a921-b0d0fa8d9ea2 tempest-VolumesTransfersV357Test-297992809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:19:21 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d918330b-a7fe-41df-a921-b0d0fa8d9ea2 tempest-VolumesTransfersV357Test-297992809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:19:21 devstack sudo[93469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:19:21 devstack sudo[93469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:19:21 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-e22539b1-9d0e-4899-8bfb-10b49512a7bd tempest-AbsoluteLimitsTests-1362953827 None] Created reservations ['e364e811-98d0-4357-8be0-a81ddda90d95', 'f4b45dc9-bcb3-4eea-9081-ee3ef25b0b92', 'a765d328-0d4b-451f-bb64-8d01a55816d5', '2c4bc4f9-2247-419d-8492-76723b264e3b'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:19:21 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-e22539b1-9d0e-4899-8bfb-10b49512a7bd tempest-AbsoluteLimitsTests-1362953827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:19:21 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-e22539b1-9d0e-4899-8bfb-10b49512a7bd tempest-AbsoluteLimitsTests-1362953827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:19:21 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-e22539b1-9d0e-4899-8bfb-10b49512a7bd tempest-AbsoluteLimitsTests-1362953827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:19:21 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-e22539b1-9d0e-4899-8bfb-10b49512a7bd tempest-AbsoluteLimitsTests-1362953827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:19:21 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-e22539b1-9d0e-4899-8bfb-10b49512a7bd tempest-AbsoluteLimitsTests-1362953827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:19:21 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-e22539b1-9d0e-4899-8bfb-10b49512a7bd tempest-AbsoluteLimitsTests-1362953827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:19:21 devstack sudo[93471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:19:21 devstack sudo[93471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:19:21 devstack sudo[93469]: pam_unix(sudo:session): session closed for user root Jul 22 03:19:21 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d918330b-a7fe-41df-a921-b0d0fa8d9ea2 tempest-VolumesTransfersV357Test-297992809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.483s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:19:21 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-d918330b-a7fe-41df-a921-b0d0fa8d9ea2 tempest-VolumesTransfersV357Test-297992809 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:19:21 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-d918330b-a7fe-41df-a921-b0d0fa8d9ea2 tempest-VolumesTransfersV357Test-297992809 None] Deleted volume successfully. Jul 22 03:19:21 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-d918330b-a7fe-41df-a921-b0d0fa8d9ea2 tempest-VolumesTransfersV357Test-297992809 None] Lock "cinder-9496075e-f810-4949-99e0-f2119093fdda-delete_volume" released by "delete_volume" :: held 1.620s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:19:21 devstack sudo[93471]: pam_unix(sudo:session): session closed for user root Jul 22 03:19:21 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-e22539b1-9d0e-4899-8bfb-10b49512a7bd tempest-AbsoluteLimitsTests-1362953827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.431s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:19:21 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-e22539b1-9d0e-4899-8bfb-10b49512a7bd tempest-AbsoluteLimitsTests-1362953827 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:19:21 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-e22539b1-9d0e-4899-8bfb-10b49512a7bd tempest-AbsoluteLimitsTests-1362953827 None] Deleted volume successfully. Jul 22 03:19:21 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-e22539b1-9d0e-4899-8bfb-10b49512a7bd tempest-AbsoluteLimitsTests-1362953827 None] Lock "cinder-1cdbae99-9c97-46eb-9580-71b98eaaacdb-delete_volume" released by "delete_volume" :: held 1.564s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:19:21 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-135b3d56-c773-435f-8c2e-b3eb9e96bf79 tempest-GroupsV314Test-154076591 None] Acquiring lock "cinder-quobyte-23d27957-0077-48d1-aea2-604362199892" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:19:21 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-135b3d56-c773-435f-8c2e-b3eb9e96bf79 tempest-GroupsV314Test-154076591 None] Lock "cinder-quobyte-23d27957-0077-48d1-aea2-604362199892" acquired by "delete_volume" :: waited 0.035s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:19:22 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee4fbd62-f002-48fb-abf7-088c6a370c19]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:19:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-135b3d56-c773-435f-8c2e-b3eb9e96bf79 tempest-GroupsV314Test-154076591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-23d27957-0077-48d1-aea2-604362199892 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:19:22 devstack sudo[93476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-23d27957-0077-48d1-aea2-604362199892 Jul 22 03:19:22 devstack sudo[93476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:19:22 devstack cinder-volume[87747]: DEBUG oslo_service.periodic_task [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87747) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 03:19:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:19:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:19:22 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:19:22 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:19:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:19:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:19:22 devstack sudo[93476]: pam_unix(sudo:session): session closed for user root Jul 22 03:19:22 devstack sudo[93482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:19:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-135b3d56-c773-435f-8c2e-b3eb9e96bf79 tempest-GroupsV314Test-154076591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-23d27957-0077-48d1-aea2-604362199892" returned: 0 in 0.411s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:19:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-135b3d56-c773-435f-8c2e-b3eb9e96bf79 tempest-GroupsV314Test-154076591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-23d27957-0077-48d1-aea2-604362199892 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:19:22 devstack sudo[93482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:19:22 devstack sudo[93484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-23d27957-0077-48d1-aea2-604362199892 Jul 22 03:19:22 devstack sudo[93484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:19:22 devstack sudo[93482]: pam_unix(sudo:session): session closed for user root Jul 22 03:19:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.275s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:19:22 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:19:22 devstack cinder-volume[87747]: DEBUG oslo_service.periodic_task [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Running periodic task VolumeManager._thread_info {{(pid=87747) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 03:19:22 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] thread count: 8 {{(pid=87747) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 22 03:19:22 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] thread info: [<_MainThread(MainThread, started 132775275860096)>, , , , , , , ] {{(pid=87747) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 22 03:19:22 devstack sudo[93484]: pam_unix(sudo:session): session closed for user root Jul 22 03:19:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-135b3d56-c773-435f-8c2e-b3eb9e96bf79 tempest-GroupsV314Test-154076591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-23d27957-0077-48d1-aea2-604362199892" returned: 0 in 0.299s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:19:22 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-135b3d56-c773-435f-8c2e-b3eb9e96bf79 tempest-GroupsV314Test-154076591 None] Lock "cinder-quobyte-23d27957-0077-48d1-aea2-604362199892" released by "delete_volume" :: held 0.809s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:19:22 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-135b3d56-c773-435f-8c2e-b3eb9e96bf79 tempest-GroupsV314Test-154076591 None] Created reservations ['9dae5bf0-a28b-40a4-814b-0a8e25456446'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:19:22 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-135b3d56-c773-435f-8c2e-b3eb9e96bf79 tempest-GroupsV314Test-154076591 None] Created reservations ['9a781ee9-b50d-421b-9c27-72364ba90c4f', '0ca93f8d-3d0a-4741-a9b5-80cbf81049a3', 'ee10d777-884b-4b47-bb36-8bdb826cc86c', '23d50fad-cd88-4481-82db-cada506b73d2'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:19:23 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-135b3d56-c773-435f-8c2e-b3eb9e96bf79 tempest-GroupsV314Test-154076591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:19:23 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-135b3d56-c773-435f-8c2e-b3eb9e96bf79 tempest-GroupsV314Test-154076591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:19:23 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-135b3d56-c773-435f-8c2e-b3eb9e96bf79 tempest-GroupsV314Test-154076591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:19:23 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-135b3d56-c773-435f-8c2e-b3eb9e96bf79 tempest-GroupsV314Test-154076591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:19:23 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-135b3d56-c773-435f-8c2e-b3eb9e96bf79 tempest-GroupsV314Test-154076591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:19:23 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-135b3d56-c773-435f-8c2e-b3eb9e96bf79 tempest-GroupsV314Test-154076591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:19:23 devstack sudo[93489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:19:23 devstack sudo[93489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:19:23 devstack sudo[93489]: pam_unix(sudo:session): session closed for user root Jul 22 03:19:23 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-135b3d56-c773-435f-8c2e-b3eb9e96bf79 tempest-GroupsV314Test-154076591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.302s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:19:23 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-135b3d56-c773-435f-8c2e-b3eb9e96bf79 tempest-GroupsV314Test-154076591 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:19:23 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-135b3d56-c773-435f-8c2e-b3eb9e96bf79 tempest-GroupsV314Test-154076591 None] Delete group completed successfully. Jul 22 03:19:28 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bfcc380-fba1-42d7-a4e2-42c2f73248c9 tempest-VolumesMetadataTest-1209729129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:19:28 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-1bfcc380-fba1-42d7-a4e2-42c2f73248c9 tempest-VolumesMetadataTest-1209729129 None] Flow 'volume_create_manager' (60eb2216-ca9f-43fc-8a83-6513181811b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:19:28 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-1bfcc380-fba1-42d7-a4e2-42c2f73248c9 tempest-VolumesMetadataTest-1209729129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63dd7aa9-eea5-4844-8084-c5cce6a3c4c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:19:28 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-1bfcc380-fba1-42d7-a4e2-42c2f73248c9 tempest-VolumesMetadataTest-1209729129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63dd7aa9-eea5-4844-8084-c5cce6a3c4c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:19:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-866699374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d194461a-2df1-4465-932e-ea9a954d4622,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c090f25ab9f456c806fdf8a7767ce86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:19:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:19:29Z,use_quota=True,user_id='0dd57b8bad8948dc846c1f630e8cd268',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:19:28 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-1bfcc380-fba1-42d7-a4e2-42c2f73248c9 tempest-VolumesMetadataTest-1209729129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f02a545-8fb7-462c-b50f-5c5118f22d17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:19:28 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-1bfcc380-fba1-42d7-a4e2-42c2f73248c9 tempest-VolumesMetadataTest-1209729129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f02a545-8fb7-462c-b50f-5c5118f22d17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:19:28 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-1bfcc380-fba1-42d7-a4e2-42c2f73248c9 tempest-VolumesMetadataTest-1209729129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10c46ce2-4b4e-48ee-8915-a7d5f1df103d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:19:28 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-1bfcc380-fba1-42d7-a4e2-42c2f73248c9 tempest-VolumesMetadataTest-1209729129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10c46ce2-4b4e-48ee-8915-a7d5f1df103d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd194461a-2df1-4465-932e-ea9a954d4622', 'volume_name': 'volume-d194461a-2df1-4465-932e-ea9a954d4622', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:19:28 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-1bfcc380-fba1-42d7-a4e2-42c2f73248c9 tempest-VolumesMetadataTest-1209729129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a0cd620-e26a-4fa6-a061-d18736f34474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:19:28 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-1bfcc380-fba1-42d7-a4e2-42c2f73248c9 tempest-VolumesMetadataTest-1209729129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a0cd620-e26a-4fa6-a061-d18736f34474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:19:28 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-1bfcc380-fba1-42d7-a4e2-42c2f73248c9 tempest-VolumesMetadataTest-1209729129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cd8f0d6-759a-4feb-b8c8-79e1f2846d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:19:28 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-1bfcc380-fba1-42d7-a4e2-42c2f73248c9 tempest-VolumesMetadataTest-1209729129 None] Volume d194461a-2df1-4465-932e-ea9a954d4622: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d194461a-2df1-4465-932e-ea9a954d4622', 'volume_size': 1} Jul 22 03:19:28 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-1bfcc380-fba1-42d7-a4e2-42c2f73248c9 tempest-VolumesMetadataTest-1209729129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:19:28 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-1bfcc380-fba1-42d7-a4e2-42c2f73248c9 tempest-VolumesMetadataTest-1209729129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:19:28 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-1bfcc380-fba1-42d7-a4e2-42c2f73248c9 tempest-VolumesMetadataTest-1209729129 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:19:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-866699374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d194461a-2df1-4465-932e-ea9a954d4622,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c090f25ab9f456c806fdf8a7767ce86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:19:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:19:29Z,use_quota=True,user_id='0dd57b8bad8948dc846c1f630e8cd268',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:19:28 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-1bfcc380-fba1-42d7-a4e2-42c2f73248c9 tempest-VolumesMetadataTest-1209729129 None] Creating volume d194461a-2df1-4465-932e-ea9a954d4622 {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:19:28 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-1bfcc380-fba1-42d7-a4e2-42c2f73248c9 tempest-VolumesMetadataTest-1209729129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:19:28 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-1bfcc380-fba1-42d7-a4e2-42c2f73248c9 tempest-VolumesMetadataTest-1209729129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:19:28 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-1bfcc380-fba1-42d7-a4e2-42c2f73248c9 tempest-VolumesMetadataTest-1209729129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:19:28 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-1bfcc380-fba1-42d7-a4e2-42c2f73248c9 tempest-VolumesMetadataTest-1209729129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:19:28 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-1bfcc380-fba1-42d7-a4e2-42c2f73248c9 tempest-VolumesMetadataTest-1209729129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:19:28 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-1bfcc380-fba1-42d7-a4e2-42c2f73248c9 tempest-VolumesMetadataTest-1209729129 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:19:28 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-1bfcc380-fba1-42d7-a4e2-42c2f73248c9 tempest-VolumesMetadataTest-1209729129 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:19:28 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-1bfcc380-fba1-42d7-a4e2-42c2f73248c9 tempest-VolumesMetadataTest-1209729129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d194461a-2df1-4465-932e-ea9a954d4622 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:19:29 devstack sudo[93539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d194461a-2df1-4465-932e-ea9a954d4622 1073741824 Jul 22 03:19:29 devstack sudo[93539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:19:29 devstack sudo[93539]: pam_unix(sudo:session): session closed for user root Jul 22 03:19:29 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-1bfcc380-fba1-42d7-a4e2-42c2f73248c9 tempest-VolumesMetadataTest-1209729129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d194461a-2df1-4465-932e-ea9a954d4622 1073741824" returned: 0 in 0.556s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:19:29 devstack cinder-volume[87747]: DEBUG dbcounter [-] [87747] Writing DB stats cinder:SELECT=138,cinder:UPDATE=160,cinder:INSERT=38,cinder:DELETE=8 {{(pid=87747) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 03:19:29 devstack cinder-volume[87747]: DEBUG dbcounter [-] [87747] Writing DB stats cinder:SELECT=121,cinder:UPDATE=159,cinder:INSERT=30,cinder:DELETE=11 {{(pid=87747) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 03:19:29 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-1bfcc380-fba1-42d7-a4e2-42c2f73248c9 tempest-VolumesMetadataTest-1209729129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d194461a-2df1-4465-932e-ea9a954d4622 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:19:29 devstack sudo[93554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d194461a-2df1-4465-932e-ea9a954d4622 Jul 22 03:19:29 devstack sudo[93554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:19:29 devstack sudo[93554]: pam_unix(sudo:session): session closed for user root Jul 22 03:19:29 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-1bfcc380-fba1-42d7-a4e2-42c2f73248c9 tempest-VolumesMetadataTest-1209729129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d194461a-2df1-4465-932e-ea9a954d4622" returned: 0 in 0.324s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:19:29 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-1bfcc380-fba1-42d7-a4e2-42c2f73248c9 tempest-VolumesMetadataTest-1209729129 None] <== create_volume: return (960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:19:29 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-1bfcc380-fba1-42d7-a4e2-42c2f73248c9 tempest-VolumesMetadataTest-1209729129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.963s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:19:29 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-1bfcc380-fba1-42d7-a4e2-42c2f73248c9 tempest-VolumesMetadataTest-1209729129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cd8f0d6-759a-4feb-b8c8-79e1f2846d9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d194461a-2df1-4465-932e-ea9a954d4622', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:19:29 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-1bfcc380-fba1-42d7-a4e2-42c2f73248c9 tempest-VolumesMetadataTest-1209729129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e51d212a-24dc-44bf-9d81-857058badf0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:19:29 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-1bfcc380-fba1-42d7-a4e2-42c2f73248c9 tempest-VolumesMetadataTest-1209729129 None] Volume volume-d194461a-2df1-4465-932e-ea9a954d4622 (d194461a-2df1-4465-932e-ea9a954d4622): created successfully Jul 22 03:19:29 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-1bfcc380-fba1-42d7-a4e2-42c2f73248c9 tempest-VolumesMetadataTest-1209729129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e51d212a-24dc-44bf-9d81-857058badf0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:19:30 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-1bfcc380-fba1-42d7-a4e2-42c2f73248c9 tempest-VolumesMetadataTest-1209729129 None] Flow 'volume_create_manager' (60eb2216-ca9f-43fc-8a83-6513181811b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:19:30 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-1bfcc380-fba1-42d7-a4e2-42c2f73248c9 tempest-VolumesMetadataTest-1209729129 None] Created volume successfully. Jul 22 03:19:30 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-c53212dd-20a8-419b-9674-0c6a816fc465 tempest-VolumesListTestJSON-1804463790 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:19:30 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-c53212dd-20a8-419b-9674-0c6a816fc465 tempest-VolumesListTestJSON-1804463790 None] Flow 'volume_create_manager' (7ec06b3d-672b-4fb0-b831-417f74133db8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:19:30 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-c53212dd-20a8-419b-9674-0c6a816fc465 tempest-VolumesListTestJSON-1804463790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57bbfc75-eb09-4422-96ea-140cd397ec02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:19:30 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-c53212dd-20a8-419b-9674-0c6a816fc465 tempest-VolumesListTestJSON-1804463790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57bbfc75-eb09-4422-96ea-140cd397ec02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:19:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-137712360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed252e63-775b-4782-bfe9-be61467ae239,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cc0ff9c29d0842bb9fe55a7c1ffbfbe3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:19:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:19:30Z,use_quota=True,user_id='02c35782a76140d9a0368ce1f97a1417',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:19:30 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-c53212dd-20a8-419b-9674-0c6a816fc465 tempest-VolumesListTestJSON-1804463790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e417e0d3-3421-4fae-85d6-8b99c171b13d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:19:30 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-c53212dd-20a8-419b-9674-0c6a816fc465 tempest-VolumesListTestJSON-1804463790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e417e0d3-3421-4fae-85d6-8b99c171b13d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:19:30 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-c53212dd-20a8-419b-9674-0c6a816fc465 tempest-VolumesListTestJSON-1804463790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e908ee1-68bf-4ee0-9233-77fa8c9ec455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:19:30 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-c53212dd-20a8-419b-9674-0c6a816fc465 tempest-VolumesListTestJSON-1804463790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e908ee1-68bf-4ee0-9233-77fa8c9ec455) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed252e63-775b-4782-bfe9-be61467ae239', 'volume_name': 'volume-ed252e63-775b-4782-bfe9-be61467ae239', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:19:30 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-c53212dd-20a8-419b-9674-0c6a816fc465 tempest-VolumesListTestJSON-1804463790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1844e8d3-b078-4b07-9969-68d09893e395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:19:30 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-c53212dd-20a8-419b-9674-0c6a816fc465 tempest-VolumesListTestJSON-1804463790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1844e8d3-b078-4b07-9969-68d09893e395) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:19:30 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-c53212dd-20a8-419b-9674-0c6a816fc465 tempest-VolumesListTestJSON-1804463790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9db82ee8-403a-40f9-a245-a77822f60100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:19:30 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-c53212dd-20a8-419b-9674-0c6a816fc465 tempest-VolumesListTestJSON-1804463790 None] Volume ed252e63-775b-4782-bfe9-be61467ae239: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed252e63-775b-4782-bfe9-be61467ae239', 'volume_size': 1} Jul 22 03:19:30 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-c53212dd-20a8-419b-9674-0c6a816fc465 tempest-VolumesListTestJSON-1804463790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:19:30 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-c53212dd-20a8-419b-9674-0c6a816fc465 tempest-VolumesListTestJSON-1804463790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:19:30 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-c53212dd-20a8-419b-9674-0c6a816fc465 tempest-VolumesListTestJSON-1804463790 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:19:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-137712360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed252e63-775b-4782-bfe9-be61467ae239,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cc0ff9c29d0842bb9fe55a7c1ffbfbe3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:19:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:19:30Z,use_quota=True,user_id='02c35782a76140d9a0368ce1f97a1417',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:19:30 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-c53212dd-20a8-419b-9674-0c6a816fc465 tempest-VolumesListTestJSON-1804463790 None] Creating volume ed252e63-775b-4782-bfe9-be61467ae239 {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:19:30 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-c53212dd-20a8-419b-9674-0c6a816fc465 tempest-VolumesListTestJSON-1804463790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:19:30 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-c53212dd-20a8-419b-9674-0c6a816fc465 tempest-VolumesListTestJSON-1804463790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:19:30 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-c53212dd-20a8-419b-9674-0c6a816fc465 tempest-VolumesListTestJSON-1804463790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:19:30 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-c53212dd-20a8-419b-9674-0c6a816fc465 tempest-VolumesListTestJSON-1804463790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:19:30 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-c53212dd-20a8-419b-9674-0c6a816fc465 tempest-VolumesListTestJSON-1804463790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:19:30 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-c53212dd-20a8-419b-9674-0c6a816fc465 tempest-VolumesListTestJSON-1804463790 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:19:30 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-c53212dd-20a8-419b-9674-0c6a816fc465 tempest-VolumesListTestJSON-1804463790 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:19:30 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-c53212dd-20a8-419b-9674-0c6a816fc465 tempest-VolumesListTestJSON-1804463790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ed252e63-775b-4782-bfe9-be61467ae239 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:19:30 devstack sudo[93574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ed252e63-775b-4782-bfe9-be61467ae239 1073741824 Jul 22 03:19:30 devstack sudo[93574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:19:30 devstack sudo[93574]: pam_unix(sudo:session): session closed for user root Jul 22 03:19:30 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-c53212dd-20a8-419b-9674-0c6a816fc465 tempest-VolumesListTestJSON-1804463790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ed252e63-775b-4782-bfe9-be61467ae239 1073741824" returned: 0 in 0.488s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:19:30 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-c53212dd-20a8-419b-9674-0c6a816fc465 tempest-VolumesListTestJSON-1804463790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ed252e63-775b-4782-bfe9-be61467ae239 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:19:30 devstack sudo[93580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ed252e63-775b-4782-bfe9-be61467ae239 Jul 22 03:19:30 devstack sudo[93580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:19:31 devstack sudo[93580]: pam_unix(sudo:session): session closed for user root Jul 22 03:19:31 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-c53212dd-20a8-419b-9674-0c6a816fc465 tempest-VolumesListTestJSON-1804463790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ed252e63-775b-4782-bfe9-be61467ae239" returned: 0 in 0.387s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:19:31 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-c53212dd-20a8-419b-9674-0c6a816fc465 tempest-VolumesListTestJSON-1804463790 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:19:31 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-c53212dd-20a8-419b-9674-0c6a816fc465 tempest-VolumesListTestJSON-1804463790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:19:31 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-c53212dd-20a8-419b-9674-0c6a816fc465 tempest-VolumesListTestJSON-1804463790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9db82ee8-403a-40f9-a245-a77822f60100) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed252e63-775b-4782-bfe9-be61467ae239', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:19:31 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-c53212dd-20a8-419b-9674-0c6a816fc465 tempest-VolumesListTestJSON-1804463790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4c6e12e-1876-4967-aeb3-a8f4f210bf5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:19:31 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-c53212dd-20a8-419b-9674-0c6a816fc465 tempest-VolumesListTestJSON-1804463790 None] Volume volume-ed252e63-775b-4782-bfe9-be61467ae239 (ed252e63-775b-4782-bfe9-be61467ae239): created successfully Jul 22 03:19:31 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-c53212dd-20a8-419b-9674-0c6a816fc465 tempest-VolumesListTestJSON-1804463790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4c6e12e-1876-4967-aeb3-a8f4f210bf5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:19:31 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-c53212dd-20a8-419b-9674-0c6a816fc465 tempest-VolumesListTestJSON-1804463790 None] Flow 'volume_create_manager' (7ec06b3d-672b-4fb0-b831-417f74133db8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:19:31 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-c53212dd-20a8-419b-9674-0c6a816fc465 tempest-VolumesListTestJSON-1804463790 None] Created volume successfully. Jul 22 03:19:31 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-b4301ca3-2026-41c4-a13a-9ac6e60b370f tempest-VolumesMetadataTest-1209729129 None] Acquiring lock "cinder-d194461a-2df1-4465-932e-ea9a954d4622-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:19:31 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-b4301ca3-2026-41c4-a13a-9ac6e60b370f tempest-VolumesMetadataTest-1209729129 None] Lock "cinder-d194461a-2df1-4465-932e-ea9a954d4622-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:19:31 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-b4301ca3-2026-41c4-a13a-9ac6e60b370f tempest-VolumesMetadataTest-1209729129 None] Acquiring lock "cinder-quobyte-d194461a-2df1-4465-932e-ea9a954d4622" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:19:31 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-b4301ca3-2026-41c4-a13a-9ac6e60b370f tempest-VolumesMetadataTest-1209729129 None] Lock "cinder-quobyte-d194461a-2df1-4465-932e-ea9a954d4622" acquired by "delete_volume" :: waited 0.019s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:19:32 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff6c5ed9-b618-40b8-b3dd-2f67df9c1e72]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:19:32 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b4301ca3-2026-41c4-a13a-9ac6e60b370f tempest-VolumesMetadataTest-1209729129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d194461a-2df1-4465-932e-ea9a954d4622 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:19:32 devstack sudo[93588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d194461a-2df1-4465-932e-ea9a954d4622 Jul 22 03:19:32 devstack sudo[93588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:19:32 devstack sudo[93588]: pam_unix(sudo:session): session closed for user root Jul 22 03:19:32 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b4301ca3-2026-41c4-a13a-9ac6e60b370f tempest-VolumesMetadataTest-1209729129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d194461a-2df1-4465-932e-ea9a954d4622" returned: 0 in 0.753s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:19:32 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b4301ca3-2026-41c4-a13a-9ac6e60b370f tempest-VolumesMetadataTest-1209729129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d194461a-2df1-4465-932e-ea9a954d4622 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:19:32 devstack sudo[93647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d194461a-2df1-4465-932e-ea9a954d4622 Jul 22 03:19:32 devstack sudo[93647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:19:33 devstack sudo[93647]: pam_unix(sudo:session): session closed for user root Jul 22 03:19:33 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b4301ca3-2026-41c4-a13a-9ac6e60b370f tempest-VolumesMetadataTest-1209729129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d194461a-2df1-4465-932e-ea9a954d4622" returned: 0 in 0.618s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:19:33 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-b4301ca3-2026-41c4-a13a-9ac6e60b370f tempest-VolumesMetadataTest-1209729129 None] Lock "cinder-quobyte-d194461a-2df1-4465-932e-ea9a954d4622" released by "delete_volume" :: held 1.464s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:19:33 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-b4301ca3-2026-41c4-a13a-9ac6e60b370f tempest-VolumesMetadataTest-1209729129 None] Created reservations ['0e62890f-fef6-4bc8-9a39-d64e5752b2d5', 'a1af02c2-bc24-4842-978a-e892964c587d', 'c33564d4-817c-4669-bde9-ef7829640591', '3a558176-ce15-42c5-ba78-133ecf4d4d7e'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:19:33 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b4301ca3-2026-41c4-a13a-9ac6e60b370f tempest-VolumesMetadataTest-1209729129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:19:33 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b4301ca3-2026-41c4-a13a-9ac6e60b370f tempest-VolumesMetadataTest-1209729129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:19:33 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-b4301ca3-2026-41c4-a13a-9ac6e60b370f tempest-VolumesMetadataTest-1209729129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:19:33 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-b4301ca3-2026-41c4-a13a-9ac6e60b370f tempest-VolumesMetadataTest-1209729129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:19:33 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b4301ca3-2026-41c4-a13a-9ac6e60b370f tempest-VolumesMetadataTest-1209729129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:19:33 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b4301ca3-2026-41c4-a13a-9ac6e60b370f tempest-VolumesMetadataTest-1209729129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:19:33 devstack sudo[93660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:19:33 devstack sudo[93660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:19:33 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7543ceb-15f4-406e-af83-46bd40323b4a tempest-VolumesListTestJSON-1804463790 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:19:33 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-d7543ceb-15f4-406e-af83-46bd40323b4a tempest-VolumesListTestJSON-1804463790 None] Flow 'volume_create_manager' (343466d0-dfa4-43c4-ad8f-3384abbe0689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:19:33 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-d7543ceb-15f4-406e-af83-46bd40323b4a tempest-VolumesListTestJSON-1804463790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bddf0c0-e949-4ddc-8efe-9113ee3c8082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:19:33 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-d7543ceb-15f4-406e-af83-46bd40323b4a tempest-VolumesListTestJSON-1804463790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bddf0c0-e949-4ddc-8efe-9113ee3c8082) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:19:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-742498879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e9a8b90-dcda-40b5-bc22-7d6216592fb6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cc0ff9c29d0842bb9fe55a7c1ffbfbe3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:19:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:19:34Z,use_quota=True,user_id='02c35782a76140d9a0368ce1f97a1417',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:19:33 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-d7543ceb-15f4-406e-af83-46bd40323b4a tempest-VolumesListTestJSON-1804463790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b77d4fad-a80b-43b4-b7e3-1b8017551ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:19:33 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-d7543ceb-15f4-406e-af83-46bd40323b4a tempest-VolumesListTestJSON-1804463790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b77d4fad-a80b-43b4-b7e3-1b8017551ec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:19:33 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-d7543ceb-15f4-406e-af83-46bd40323b4a tempest-VolumesListTestJSON-1804463790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (694d7732-1d95-4170-b9fb-d72fab59ef1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:19:33 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-d7543ceb-15f4-406e-af83-46bd40323b4a tempest-VolumesListTestJSON-1804463790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (694d7732-1d95-4170-b9fb-d72fab59ef1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e9a8b90-dcda-40b5-bc22-7d6216592fb6', 'volume_name': 'volume-0e9a8b90-dcda-40b5-bc22-7d6216592fb6', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:19:33 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-d7543ceb-15f4-406e-af83-46bd40323b4a tempest-VolumesListTestJSON-1804463790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77121b2c-daf3-4de8-95ac-5fb20be62243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:19:33 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-d7543ceb-15f4-406e-af83-46bd40323b4a tempest-VolumesListTestJSON-1804463790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77121b2c-daf3-4de8-95ac-5fb20be62243) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:19:33 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-d7543ceb-15f4-406e-af83-46bd40323b4a tempest-VolumesListTestJSON-1804463790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c7956b2-bf45-4807-a61f-c0b47e198fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:19:33 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-d7543ceb-15f4-406e-af83-46bd40323b4a tempest-VolumesListTestJSON-1804463790 None] Volume 0e9a8b90-dcda-40b5-bc22-7d6216592fb6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e9a8b90-dcda-40b5-bc22-7d6216592fb6', 'volume_size': 1} Jul 22 03:19:33 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-d7543ceb-15f4-406e-af83-46bd40323b4a tempest-VolumesListTestJSON-1804463790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:19:33 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-d7543ceb-15f4-406e-af83-46bd40323b4a tempest-VolumesListTestJSON-1804463790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:19:33 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-d7543ceb-15f4-406e-af83-46bd40323b4a tempest-VolumesListTestJSON-1804463790 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:19:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-742498879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e9a8b90-dcda-40b5-bc22-7d6216592fb6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cc0ff9c29d0842bb9fe55a7c1ffbfbe3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:19:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:19:34Z,use_quota=True,user_id='02c35782a76140d9a0368ce1f97a1417',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:19:33 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-d7543ceb-15f4-406e-af83-46bd40323b4a tempest-VolumesListTestJSON-1804463790 None] Creating volume 0e9a8b90-dcda-40b5-bc22-7d6216592fb6 {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:19:33 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-d7543ceb-15f4-406e-af83-46bd40323b4a tempest-VolumesListTestJSON-1804463790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:19:33 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-d7543ceb-15f4-406e-af83-46bd40323b4a tempest-VolumesListTestJSON-1804463790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:19:33 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-d7543ceb-15f4-406e-af83-46bd40323b4a tempest-VolumesListTestJSON-1804463790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:19:33 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-d7543ceb-15f4-406e-af83-46bd40323b4a tempest-VolumesListTestJSON-1804463790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:19:33 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-d7543ceb-15f4-406e-af83-46bd40323b4a tempest-VolumesListTestJSON-1804463790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:19:33 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-d7543ceb-15f4-406e-af83-46bd40323b4a tempest-VolumesListTestJSON-1804463790 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:19:33 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-d7543ceb-15f4-406e-af83-46bd40323b4a tempest-VolumesListTestJSON-1804463790 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:19:33 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d7543ceb-15f4-406e-af83-46bd40323b4a tempest-VolumesListTestJSON-1804463790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0e9a8b90-dcda-40b5-bc22-7d6216592fb6 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:19:33 devstack sudo[93660]: pam_unix(sudo:session): session closed for user root Jul 22 03:19:33 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b4301ca3-2026-41c4-a13a-9ac6e60b370f tempest-VolumesMetadataTest-1209729129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.337s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:19:33 devstack sudo[93663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0e9a8b90-dcda-40b5-bc22-7d6216592fb6 1073741824 Jul 22 03:19:33 devstack sudo[93663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:19:33 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-b4301ca3-2026-41c4-a13a-9ac6e60b370f tempest-VolumesMetadataTest-1209729129 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:19:33 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-b4301ca3-2026-41c4-a13a-9ac6e60b370f tempest-VolumesMetadataTest-1209729129 None] Deleted volume successfully. Jul 22 03:19:33 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-b4301ca3-2026-41c4-a13a-9ac6e60b370f tempest-VolumesMetadataTest-1209729129 None] Lock "cinder-d194461a-2df1-4465-932e-ea9a954d4622-delete_volume" released by "delete_volume" :: held 2.091s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:19:34 devstack sudo[93663]: pam_unix(sudo:session): session closed for user root Jul 22 03:19:34 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d7543ceb-15f4-406e-af83-46bd40323b4a tempest-VolumesListTestJSON-1804463790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0e9a8b90-dcda-40b5-bc22-7d6216592fb6 1073741824" returned: 0 in 0.838s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:19:34 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d7543ceb-15f4-406e-af83-46bd40323b4a tempest-VolumesListTestJSON-1804463790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0e9a8b90-dcda-40b5-bc22-7d6216592fb6 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:19:34 devstack sudo[93671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0e9a8b90-dcda-40b5-bc22-7d6216592fb6 Jul 22 03:19:34 devstack sudo[93671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:19:35 devstack sudo[93671]: pam_unix(sudo:session): session closed for user root Jul 22 03:19:35 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d7543ceb-15f4-406e-af83-46bd40323b4a tempest-VolumesListTestJSON-1804463790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0e9a8b90-dcda-40b5-bc22-7d6216592fb6" returned: 0 in 0.320s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:19:35 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-d7543ceb-15f4-406e-af83-46bd40323b4a tempest-VolumesListTestJSON-1804463790 None] <== create_volume: return (1262ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:19:35 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-d7543ceb-15f4-406e-af83-46bd40323b4a tempest-VolumesListTestJSON-1804463790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.265s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:19:35 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-d7543ceb-15f4-406e-af83-46bd40323b4a tempest-VolumesListTestJSON-1804463790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c7956b2-bf45-4807-a61f-c0b47e198fc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e9a8b90-dcda-40b5-bc22-7d6216592fb6', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:19:35 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-d7543ceb-15f4-406e-af83-46bd40323b4a tempest-VolumesListTestJSON-1804463790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d213d985-05aa-45b1-bbdb-83079ff64bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:19:35 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-d7543ceb-15f4-406e-af83-46bd40323b4a tempest-VolumesListTestJSON-1804463790 None] Volume volume-0e9a8b90-dcda-40b5-bc22-7d6216592fb6 (0e9a8b90-dcda-40b5-bc22-7d6216592fb6): created successfully Jul 22 03:19:35 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-d7543ceb-15f4-406e-af83-46bd40323b4a tempest-VolumesListTestJSON-1804463790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d213d985-05aa-45b1-bbdb-83079ff64bc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:19:35 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-d7543ceb-15f4-406e-af83-46bd40323b4a tempest-VolumesListTestJSON-1804463790 None] Flow 'volume_create_manager' (343466d0-dfa4-43c4-ad8f-3384abbe0689) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:19:35 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-d7543ceb-15f4-406e-af83-46bd40323b4a tempest-VolumesListTestJSON-1804463790 None] Created volume successfully. Jul 22 03:19:37 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-aca5d53a-bdb5-4fd3-b144-1994b93da5c3 tempest-VolumesListTestJSON-1804463790 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:19:37 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-aca5d53a-bdb5-4fd3-b144-1994b93da5c3 tempest-VolumesListTestJSON-1804463790 None] Flow 'volume_create_manager' (be27ccbb-2220-4ba0-a258-6c95b2e5f0c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:19:37 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-aca5d53a-bdb5-4fd3-b144-1994b93da5c3 tempest-VolumesListTestJSON-1804463790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6e12836-a8a4-4833-a482-2056d4f94ed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:19:37 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-aca5d53a-bdb5-4fd3-b144-1994b93da5c3 tempest-VolumesListTestJSON-1804463790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6e12836-a8a4-4833-a482-2056d4f94ed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:19:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-157434266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45628fd9-719f-4927-aaf2-c664b9d23ebc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cc0ff9c29d0842bb9fe55a7c1ffbfbe3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:19:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:19:37Z,use_quota=True,user_id='02c35782a76140d9a0368ce1f97a1417',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:19:37 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-aca5d53a-bdb5-4fd3-b144-1994b93da5c3 tempest-VolumesListTestJSON-1804463790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e09ab25a-77b9-4060-921d-8fd7b73408aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:19:37 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-aca5d53a-bdb5-4fd3-b144-1994b93da5c3 tempest-VolumesListTestJSON-1804463790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e09ab25a-77b9-4060-921d-8fd7b73408aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:19:37 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-aca5d53a-bdb5-4fd3-b144-1994b93da5c3 tempest-VolumesListTestJSON-1804463790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4bf113d-b858-4d9e-9a86-c2ef286591b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:19:37 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-aca5d53a-bdb5-4fd3-b144-1994b93da5c3 tempest-VolumesListTestJSON-1804463790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4bf113d-b858-4d9e-9a86-c2ef286591b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45628fd9-719f-4927-aaf2-c664b9d23ebc', 'volume_name': 'volume-45628fd9-719f-4927-aaf2-c664b9d23ebc', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:19:37 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-aca5d53a-bdb5-4fd3-b144-1994b93da5c3 tempest-VolumesListTestJSON-1804463790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d5b81b0-d0dd-4526-af3a-a2287a11ffc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:19:37 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-aca5d53a-bdb5-4fd3-b144-1994b93da5c3 tempest-VolumesListTestJSON-1804463790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d5b81b0-d0dd-4526-af3a-a2287a11ffc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:19:37 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-aca5d53a-bdb5-4fd3-b144-1994b93da5c3 tempest-VolumesListTestJSON-1804463790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2820982-6504-4324-b15c-d070b909bb11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:19:37 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-aca5d53a-bdb5-4fd3-b144-1994b93da5c3 tempest-VolumesListTestJSON-1804463790 None] Volume 45628fd9-719f-4927-aaf2-c664b9d23ebc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45628fd9-719f-4927-aaf2-c664b9d23ebc', 'volume_size': 1} Jul 22 03:19:37 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-aca5d53a-bdb5-4fd3-b144-1994b93da5c3 tempest-VolumesListTestJSON-1804463790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:19:37 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-aca5d53a-bdb5-4fd3-b144-1994b93da5c3 tempest-VolumesListTestJSON-1804463790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:19:37 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-aca5d53a-bdb5-4fd3-b144-1994b93da5c3 tempest-VolumesListTestJSON-1804463790 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:19:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-157434266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45628fd9-719f-4927-aaf2-c664b9d23ebc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cc0ff9c29d0842bb9fe55a7c1ffbfbe3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:19:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:19:37Z,use_quota=True,user_id='02c35782a76140d9a0368ce1f97a1417',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:19:37 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-aca5d53a-bdb5-4fd3-b144-1994b93da5c3 tempest-VolumesListTestJSON-1804463790 None] Creating volume 45628fd9-719f-4927-aaf2-c664b9d23ebc {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:19:37 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-aca5d53a-bdb5-4fd3-b144-1994b93da5c3 tempest-VolumesListTestJSON-1804463790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:19:37 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-aca5d53a-bdb5-4fd3-b144-1994b93da5c3 tempest-VolumesListTestJSON-1804463790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:19:37 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-aca5d53a-bdb5-4fd3-b144-1994b93da5c3 tempest-VolumesListTestJSON-1804463790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:19:37 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-aca5d53a-bdb5-4fd3-b144-1994b93da5c3 tempest-VolumesListTestJSON-1804463790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:19:37 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-aca5d53a-bdb5-4fd3-b144-1994b93da5c3 tempest-VolumesListTestJSON-1804463790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:19:37 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-aca5d53a-bdb5-4fd3-b144-1994b93da5c3 tempest-VolumesListTestJSON-1804463790 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:19:37 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-aca5d53a-bdb5-4fd3-b144-1994b93da5c3 tempest-VolumesListTestJSON-1804463790 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:19:37 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-aca5d53a-bdb5-4fd3-b144-1994b93da5c3 tempest-VolumesListTestJSON-1804463790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-45628fd9-719f-4927-aaf2-c664b9d23ebc 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:19:37 devstack sudo[93675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-45628fd9-719f-4927-aaf2-c664b9d23ebc 1073741824 Jul 22 03:19:37 devstack sudo[93675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:19:37 devstack sudo[93675]: pam_unix(sudo:session): session closed for user root Jul 22 03:19:37 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-aca5d53a-bdb5-4fd3-b144-1994b93da5c3 tempest-VolumesListTestJSON-1804463790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-45628fd9-719f-4927-aaf2-c664b9d23ebc 1073741824" returned: 0 in 0.507s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:19:37 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-aca5d53a-bdb5-4fd3-b144-1994b93da5c3 tempest-VolumesListTestJSON-1804463790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-45628fd9-719f-4927-aaf2-c664b9d23ebc {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:19:37 devstack sudo[93681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-45628fd9-719f-4927-aaf2-c664b9d23ebc Jul 22 03:19:37 devstack sudo[93681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:19:38 devstack sudo[93681]: pam_unix(sudo:session): session closed for user root Jul 22 03:19:38 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-aca5d53a-bdb5-4fd3-b144-1994b93da5c3 tempest-VolumesListTestJSON-1804463790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-45628fd9-719f-4927-aaf2-c664b9d23ebc" returned: 0 in 0.377s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:19:38 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-aca5d53a-bdb5-4fd3-b144-1994b93da5c3 tempest-VolumesListTestJSON-1804463790 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:19:38 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-aca5d53a-bdb5-4fd3-b144-1994b93da5c3 tempest-VolumesListTestJSON-1804463790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:19:38 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-aca5d53a-bdb5-4fd3-b144-1994b93da5c3 tempest-VolumesListTestJSON-1804463790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2820982-6504-4324-b15c-d070b909bb11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45628fd9-719f-4927-aaf2-c664b9d23ebc', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:19:38 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-aca5d53a-bdb5-4fd3-b144-1994b93da5c3 tempest-VolumesListTestJSON-1804463790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9768657c-364a-4add-9b3b-ec6695e71efd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:19:38 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-aca5d53a-bdb5-4fd3-b144-1994b93da5c3 tempest-VolumesListTestJSON-1804463790 None] Volume volume-45628fd9-719f-4927-aaf2-c664b9d23ebc (45628fd9-719f-4927-aaf2-c664b9d23ebc): created successfully Jul 22 03:19:38 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-aca5d53a-bdb5-4fd3-b144-1994b93da5c3 tempest-VolumesListTestJSON-1804463790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9768657c-364a-4add-9b3b-ec6695e71efd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:19:38 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-aca5d53a-bdb5-4fd3-b144-1994b93da5c3 tempest-VolumesListTestJSON-1804463790 None] Flow 'volume_create_manager' (be27ccbb-2220-4ba0-a258-6c95b2e5f0c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:19:38 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-aca5d53a-bdb5-4fd3-b144-1994b93da5c3 tempest-VolumesListTestJSON-1804463790 None] Created volume successfully. Jul 22 03:19:40 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-658666cf-e28b-4eda-a79a-ccf80ceb55aa tempest-VolumesTransfersTest-1654617451 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:19:40 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-658666cf-e28b-4eda-a79a-ccf80ceb55aa tempest-VolumesTransfersTest-1654617451 None] Flow 'volume_create_manager' (80b4d60e-39c5-4381-8d21-07438e9cc881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:19:40 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-658666cf-e28b-4eda-a79a-ccf80ceb55aa tempest-VolumesTransfersTest-1654617451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df77d999-de2a-460e-b504-4e4ae72c8c81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:19:40 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-658666cf-e28b-4eda-a79a-ccf80ceb55aa tempest-VolumesTransfersTest-1654617451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df77d999-de2a-460e-b504-4e4ae72c8c81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:19:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1023081642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0dd8bb2-fff2-4381-9691-18fbdeb36a1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='985643bedf064665b409152147dda844',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:19:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:19:41Z,use_quota=True,user_id='c5df1b6614c64cc9b1fe7a44b3f6e873',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:19:40 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-658666cf-e28b-4eda-a79a-ccf80ceb55aa tempest-VolumesTransfersTest-1654617451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d0f8f1a-779d-4464-8994-18b223f9074d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:19:40 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-658666cf-e28b-4eda-a79a-ccf80ceb55aa tempest-VolumesTransfersTest-1654617451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d0f8f1a-779d-4464-8994-18b223f9074d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:19:40 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-658666cf-e28b-4eda-a79a-ccf80ceb55aa tempest-VolumesTransfersTest-1654617451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6fb0347-2eeb-492b-9261-cbb9c70368f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:19:40 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-658666cf-e28b-4eda-a79a-ccf80ceb55aa tempest-VolumesTransfersTest-1654617451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6fb0347-2eeb-492b-9261-cbb9c70368f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0dd8bb2-fff2-4381-9691-18fbdeb36a1e', 'volume_name': 'volume-b0dd8bb2-fff2-4381-9691-18fbdeb36a1e', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:19:40 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-658666cf-e28b-4eda-a79a-ccf80ceb55aa tempest-VolumesTransfersTest-1654617451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71cef715-6e88-4b8c-b3de-c5000fc26adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:19:40 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-658666cf-e28b-4eda-a79a-ccf80ceb55aa tempest-VolumesTransfersTest-1654617451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71cef715-6e88-4b8c-b3de-c5000fc26adc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:19:40 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-658666cf-e28b-4eda-a79a-ccf80ceb55aa tempest-VolumesTransfersTest-1654617451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b651b85-820a-4e5f-976f-61bbeb951dba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:19:40 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-658666cf-e28b-4eda-a79a-ccf80ceb55aa tempest-VolumesTransfersTest-1654617451 None] Volume b0dd8bb2-fff2-4381-9691-18fbdeb36a1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0dd8bb2-fff2-4381-9691-18fbdeb36a1e', 'volume_size': 1} Jul 22 03:19:40 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-658666cf-e28b-4eda-a79a-ccf80ceb55aa tempest-VolumesTransfersTest-1654617451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:19:40 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-658666cf-e28b-4eda-a79a-ccf80ceb55aa tempest-VolumesTransfersTest-1654617451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:19:40 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-658666cf-e28b-4eda-a79a-ccf80ceb55aa tempest-VolumesTransfersTest-1654617451 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:19:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1023081642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0dd8bb2-fff2-4381-9691-18fbdeb36a1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='985643bedf064665b409152147dda844',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:19:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:19:41Z,use_quota=True,user_id='c5df1b6614c64cc9b1fe7a44b3f6e873',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:19:40 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-658666cf-e28b-4eda-a79a-ccf80ceb55aa tempest-VolumesTransfersTest-1654617451 None] Creating volume b0dd8bb2-fff2-4381-9691-18fbdeb36a1e {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:19:40 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-658666cf-e28b-4eda-a79a-ccf80ceb55aa tempest-VolumesTransfersTest-1654617451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:19:40 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-658666cf-e28b-4eda-a79a-ccf80ceb55aa tempest-VolumesTransfersTest-1654617451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:19:40 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-658666cf-e28b-4eda-a79a-ccf80ceb55aa tempest-VolumesTransfersTest-1654617451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:19:41 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-658666cf-e28b-4eda-a79a-ccf80ceb55aa tempest-VolumesTransfersTest-1654617451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:19:41 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-658666cf-e28b-4eda-a79a-ccf80ceb55aa tempest-VolumesTransfersTest-1654617451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:19:41 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-658666cf-e28b-4eda-a79a-ccf80ceb55aa tempest-VolumesTransfersTest-1654617451 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:19:41 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-658666cf-e28b-4eda-a79a-ccf80ceb55aa tempest-VolumesTransfersTest-1654617451 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:19:41 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-658666cf-e28b-4eda-a79a-ccf80ceb55aa tempest-VolumesTransfersTest-1654617451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b0dd8bb2-fff2-4381-9691-18fbdeb36a1e 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:19:41 devstack sudo[93685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b0dd8bb2-fff2-4381-9691-18fbdeb36a1e 1073741824 Jul 22 03:19:41 devstack sudo[93685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:19:41 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-47982b26-7fa9-42f5-9c1b-2b510a8dd192 tempest-SnapshotsActionsTest-1329048363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:19:41 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-47982b26-7fa9-42f5-9c1b-2b510a8dd192 tempest-SnapshotsActionsTest-1329048363 None] Flow 'volume_create_manager' (39e4fb0a-2e86-4570-8e74-0cd21bf34e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:19:41 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-47982b26-7fa9-42f5-9c1b-2b510a8dd192 tempest-SnapshotsActionsTest-1329048363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdfae8e5-9968-45ae-aec9-88b54181fbaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:19:41 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-47982b26-7fa9-42f5-9c1b-2b510a8dd192 tempest-SnapshotsActionsTest-1329048363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdfae8e5-9968-45ae-aec9-88b54181fbaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:19:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1273133138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d01a3a60-aacf-4183-a2c5-769747c37d7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='331a12e7215247cc994b987e8de3ace7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:19:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:19:41Z,use_quota=True,user_id='ed6343b0a4f94045aeef06937305d9ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:19:41 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-47982b26-7fa9-42f5-9c1b-2b510a8dd192 tempest-SnapshotsActionsTest-1329048363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a5d941f-ed74-499b-b78a-db44ef4c75f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:19:41 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-47982b26-7fa9-42f5-9c1b-2b510a8dd192 tempest-SnapshotsActionsTest-1329048363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a5d941f-ed74-499b-b78a-db44ef4c75f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:19:41 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-47982b26-7fa9-42f5-9c1b-2b510a8dd192 tempest-SnapshotsActionsTest-1329048363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60916333-6297-47b2-9fb3-ac89f281e1c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:19:41 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-47982b26-7fa9-42f5-9c1b-2b510a8dd192 tempest-SnapshotsActionsTest-1329048363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60916333-6297-47b2-9fb3-ac89f281e1c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd01a3a60-aacf-4183-a2c5-769747c37d7a', 'volume_name': 'volume-d01a3a60-aacf-4183-a2c5-769747c37d7a', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:19:41 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-47982b26-7fa9-42f5-9c1b-2b510a8dd192 tempest-SnapshotsActionsTest-1329048363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbe46013-793b-4d16-be25-433be6e4ac0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:19:41 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-47982b26-7fa9-42f5-9c1b-2b510a8dd192 tempest-SnapshotsActionsTest-1329048363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbe46013-793b-4d16-be25-433be6e4ac0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:19:41 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-47982b26-7fa9-42f5-9c1b-2b510a8dd192 tempest-SnapshotsActionsTest-1329048363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbe86c9c-569d-4cd0-a6ca-32e766d123bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:19:41 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-47982b26-7fa9-42f5-9c1b-2b510a8dd192 tempest-SnapshotsActionsTest-1329048363 None] Volume d01a3a60-aacf-4183-a2c5-769747c37d7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d01a3a60-aacf-4183-a2c5-769747c37d7a', 'volume_size': 1} Jul 22 03:19:41 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-47982b26-7fa9-42f5-9c1b-2b510a8dd192 tempest-SnapshotsActionsTest-1329048363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:19:41 devstack sudo[93685]: pam_unix(sudo:session): session closed for user root Jul 22 03:19:41 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-658666cf-e28b-4eda-a79a-ccf80ceb55aa tempest-VolumesTransfersTest-1654617451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b0dd8bb2-fff2-4381-9691-18fbdeb36a1e 1073741824" returned: 0 in 0.513s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:19:41 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-658666cf-e28b-4eda-a79a-ccf80ceb55aa tempest-VolumesTransfersTest-1654617451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b0dd8bb2-fff2-4381-9691-18fbdeb36a1e {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:19:41 devstack sudo[93691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b0dd8bb2-fff2-4381-9691-18fbdeb36a1e Jul 22 03:19:41 devstack sudo[93691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:19:41 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-d7a6e2d6-e67f-4a73-97d0-3fc56a1552a5 tempest-VolumesListTestJSON-1804463790 None] Acquiring lock "cinder-45628fd9-719f-4927-aaf2-c664b9d23ebc-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:19:41 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-d7a6e2d6-e67f-4a73-97d0-3fc56a1552a5 tempest-VolumesListTestJSON-1804463790 None] Lock "cinder-45628fd9-719f-4927-aaf2-c664b9d23ebc-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:19:41 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-d7a6e2d6-e67f-4a73-97d0-3fc56a1552a5 tempest-VolumesListTestJSON-1804463790 None] Acquiring lock "cinder-quobyte-45628fd9-719f-4927-aaf2-c664b9d23ebc" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:19:41 devstack sudo[93691]: pam_unix(sudo:session): session closed for user root Jul 22 03:19:41 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-658666cf-e28b-4eda-a79a-ccf80ceb55aa tempest-VolumesTransfersTest-1654617451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b0dd8bb2-fff2-4381-9691-18fbdeb36a1e" returned: 0 in 0.337s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:19:41 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-658666cf-e28b-4eda-a79a-ccf80ceb55aa tempest-VolumesTransfersTest-1654617451 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:19:41 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-658666cf-e28b-4eda-a79a-ccf80ceb55aa tempest-VolumesTransfersTest-1654617451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:19:41 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-d7a6e2d6-e67f-4a73-97d0-3fc56a1552a5 tempest-VolumesListTestJSON-1804463790 None] Lock "cinder-quobyte-45628fd9-719f-4927-aaf2-c664b9d23ebc" acquired by "delete_volume" :: waited 0.023s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:19:41 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-47982b26-7fa9-42f5-9c1b-2b510a8dd192 tempest-SnapshotsActionsTest-1329048363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.563s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:19:41 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-47982b26-7fa9-42f5-9c1b-2b510a8dd192 tempest-SnapshotsActionsTest-1329048363 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:19:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1273133138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d01a3a60-aacf-4183-a2c5-769747c37d7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='331a12e7215247cc994b987e8de3ace7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:19:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:19:41Z,use_quota=True,user_id='ed6343b0a4f94045aeef06937305d9ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:19:41 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-47982b26-7fa9-42f5-9c1b-2b510a8dd192 tempest-SnapshotsActionsTest-1329048363 None] Creating volume d01a3a60-aacf-4183-a2c5-769747c37d7a {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:19:41 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-47982b26-7fa9-42f5-9c1b-2b510a8dd192 tempest-SnapshotsActionsTest-1329048363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:19:41 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-47982b26-7fa9-42f5-9c1b-2b510a8dd192 tempest-SnapshotsActionsTest-1329048363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:19:41 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-47982b26-7fa9-42f5-9c1b-2b510a8dd192 tempest-SnapshotsActionsTest-1329048363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:19:41 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-47982b26-7fa9-42f5-9c1b-2b510a8dd192 tempest-SnapshotsActionsTest-1329048363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:19:41 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-47982b26-7fa9-42f5-9c1b-2b510a8dd192 tempest-SnapshotsActionsTest-1329048363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:19:41 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-47982b26-7fa9-42f5-9c1b-2b510a8dd192 tempest-SnapshotsActionsTest-1329048363 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:19:41 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-47982b26-7fa9-42f5-9c1b-2b510a8dd192 tempest-SnapshotsActionsTest-1329048363 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:19:41 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-47982b26-7fa9-42f5-9c1b-2b510a8dd192 tempest-SnapshotsActionsTest-1329048363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:19:41 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[23823d9b-52bf-44aa-bf48-bfd971f8b044]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:19:41 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d7a6e2d6-e67f-4a73-97d0-3fc56a1552a5 tempest-VolumesListTestJSON-1804463790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-45628fd9-719f-4927-aaf2-c664b9d23ebc {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:19:41 devstack sudo[93694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a 1073741824 Jul 22 03:19:41 devstack sudo[93694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:19:41 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-658666cf-e28b-4eda-a79a-ccf80ceb55aa tempest-VolumesTransfersTest-1654617451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b651b85-820a-4e5f-976f-61bbeb951dba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0dd8bb2-fff2-4381-9691-18fbdeb36a1e', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:19:41 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-658666cf-e28b-4eda-a79a-ccf80ceb55aa tempest-VolumesTransfersTest-1654617451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3a76f07-6ffe-46ea-ab8d-d88349ce3f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:19:42 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-658666cf-e28b-4eda-a79a-ccf80ceb55aa tempest-VolumesTransfersTest-1654617451 None] Volume volume-b0dd8bb2-fff2-4381-9691-18fbdeb36a1e (b0dd8bb2-fff2-4381-9691-18fbdeb36a1e): created successfully Jul 22 03:19:42 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-658666cf-e28b-4eda-a79a-ccf80ceb55aa tempest-VolumesTransfersTest-1654617451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3a76f07-6ffe-46ea-ab8d-d88349ce3f60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:19:42 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-658666cf-e28b-4eda-a79a-ccf80ceb55aa tempest-VolumesTransfersTest-1654617451 None] Flow 'volume_create_manager' (80b4d60e-39c5-4381-8d21-07438e9cc881) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:19:42 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-658666cf-e28b-4eda-a79a-ccf80ceb55aa tempest-VolumesTransfersTest-1654617451 None] Created volume successfully. Jul 22 03:19:42 devstack sudo[93695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-45628fd9-719f-4927-aaf2-c664b9d23ebc Jul 22 03:19:42 devstack sudo[93695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:19:42 devstack sudo[93695]: pam_unix(sudo:session): session closed for user root Jul 22 03:19:42 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d7a6e2d6-e67f-4a73-97d0-3fc56a1552a5 tempest-VolumesListTestJSON-1804463790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-45628fd9-719f-4927-aaf2-c664b9d23ebc" returned: 0 in 0.381s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:19:42 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d7a6e2d6-e67f-4a73-97d0-3fc56a1552a5 tempest-VolumesListTestJSON-1804463790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-45628fd9-719f-4927-aaf2-c664b9d23ebc {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:19:42 devstack sudo[93704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-45628fd9-719f-4927-aaf2-c664b9d23ebc Jul 22 03:19:42 devstack sudo[93704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:19:42 devstack sudo[93694]: pam_unix(sudo:session): session closed for user root Jul 22 03:19:42 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-47982b26-7fa9-42f5-9c1b-2b510a8dd192 tempest-SnapshotsActionsTest-1329048363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a 1073741824" returned: 0 in 0.485s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:19:42 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-47982b26-7fa9-42f5-9c1b-2b510a8dd192 tempest-SnapshotsActionsTest-1329048363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:19:42 devstack sudo[93707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a Jul 22 03:19:42 devstack sudo[93707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:19:42 devstack sudo[93704]: pam_unix(sudo:session): session closed for user root Jul 22 03:19:42 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d7a6e2d6-e67f-4a73-97d0-3fc56a1552a5 tempest-VolumesListTestJSON-1804463790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-45628fd9-719f-4927-aaf2-c664b9d23ebc" returned: 0 in 0.266s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:19:42 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-d7a6e2d6-e67f-4a73-97d0-3fc56a1552a5 tempest-VolumesListTestJSON-1804463790 None] Lock "cinder-quobyte-45628fd9-719f-4927-aaf2-c664b9d23ebc" released by "delete_volume" :: held 0.702s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:19:42 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-d7a6e2d6-e67f-4a73-97d0-3fc56a1552a5 tempest-VolumesListTestJSON-1804463790 None] Created reservations ['8d9567d1-f5ca-4922-9ed7-6c623e484960', '0a9f3ae3-e56c-4601-93b2-e8a1f525fd90', '20020f79-26d6-4eda-804e-011900cc61ba', '043cc0fd-0fde-4746-b046-7fe408324212'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:19:42 devstack sudo[93707]: pam_unix(sudo:session): session closed for user root Jul 22 03:19:42 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-d7a6e2d6-e67f-4a73-97d0-3fc56a1552a5 tempest-VolumesListTestJSON-1804463790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:19:42 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-d7a6e2d6-e67f-4a73-97d0-3fc56a1552a5 tempest-VolumesListTestJSON-1804463790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:19:42 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-d7a6e2d6-e67f-4a73-97d0-3fc56a1552a5 tempest-VolumesListTestJSON-1804463790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:19:42 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-d7a6e2d6-e67f-4a73-97d0-3fc56a1552a5 tempest-VolumesListTestJSON-1804463790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:19:42 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-d7a6e2d6-e67f-4a73-97d0-3fc56a1552a5 tempest-VolumesListTestJSON-1804463790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:19:42 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d7a6e2d6-e67f-4a73-97d0-3fc56a1552a5 tempest-VolumesListTestJSON-1804463790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:19:42 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-47982b26-7fa9-42f5-9c1b-2b510a8dd192 tempest-SnapshotsActionsTest-1329048363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a" returned: 0 in 0.294s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:19:42 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-47982b26-7fa9-42f5-9c1b-2b510a8dd192 tempest-SnapshotsActionsTest-1329048363 None] <== create_volume: return (841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:19:42 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-47982b26-7fa9-42f5-9c1b-2b510a8dd192 tempest-SnapshotsActionsTest-1329048363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.844s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:19:42 devstack sudo[93712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:19:42 devstack sudo[93712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:19:42 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-47982b26-7fa9-42f5-9c1b-2b510a8dd192 tempest-SnapshotsActionsTest-1329048363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbe86c9c-569d-4cd0-a6ca-32e766d123bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d01a3a60-aacf-4183-a2c5-769747c37d7a', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:19:42 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-47982b26-7fa9-42f5-9c1b-2b510a8dd192 tempest-SnapshotsActionsTest-1329048363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a81023e3-3c2c-48b1-aa59-c68f5972d5b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:19:42 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-47982b26-7fa9-42f5-9c1b-2b510a8dd192 tempest-SnapshotsActionsTest-1329048363 None] Volume volume-d01a3a60-aacf-4183-a2c5-769747c37d7a (d01a3a60-aacf-4183-a2c5-769747c37d7a): created successfully Jul 22 03:19:42 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-47982b26-7fa9-42f5-9c1b-2b510a8dd192 tempest-SnapshotsActionsTest-1329048363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a81023e3-3c2c-48b1-aa59-c68f5972d5b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:19:42 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-47982b26-7fa9-42f5-9c1b-2b510a8dd192 tempest-SnapshotsActionsTest-1329048363 None] Flow 'volume_create_manager' (39e4fb0a-2e86-4570-8e74-0cd21bf34e0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:19:42 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-47982b26-7fa9-42f5-9c1b-2b510a8dd192 tempest-SnapshotsActionsTest-1329048363 None] Created volume successfully. Jul 22 03:19:43 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-465a3e1c-7fd9-4773-bafd-d4faac7e1656 tempest-VolumesListTestJSON-1804463790 None] Acquiring lock "cinder-0e9a8b90-dcda-40b5-bc22-7d6216592fb6-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:19:43 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-465a3e1c-7fd9-4773-bafd-d4faac7e1656 tempest-VolumesListTestJSON-1804463790 None] Lock "cinder-0e9a8b90-dcda-40b5-bc22-7d6216592fb6-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:19:43 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-465a3e1c-7fd9-4773-bafd-d4faac7e1656 tempest-VolumesListTestJSON-1804463790 None] Acquiring lock "cinder-quobyte-0e9a8b90-dcda-40b5-bc22-7d6216592fb6" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:19:43 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-465a3e1c-7fd9-4773-bafd-d4faac7e1656 tempest-VolumesListTestJSON-1804463790 None] Lock "cinder-quobyte-0e9a8b90-dcda-40b5-bc22-7d6216592fb6" acquired by "delete_volume" :: waited 0.024s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:19:43 devstack sudo[93712]: pam_unix(sudo:session): session closed for user root Jul 22 03:19:43 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d7a6e2d6-e67f-4a73-97d0-3fc56a1552a5 tempest-VolumesListTestJSON-1804463790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.444s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:19:43 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-d7a6e2d6-e67f-4a73-97d0-3fc56a1552a5 tempest-VolumesListTestJSON-1804463790 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:19:43 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-d7a6e2d6-e67f-4a73-97d0-3fc56a1552a5 tempest-VolumesListTestJSON-1804463790 None] Deleted volume successfully. Jul 22 03:19:43 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd229107-f265-4ced-a9de-e7d9188c7850]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:19:43 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-465a3e1c-7fd9-4773-bafd-d4faac7e1656 tempest-VolumesListTestJSON-1804463790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0e9a8b90-dcda-40b5-bc22-7d6216592fb6 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:19:43 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-d7a6e2d6-e67f-4a73-97d0-3fc56a1552a5 tempest-VolumesListTestJSON-1804463790 None] Lock "cinder-45628fd9-719f-4927-aaf2-c664b9d23ebc-delete_volume" released by "delete_volume" :: held 1.429s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:19:43 devstack sudo[93715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0e9a8b90-dcda-40b5-bc22-7d6216592fb6 Jul 22 03:19:43 devstack sudo[93715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:19:43 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-c1b3257e-7b81-470f-8d9b-6ba7d673ef76 tempest-SnapshotsActionsTest-1329048363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:19:43 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-c1b3257e-7b81-470f-8d9b-6ba7d673ef76 tempest-SnapshotsActionsTest-1329048363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:19:43 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-c1b3257e-7b81-470f-8d9b-6ba7d673ef76 tempest-SnapshotsActionsTest-1329048363 None] Creating offline snapshot 97226f74-0159-4b9a-b538-229d4a909064 of volume d01a3a60-aacf-4183-a2c5-769747c37d7a {{(pid=87747) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 03:19:43 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[e64c419a-e0d6-4a2f-9f48-ca1a0f789aba]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:19:43 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-c1b3257e-7b81-470f-8d9b-6ba7d673ef76 tempest-SnapshotsActionsTest-1329048363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:19:43 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-dee53fe1-202f-4f8d-9b7b-8df38fca0f71 tempest-VolumesTransfersTest-1241856813 None] Transfer volume completed successfully. Jul 22 03:19:43 devstack sudo[93715]: pam_unix(sudo:session): session closed for user root Jul 22 03:19:43 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-465a3e1c-7fd9-4773-bafd-d4faac7e1656 tempest-VolumesListTestJSON-1804463790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0e9a8b90-dcda-40b5-bc22-7d6216592fb6" returned: 0 in 0.557s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:19:43 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-465a3e1c-7fd9-4773-bafd-d4faac7e1656 tempest-VolumesListTestJSON-1804463790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0e9a8b90-dcda-40b5-bc22-7d6216592fb6 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:19:43 devstack sudo[93717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a Jul 22 03:19:43 devstack sudo[93717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:19:43 devstack sudo[93721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0e9a8b90-dcda-40b5-bc22-7d6216592fb6 Jul 22 03:19:43 devstack sudo[93721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:19:44 devstack sudo[93717]: pam_unix(sudo:session): session closed for user root Jul 22 03:19:44 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-c1b3257e-7b81-470f-8d9b-6ba7d673ef76 tempest-SnapshotsActionsTest-1329048363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a" returned: 0 in 0.541s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:19:44 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-c1b3257e-7b81-470f-8d9b-6ba7d673ef76 tempest-SnapshotsActionsTest-1329048363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.97226f74-0159-4b9a-b538-229d4a909064 1G {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:19:44 devstack sudo[93734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.97226f74-0159-4b9a-b538-229d4a909064 1G Jul 22 03:19:44 devstack sudo[93734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:19:44 devstack sudo[93721]: pam_unix(sudo:session): session closed for user root Jul 22 03:19:44 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-465a3e1c-7fd9-4773-bafd-d4faac7e1656 tempest-VolumesListTestJSON-1804463790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0e9a8b90-dcda-40b5-bc22-7d6216592fb6" returned: 0 in 0.450s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:19:44 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-465a3e1c-7fd9-4773-bafd-d4faac7e1656 tempest-VolumesListTestJSON-1804463790 None] Lock "cinder-quobyte-0e9a8b90-dcda-40b5-bc22-7d6216592fb6" released by "delete_volume" :: held 1.080s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:19:44 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-465a3e1c-7fd9-4773-bafd-d4faac7e1656 tempest-VolumesListTestJSON-1804463790 None] Created reservations ['2cc4eda5-cf24-4a13-b17f-6df3accb389a', 'da450a5c-a769-41b9-9ef0-7175d66cee0d', '93e78afa-1627-4964-8c3d-5980e980c8fb', '87eea130-3fb8-4e1b-9cae-a0938e239dc3'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:19:44 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-465a3e1c-7fd9-4773-bafd-d4faac7e1656 tempest-VolumesListTestJSON-1804463790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:19:44 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-465a3e1c-7fd9-4773-bafd-d4faac7e1656 tempest-VolumesListTestJSON-1804463790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:19:44 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-465a3e1c-7fd9-4773-bafd-d4faac7e1656 tempest-VolumesListTestJSON-1804463790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:19:44 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-465a3e1c-7fd9-4773-bafd-d4faac7e1656 tempest-VolumesListTestJSON-1804463790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:19:44 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-465a3e1c-7fd9-4773-bafd-d4faac7e1656 tempest-VolumesListTestJSON-1804463790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:19:44 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-465a3e1c-7fd9-4773-bafd-d4faac7e1656 tempest-VolumesListTestJSON-1804463790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:19:44 devstack sudo[93736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:19:44 devstack sudo[93736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:19:44 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-b82947f0-f651-4a9f-b4f7-5d2a988585b7 tempest-VolumesTransfersTest-65232147 None] Acquiring lock "cinder-b0dd8bb2-fff2-4381-9691-18fbdeb36a1e-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:19:44 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-b82947f0-f651-4a9f-b4f7-5d2a988585b7 tempest-VolumesTransfersTest-65232147 None] Lock "cinder-b0dd8bb2-fff2-4381-9691-18fbdeb36a1e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:19:44 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-b82947f0-f651-4a9f-b4f7-5d2a988585b7 tempest-VolumesTransfersTest-65232147 None] Acquiring lock "cinder-quobyte-b0dd8bb2-fff2-4381-9691-18fbdeb36a1e" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:19:44 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-b82947f0-f651-4a9f-b4f7-5d2a988585b7 tempest-VolumesTransfersTest-65232147 None] Lock "cinder-quobyte-b0dd8bb2-fff2-4381-9691-18fbdeb36a1e" acquired by "delete_volume" :: waited 0.039s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:19:44 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[301f0779-2730-48f5-9ec0-723faa7214a7]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:19:44 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b82947f0-f651-4a9f-b4f7-5d2a988585b7 tempest-VolumesTransfersTest-65232147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b0dd8bb2-fff2-4381-9691-18fbdeb36a1e {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:19:44 devstack sudo[93741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b0dd8bb2-fff2-4381-9691-18fbdeb36a1e Jul 22 03:19:44 devstack sudo[93741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:19:44 devstack sudo[93734]: pam_unix(sudo:session): session closed for user root Jul 22 03:19:44 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-c1b3257e-7b81-470f-8d9b-6ba7d673ef76 tempest-SnapshotsActionsTest-1329048363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.97226f74-0159-4b9a-b538-229d4a909064 1G" returned: 0 in 0.594s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:19:44 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-c1b3257e-7b81-470f-8d9b-6ba7d673ef76 tempest-SnapshotsActionsTest-1329048363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d01a3a60-aacf-4183-a2c5-769747c37d7a -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.97226f74-0159-4b9a-b538-229d4a909064 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:19:44 devstack sudo[93736]: pam_unix(sudo:session): session closed for user root Jul 22 03:19:44 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-465a3e1c-7fd9-4773-bafd-d4faac7e1656 tempest-VolumesListTestJSON-1804463790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.391s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:19:44 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-465a3e1c-7fd9-4773-bafd-d4faac7e1656 tempest-VolumesListTestJSON-1804463790 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:19:44 devstack sudo[93746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d01a3a60-aacf-4183-a2c5-769747c37d7a -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.97226f74-0159-4b9a-b538-229d4a909064 Jul 22 03:19:44 devstack sudo[93746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:19:44 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-465a3e1c-7fd9-4773-bafd-d4faac7e1656 tempest-VolumesListTestJSON-1804463790 None] Deleted volume successfully. Jul 22 03:19:44 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-465a3e1c-7fd9-4773-bafd-d4faac7e1656 tempest-VolumesListTestJSON-1804463790 None] Lock "cinder-0e9a8b90-dcda-40b5-bc22-7d6216592fb6-delete_volume" released by "delete_volume" :: held 1.735s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:19:45 devstack sudo[93741]: pam_unix(sudo:session): session closed for user root Jul 22 03:19:45 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b82947f0-f651-4a9f-b4f7-5d2a988585b7 tempest-VolumesTransfersTest-65232147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b0dd8bb2-fff2-4381-9691-18fbdeb36a1e" returned: 0 in 0.443s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:19:45 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b82947f0-f651-4a9f-b4f7-5d2a988585b7 tempest-VolumesTransfersTest-65232147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b0dd8bb2-fff2-4381-9691-18fbdeb36a1e {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:19:45 devstack sudo[93756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b0dd8bb2-fff2-4381-9691-18fbdeb36a1e Jul 22 03:19:45 devstack sudo[93756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:19:45 devstack sudo[93746]: pam_unix(sudo:session): session closed for user root Jul 22 03:19:45 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-c1b3257e-7b81-470f-8d9b-6ba7d673ef76 tempest-SnapshotsActionsTest-1329048363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d01a3a60-aacf-4183-a2c5-769747c37d7a -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.97226f74-0159-4b9a-b538-229d4a909064" returned: 0 in 0.343s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:19:45 devstack cinder-volume[87747]: WARNING cinder.volume.drivers.remotefs [None req-c1b3257e-7b81-470f-8d9b-6ba7d673ef76 tempest-SnapshotsActionsTest-1329048363 None] /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.97226f74-0159-4b9a-b538-229d4a909064 is being set with open permissions: ugo+rw Jul 22 03:19:45 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-c1b3257e-7b81-470f-8d9b-6ba7d673ef76 tempest-SnapshotsActionsTest-1329048363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.97226f74-0159-4b9a-b538-229d4a909064 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:19:45 devstack sudo[93758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.97226f74-0159-4b9a-b538-229d4a909064 Jul 22 03:19:45 devstack sudo[93758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:19:45 devstack sudo[93756]: pam_unix(sudo:session): session closed for user root Jul 22 03:19:45 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b82947f0-f651-4a9f-b4f7-5d2a988585b7 tempest-VolumesTransfersTest-65232147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b0dd8bb2-fff2-4381-9691-18fbdeb36a1e" returned: 0 in 0.296s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:19:45 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-b82947f0-f651-4a9f-b4f7-5d2a988585b7 tempest-VolumesTransfersTest-65232147 None] Lock "cinder-quobyte-b0dd8bb2-fff2-4381-9691-18fbdeb36a1e" released by "delete_volume" :: held 0.800s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:19:45 devstack sudo[93758]: pam_unix(sudo:session): session closed for user root Jul 22 03:19:45 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-c1b3257e-7b81-470f-8d9b-6ba7d673ef76 tempest-SnapshotsActionsTest-1329048363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.97226f74-0159-4b9a-b538-229d4a909064" returned: 0 in 0.292s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:19:45 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-c1b3257e-7b81-470f-8d9b-6ba7d673ef76 tempest-SnapshotsActionsTest-1329048363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.info {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:19:45 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-b82947f0-f651-4a9f-b4f7-5d2a988585b7 tempest-VolumesTransfersTest-65232147 None] Created reservations ['c7bb27a3-0f93-4437-b791-71e89b6c2fe3', '6fa308e9-1ce6-4a69-85a7-d3dfed00bff9', 'c7213329-2742-4105-9230-3ee9eb6b3e73', '4cdd720d-199b-42d2-a4c2-da2146d566c9'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:19:45 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-880f84ab-6d54-4588-b26a-3ef2745e7861 tempest-VolumesListTestJSON-1804463790 None] Acquiring lock "cinder-ed252e63-775b-4782-bfe9-be61467ae239-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:19:45 devstack sudo[93762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.info Jul 22 03:19:45 devstack sudo[93762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:19:45 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-880f84ab-6d54-4588-b26a-3ef2745e7861 tempest-VolumesListTestJSON-1804463790 None] Lock "cinder-ed252e63-775b-4782-bfe9-be61467ae239-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:19:45 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-880f84ab-6d54-4588-b26a-3ef2745e7861 tempest-VolumesListTestJSON-1804463790 None] Acquiring lock "cinder-quobyte-ed252e63-775b-4782-bfe9-be61467ae239" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:19:45 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-880f84ab-6d54-4588-b26a-3ef2745e7861 tempest-VolumesListTestJSON-1804463790 None] Lock "cinder-quobyte-ed252e63-775b-4782-bfe9-be61467ae239" acquired by "delete_volume" :: waited 0.025s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:19:45 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b82947f0-f651-4a9f-b4f7-5d2a988585b7 tempest-VolumesTransfersTest-65232147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:19:45 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b82947f0-f651-4a9f-b4f7-5d2a988585b7 tempest-VolumesTransfersTest-65232147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:19:45 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-b82947f0-f651-4a9f-b4f7-5d2a988585b7 tempest-VolumesTransfersTest-65232147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:19:45 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-b82947f0-f651-4a9f-b4f7-5d2a988585b7 tempest-VolumesTransfersTest-65232147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:19:45 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b82947f0-f651-4a9f-b4f7-5d2a988585b7 tempest-VolumesTransfersTest-65232147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:19:45 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b82947f0-f651-4a9f-b4f7-5d2a988585b7 tempest-VolumesTransfersTest-65232147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:19:45 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[a149d29a-74ac-4bf7-a481-3f7816f7db48]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:19:45 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-880f84ab-6d54-4588-b26a-3ef2745e7861 tempest-VolumesListTestJSON-1804463790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ed252e63-775b-4782-bfe9-be61467ae239 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:19:45 devstack sudo[93764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:19:45 devstack sudo[93764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:19:45 devstack sudo[93762]: pam_unix(sudo:session): session closed for user root Jul 22 03:19:45 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-c1b3257e-7b81-470f-8d9b-6ba7d673ef76 tempest-SnapshotsActionsTest-1329048363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.info" returned: 0 in 0.475s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:19:45 devstack cinder-volume[87747]: WARNING cinder.volume.drivers.remotefs [None req-c1b3257e-7b81-470f-8d9b-6ba7d673ef76 tempest-SnapshotsActionsTest-1329048363 None] /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.info is being set with open permissions: ugo+rw Jul 22 03:19:45 devstack sudo[93765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ed252e63-775b-4782-bfe9-be61467ae239 Jul 22 03:19:45 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-c1b3257e-7b81-470f-8d9b-6ba7d673ef76 tempest-SnapshotsActionsTest-1329048363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.info {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:19:45 devstack sudo[93765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:19:46 devstack sudo[93769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.info Jul 22 03:19:46 devstack sudo[93769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:19:46 devstack sudo[93764]: pam_unix(sudo:session): session closed for user root Jul 22 03:19:46 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b82947f0-f651-4a9f-b4f7-5d2a988585b7 tempest-VolumesTransfersTest-65232147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.482s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:19:46 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-b82947f0-f651-4a9f-b4f7-5d2a988585b7 tempest-VolumesTransfersTest-65232147 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:19:46 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-b82947f0-f651-4a9f-b4f7-5d2a988585b7 tempest-VolumesTransfersTest-65232147 None] Deleted volume successfully. Jul 22 03:19:46 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-b82947f0-f651-4a9f-b4f7-5d2a988585b7 tempest-VolumesTransfersTest-65232147 None] Lock "cinder-b0dd8bb2-fff2-4381-9691-18fbdeb36a1e-delete_volume" released by "delete_volume" :: held 1.735s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:19:46 devstack sudo[93769]: pam_unix(sudo:session): session closed for user root Jul 22 03:19:46 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-c1b3257e-7b81-470f-8d9b-6ba7d673ef76 tempest-SnapshotsActionsTest-1329048363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.info" returned: 0 in 0.385s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:19:46 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-c1b3257e-7b81-470f-8d9b-6ba7d673ef76 tempest-SnapshotsActionsTest-1329048363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.761s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:19:46 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-c1b3257e-7b81-470f-8d9b-6ba7d673ef76 tempest-SnapshotsActionsTest-1329048363 None] Create snapshot completed successfully Jul 22 03:19:46 devstack sudo[93765]: pam_unix(sudo:session): session closed for user root Jul 22 03:19:46 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-880f84ab-6d54-4588-b26a-3ef2745e7861 tempest-VolumesListTestJSON-1804463790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ed252e63-775b-4782-bfe9-be61467ae239" returned: 0 in 0.733s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:19:46 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-880f84ab-6d54-4588-b26a-3ef2745e7861 tempest-VolumesListTestJSON-1804463790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ed252e63-775b-4782-bfe9-be61467ae239 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:19:46 devstack sudo[93777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ed252e63-775b-4782-bfe9-be61467ae239 Jul 22 03:19:46 devstack sudo[93777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:19:46 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e457027-d3a3-4ae3-92e3-c9881a09885d tempest-VolumesTransfersTest-1654617451 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:19:46 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-5e457027-d3a3-4ae3-92e3-c9881a09885d tempest-VolumesTransfersTest-1654617451 None] Flow 'volume_create_manager' (7992f384-130e-4713-bd91-0bc19dcb2366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:19:46 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-5e457027-d3a3-4ae3-92e3-c9881a09885d tempest-VolumesTransfersTest-1654617451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b43dc84-0730-4369-a447-f10d560f0108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:19:46 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-5e457027-d3a3-4ae3-92e3-c9881a09885d tempest-VolumesTransfersTest-1654617451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b43dc84-0730-4369-a447-f10d560f0108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:19:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-187847202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79772453-fc57-47f7-90e9-c845fa49ee7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='985643bedf064665b409152147dda844',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:19:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:19:47Z,use_quota=True,user_id='c5df1b6614c64cc9b1fe7a44b3f6e873',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:19:46 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-5e457027-d3a3-4ae3-92e3-c9881a09885d tempest-VolumesTransfersTest-1654617451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b0c1233-b0dc-47dc-9809-a464165445ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:19:46 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-5e457027-d3a3-4ae3-92e3-c9881a09885d tempest-VolumesTransfersTest-1654617451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b0c1233-b0dc-47dc-9809-a464165445ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:19:46 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-5e457027-d3a3-4ae3-92e3-c9881a09885d tempest-VolumesTransfersTest-1654617451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a8e0837-a861-430a-83b8-b352c4d3ed18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:19:46 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-5e457027-d3a3-4ae3-92e3-c9881a09885d tempest-VolumesTransfersTest-1654617451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a8e0837-a861-430a-83b8-b352c4d3ed18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79772453-fc57-47f7-90e9-c845fa49ee7e', 'volume_name': 'volume-79772453-fc57-47f7-90e9-c845fa49ee7e', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:19:46 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-5e457027-d3a3-4ae3-92e3-c9881a09885d tempest-VolumesTransfersTest-1654617451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9481f53-15a9-4cfd-97f1-05372cbac214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:19:46 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-5e457027-d3a3-4ae3-92e3-c9881a09885d tempest-VolumesTransfersTest-1654617451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9481f53-15a9-4cfd-97f1-05372cbac214) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:19:46 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-5e457027-d3a3-4ae3-92e3-c9881a09885d tempest-VolumesTransfersTest-1654617451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c804f02c-d189-4a58-8d6d-8bd9f895c10b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:19:46 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-5e457027-d3a3-4ae3-92e3-c9881a09885d tempest-VolumesTransfersTest-1654617451 None] Volume 79772453-fc57-47f7-90e9-c845fa49ee7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79772453-fc57-47f7-90e9-c845fa49ee7e', 'volume_size': 1} Jul 22 03:19:46 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-5e457027-d3a3-4ae3-92e3-c9881a09885d tempest-VolumesTransfersTest-1654617451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:19:46 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-5e457027-d3a3-4ae3-92e3-c9881a09885d tempest-VolumesTransfersTest-1654617451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:19:46 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-5e457027-d3a3-4ae3-92e3-c9881a09885d tempest-VolumesTransfersTest-1654617451 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:19:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-187847202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79772453-fc57-47f7-90e9-c845fa49ee7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='985643bedf064665b409152147dda844',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:19:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:19:47Z,use_quota=True,user_id='c5df1b6614c64cc9b1fe7a44b3f6e873',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:19:46 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-5e457027-d3a3-4ae3-92e3-c9881a09885d tempest-VolumesTransfersTest-1654617451 None] Creating volume 79772453-fc57-47f7-90e9-c845fa49ee7e {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:19:46 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-5e457027-d3a3-4ae3-92e3-c9881a09885d tempest-VolumesTransfersTest-1654617451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:19:46 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-5e457027-d3a3-4ae3-92e3-c9881a09885d tempest-VolumesTransfersTest-1654617451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:19:46 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-5e457027-d3a3-4ae3-92e3-c9881a09885d tempest-VolumesTransfersTest-1654617451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:19:46 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-5e457027-d3a3-4ae3-92e3-c9881a09885d tempest-VolumesTransfersTest-1654617451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:19:46 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-5e457027-d3a3-4ae3-92e3-c9881a09885d tempest-VolumesTransfersTest-1654617451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:19:46 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-5e457027-d3a3-4ae3-92e3-c9881a09885d tempest-VolumesTransfersTest-1654617451 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:19:46 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-5e457027-d3a3-4ae3-92e3-c9881a09885d tempest-VolumesTransfersTest-1654617451 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:19:46 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5e457027-d3a3-4ae3-92e3-c9881a09885d tempest-VolumesTransfersTest-1654617451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-79772453-fc57-47f7-90e9-c845fa49ee7e 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:19:46 devstack sudo[93780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-79772453-fc57-47f7-90e9-c845fa49ee7e 1073741824 Jul 22 03:19:46 devstack sudo[93780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:19:46 devstack sudo[93777]: pam_unix(sudo:session): session closed for user root Jul 22 03:19:46 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-880f84ab-6d54-4588-b26a-3ef2745e7861 tempest-VolumesListTestJSON-1804463790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ed252e63-775b-4782-bfe9-be61467ae239" returned: 0 in 0.311s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:19:46 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-880f84ab-6d54-4588-b26a-3ef2745e7861 tempest-VolumesListTestJSON-1804463790 None] Lock "cinder-quobyte-ed252e63-775b-4782-bfe9-be61467ae239" released by "delete_volume" :: held 1.138s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:19:46 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-880f84ab-6d54-4588-b26a-3ef2745e7861 tempest-VolumesListTestJSON-1804463790 None] Created reservations ['68fe8ccd-b70e-4901-a1f4-2bcc61226842', '4c51acaf-eef8-4aef-b80e-b69ac2c70b99', '2977797f-cd5a-4e68-9f88-9ec39dd3a5d4', '64a54d80-07b3-4944-9696-d142fc821734'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:19:46 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-880f84ab-6d54-4588-b26a-3ef2745e7861 tempest-VolumesListTestJSON-1804463790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:19:46 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-880f84ab-6d54-4588-b26a-3ef2745e7861 tempest-VolumesListTestJSON-1804463790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:19:46 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-880f84ab-6d54-4588-b26a-3ef2745e7861 tempest-VolumesListTestJSON-1804463790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:19:46 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-880f84ab-6d54-4588-b26a-3ef2745e7861 tempest-VolumesListTestJSON-1804463790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:19:46 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-880f84ab-6d54-4588-b26a-3ef2745e7861 tempest-VolumesListTestJSON-1804463790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:19:46 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-880f84ab-6d54-4588-b26a-3ef2745e7861 tempest-VolumesListTestJSON-1804463790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:19:46 devstack sudo[93782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:19:46 devstack sudo[93782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:19:47 devstack sudo[93780]: pam_unix(sudo:session): session closed for user root Jul 22 03:19:47 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5e457027-d3a3-4ae3-92e3-c9881a09885d tempest-VolumesTransfersTest-1654617451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-79772453-fc57-47f7-90e9-c845fa49ee7e 1073741824" returned: 0 in 0.603s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:19:47 devstack sudo[93782]: pam_unix(sudo:session): session closed for user root Jul 22 03:19:47 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-880f84ab-6d54-4588-b26a-3ef2745e7861 tempest-VolumesListTestJSON-1804463790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.361s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:19:47 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-880f84ab-6d54-4588-b26a-3ef2745e7861 tempest-VolumesListTestJSON-1804463790 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:19:47 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-880f84ab-6d54-4588-b26a-3ef2745e7861 tempest-VolumesListTestJSON-1804463790 None] Deleted volume successfully. Jul 22 03:19:47 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-ed1cbd92-e7c6-417c-9950-40334c5d931e tempest-SnapshotsActionsTest-1329048363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:19:47 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-880f84ab-6d54-4588-b26a-3ef2745e7861 tempest-VolumesListTestJSON-1804463790 None] Lock "cinder-ed252e63-775b-4782-bfe9-be61467ae239-delete_volume" released by "delete_volume" :: held 1.821s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:19:47 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5e457027-d3a3-4ae3-92e3-c9881a09885d tempest-VolumesTransfersTest-1654617451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-79772453-fc57-47f7-90e9-c845fa49ee7e {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:19:47 devstack sudo[93788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-79772453-fc57-47f7-90e9-c845fa49ee7e Jul 22 03:19:47 devstack sudo[93788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:19:47 devstack sudo[93788]: pam_unix(sudo:session): session closed for user root Jul 22 03:19:47 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5e457027-d3a3-4ae3-92e3-c9881a09885d tempest-VolumesTransfersTest-1654617451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-79772453-fc57-47f7-90e9-c845fa49ee7e" returned: 0 in 0.273s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:19:47 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-5e457027-d3a3-4ae3-92e3-c9881a09885d tempest-VolumesTransfersTest-1654617451 None] <== create_volume: return (975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:19:47 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-5e457027-d3a3-4ae3-92e3-c9881a09885d tempest-VolumesTransfersTest-1654617451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:19:47 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-ed1cbd92-e7c6-417c-9950-40334c5d931e tempest-SnapshotsActionsTest-1329048363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.285s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:19:47 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-ed1cbd92-e7c6-417c-9950-40334c5d931e tempest-SnapshotsActionsTest-1329048363 None] Creating offline snapshot dbba0708-cfc5-40fc-b162-8dc1da6c5aca of volume d01a3a60-aacf-4183-a2c5-769747c37d7a {{(pid=87747) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 03:19:47 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-5e457027-d3a3-4ae3-92e3-c9881a09885d tempest-VolumesTransfersTest-1654617451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c804f02c-d189-4a58-8d6d-8bd9f895c10b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79772453-fc57-47f7-90e9-c845fa49ee7e', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:19:47 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-5e457027-d3a3-4ae3-92e3-c9881a09885d tempest-VolumesTransfersTest-1654617451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d5e2644-db12-400a-9e24-8fbc414f34a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:19:47 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[519dad5e-0c12-442f-887e-af858f7759b2]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:19:47 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ed1cbd92-e7c6-417c-9950-40334c5d931e tempest-SnapshotsActionsTest-1329048363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.97226f74-0159-4b9a-b538-229d4a909064 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:19:47 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-5e457027-d3a3-4ae3-92e3-c9881a09885d tempest-VolumesTransfersTest-1654617451 None] Volume volume-79772453-fc57-47f7-90e9-c845fa49ee7e (79772453-fc57-47f7-90e9-c845fa49ee7e): created successfully Jul 22 03:19:47 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-5e457027-d3a3-4ae3-92e3-c9881a09885d tempest-VolumesTransfersTest-1654617451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d5e2644-db12-400a-9e24-8fbc414f34a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:19:47 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-5e457027-d3a3-4ae3-92e3-c9881a09885d tempest-VolumesTransfersTest-1654617451 None] Flow 'volume_create_manager' (7992f384-130e-4713-bd91-0bc19dcb2366) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:19:47 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-5e457027-d3a3-4ae3-92e3-c9881a09885d tempest-VolumesTransfersTest-1654617451 None] Created volume successfully. Jul 22 03:19:47 devstack sudo[93800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.97226f74-0159-4b9a-b538-229d4a909064 Jul 22 03:19:47 devstack sudo[93800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:19:48 devstack sudo[93800]: pam_unix(sudo:session): session closed for user root Jul 22 03:19:48 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ed1cbd92-e7c6-417c-9950-40334c5d931e tempest-SnapshotsActionsTest-1329048363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.97226f74-0159-4b9a-b538-229d4a909064" returned: 0 in 0.409s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:19:48 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-ed1cbd92-e7c6-417c-9950-40334c5d931e tempest-SnapshotsActionsTest-1329048363 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d01a3a60-aacf-4183-a2c5-769747c37d7a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87747) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 03:19:48 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ed1cbd92-e7c6-417c-9950-40334c5d931e tempest-SnapshotsActionsTest-1329048363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.97226f74-0159-4b9a-b538-229d4a909064,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.dbba0708-cfc5-40fc-b162-8dc1da6c5aca 1G {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:19:48 devstack sudo[93805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.97226f74-0159-4b9a-b538-229d4a909064,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.dbba0708-cfc5-40fc-b162-8dc1da6c5aca 1G Jul 22 03:19:48 devstack sudo[93805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:19:48 devstack sudo[93805]: pam_unix(sudo:session): session closed for user root Jul 22 03:19:48 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ed1cbd92-e7c6-417c-9950-40334c5d931e tempest-SnapshotsActionsTest-1329048363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.97226f74-0159-4b9a-b538-229d4a909064,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.dbba0708-cfc5-40fc-b162-8dc1da6c5aca 1G" returned: 0 in 0.500s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:19:48 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ed1cbd92-e7c6-417c-9950-40334c5d931e tempest-SnapshotsActionsTest-1329048363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.97226f74-0159-4b9a-b538-229d4a909064 -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.dbba0708-cfc5-40fc-b162-8dc1da6c5aca {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:19:48 devstack sudo[93811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.97226f74-0159-4b9a-b538-229d4a909064 -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.dbba0708-cfc5-40fc-b162-8dc1da6c5aca Jul 22 03:19:48 devstack sudo[93811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:19:48 devstack sudo[93811]: pam_unix(sudo:session): session closed for user root Jul 22 03:19:49 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ed1cbd92-e7c6-417c-9950-40334c5d931e tempest-SnapshotsActionsTest-1329048363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.97226f74-0159-4b9a-b538-229d4a909064 -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.dbba0708-cfc5-40fc-b162-8dc1da6c5aca" returned: 0 in 0.351s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:19:49 devstack cinder-volume[87747]: WARNING cinder.volume.drivers.remotefs [None req-ed1cbd92-e7c6-417c-9950-40334c5d931e tempest-SnapshotsActionsTest-1329048363 None] /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.dbba0708-cfc5-40fc-b162-8dc1da6c5aca is being set with open permissions: ugo+rw Jul 22 03:19:49 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ed1cbd92-e7c6-417c-9950-40334c5d931e tempest-SnapshotsActionsTest-1329048363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.dbba0708-cfc5-40fc-b162-8dc1da6c5aca {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:19:49 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-5c749025-cad8-4967-a99f-3c25ce6aebba tempest-VolumesTransfersTest-65232147 None] Acquiring lock "cinder-79772453-fc57-47f7-90e9-c845fa49ee7e-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:19:49 devstack sudo[93816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.dbba0708-cfc5-40fc-b162-8dc1da6c5aca Jul 22 03:19:49 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-5c749025-cad8-4967-a99f-3c25ce6aebba tempest-VolumesTransfersTest-65232147 None] Lock "cinder-79772453-fc57-47f7-90e9-c845fa49ee7e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:19:49 devstack sudo[93816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:19:49 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-5c749025-cad8-4967-a99f-3c25ce6aebba tempest-VolumesTransfersTest-65232147 None] Acquiring lock "cinder-quobyte-79772453-fc57-47f7-90e9-c845fa49ee7e" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:19:49 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-5c749025-cad8-4967-a99f-3c25ce6aebba tempest-VolumesTransfersTest-65232147 None] Lock "cinder-quobyte-79772453-fc57-47f7-90e9-c845fa49ee7e" acquired by "delete_volume" :: waited 0.027s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:19:49 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b11f85-8f32-4faa-bbf3-1553c23c21a6]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:19:49 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5c749025-cad8-4967-a99f-3c25ce6aebba tempest-VolumesTransfersTest-65232147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-79772453-fc57-47f7-90e9-c845fa49ee7e {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:19:49 devstack sudo[93818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-79772453-fc57-47f7-90e9-c845fa49ee7e Jul 22 03:19:49 devstack sudo[93818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:19:49 devstack sudo[93816]: pam_unix(sudo:session): session closed for user root Jul 22 03:19:49 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ed1cbd92-e7c6-417c-9950-40334c5d931e tempest-SnapshotsActionsTest-1329048363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.dbba0708-cfc5-40fc-b162-8dc1da6c5aca" returned: 0 in 0.303s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:19:49 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-ed1cbd92-e7c6-417c-9950-40334c5d931e tempest-SnapshotsActionsTest-1329048363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.687s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:19:49 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-ed1cbd92-e7c6-417c-9950-40334c5d931e tempest-SnapshotsActionsTest-1329048363 None] Create snapshot completed successfully Jul 22 03:19:49 devstack sudo[93818]: pam_unix(sudo:session): session closed for user root Jul 22 03:19:49 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5c749025-cad8-4967-a99f-3c25ce6aebba tempest-VolumesTransfersTest-65232147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-79772453-fc57-47f7-90e9-c845fa49ee7e" returned: 0 in 0.399s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:19:49 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5c749025-cad8-4967-a99f-3c25ce6aebba tempest-VolumesTransfersTest-65232147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-79772453-fc57-47f7-90e9-c845fa49ee7e {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:19:49 devstack sudo[93824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-79772453-fc57-47f7-90e9-c845fa49ee7e Jul 22 03:19:49 devstack sudo[93824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:19:49 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-65614ab4-2dff-4e73-b7a4-265ce7fda2fa tempest-SnapshotsActionsTest-618519404 None] Acquiring lock "cinder-dbba0708-cfc5-40fc-b162-8dc1da6c5aca-delete_snapshot" by "delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:19:49 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-65614ab4-2dff-4e73-b7a4-265ce7fda2fa tempest-SnapshotsActionsTest-618519404 None] Lock "cinder-dbba0708-cfc5-40fc-b162-8dc1da6c5aca-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:19:49 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-65614ab4-2dff-4e73-b7a4-265ce7fda2fa tempest-SnapshotsActionsTest-618519404 None] Acquiring lock "cinder-quobyte-d01a3a60-aacf-4183-a2c5-769747c37d7a" by "delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:19:49 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-65614ab4-2dff-4e73-b7a4-265ce7fda2fa tempest-SnapshotsActionsTest-618519404 None] Lock "cinder-quobyte-d01a3a60-aacf-4183-a2c5-769747c37d7a" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:19:49 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-65614ab4-2dff-4e73-b7a4-265ce7fda2fa tempest-SnapshotsActionsTest-618519404 None] Acquiring lock "cinder-quobyte-dbba0708-cfc5-40fc-b162-8dc1da6c5aca" by "_delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:19:49 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-65614ab4-2dff-4e73-b7a4-265ce7fda2fa tempest-SnapshotsActionsTest-618519404 None] Lock "cinder-quobyte-dbba0708-cfc5-40fc-b162-8dc1da6c5aca" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:19:49 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-65614ab4-2dff-4e73-b7a4-265ce7fda2fa tempest-SnapshotsActionsTest-618519404 None] Deleting offline snapshot dbba0708-cfc5-40fc-b162-8dc1da6c5aca of volume d01a3a60-aacf-4183-a2c5-769747c37d7a {{(pid=87747) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 03:19:49 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-65614ab4-2dff-4e73-b7a4-265ce7fda2fa tempest-SnapshotsActionsTest-618519404 None] snapshot_file for this snap is: volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.dbba0708-cfc5-40fc-b162-8dc1da6c5aca {{(pid=87747) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 03:19:49 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee208fe8-3849-41eb-8a54-e6435c7268f4]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:19:49 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-65614ab4-2dff-4e73-b7a4-265ce7fda2fa tempest-SnapshotsActionsTest-618519404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.dbba0708-cfc5-40fc-b162-8dc1da6c5aca {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:19:49 devstack sudo[93824]: pam_unix(sudo:session): session closed for user root Jul 22 03:19:49 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5c749025-cad8-4967-a99f-3c25ce6aebba tempest-VolumesTransfersTest-65232147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-79772453-fc57-47f7-90e9-c845fa49ee7e" returned: 0 in 0.280s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:19:49 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-5c749025-cad8-4967-a99f-3c25ce6aebba tempest-VolumesTransfersTest-65232147 None] Lock "cinder-quobyte-79772453-fc57-47f7-90e9-c845fa49ee7e" released by "delete_volume" :: held 0.736s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:19:49 devstack sudo[93826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.dbba0708-cfc5-40fc-b162-8dc1da6c5aca Jul 22 03:19:49 devstack sudo[93826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:19:49 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-5c749025-cad8-4967-a99f-3c25ce6aebba tempest-VolumesTransfersTest-65232147 None] Created reservations ['3e585fc3-baf3-4ebe-9c29-41c4df05ad1e', 'ff5c78e3-41aa-442e-8c71-da11e302e48d', '9af573db-0c4a-4ed0-bc8b-d3832423d82f', '3e77fd2e-53ad-4cbf-ba7c-8fcca65169af'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:19:49 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-5c749025-cad8-4967-a99f-3c25ce6aebba tempest-VolumesTransfersTest-65232147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:19:49 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-5c749025-cad8-4967-a99f-3c25ce6aebba tempest-VolumesTransfersTest-65232147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:19:49 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-5c749025-cad8-4967-a99f-3c25ce6aebba tempest-VolumesTransfersTest-65232147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:19:49 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-5c749025-cad8-4967-a99f-3c25ce6aebba tempest-VolumesTransfersTest-65232147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:19:49 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-5c749025-cad8-4967-a99f-3c25ce6aebba tempest-VolumesTransfersTest-65232147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:19:50 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5c749025-cad8-4967-a99f-3c25ce6aebba tempest-VolumesTransfersTest-65232147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:19:50 devstack sudo[93829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:19:50 devstack sudo[93829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:19:50 devstack sudo[93826]: pam_unix(sudo:session): session closed for user root Jul 22 03:19:50 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-65614ab4-2dff-4e73-b7a4-265ce7fda2fa tempest-SnapshotsActionsTest-618519404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.dbba0708-cfc5-40fc-b162-8dc1da6c5aca" returned: 0 in 0.472s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:19:50 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-65614ab4-2dff-4e73-b7a4-265ce7fda2fa tempest-SnapshotsActionsTest-618519404 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d01a3a60-aacf-4183-a2c5-769747c37d7a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87747) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 03:19:50 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[d22b6a1e-1aba-4d2b-8ba0-6fedc5492495]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:19:50 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-65614ab4-2dff-4e73-b7a4-265ce7fda2fa tempest-SnapshotsActionsTest-618519404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.97226f74-0159-4b9a-b538-229d4a909064 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:19:50 devstack sudo[93829]: pam_unix(sudo:session): session closed for user root Jul 22 03:19:50 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5c749025-cad8-4967-a99f-3c25ce6aebba tempest-VolumesTransfersTest-65232147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.273s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:19:50 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-5c749025-cad8-4967-a99f-3c25ce6aebba tempest-VolumesTransfersTest-65232147 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:19:50 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-5c749025-cad8-4967-a99f-3c25ce6aebba tempest-VolumesTransfersTest-65232147 None] Deleted volume successfully. Jul 22 03:19:50 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-5c749025-cad8-4967-a99f-3c25ce6aebba tempest-VolumesTransfersTest-65232147 None] Lock "cinder-79772453-fc57-47f7-90e9-c845fa49ee7e-delete_volume" released by "delete_volume" :: held 1.275s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:19:50 devstack sudo[93835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.97226f74-0159-4b9a-b538-229d4a909064 Jul 22 03:19:50 devstack sudo[93835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:19:50 devstack sudo[93835]: pam_unix(sudo:session): session closed for user root Jul 22 03:19:50 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-65614ab4-2dff-4e73-b7a4-265ce7fda2fa tempest-SnapshotsActionsTest-618519404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.97226f74-0159-4b9a-b538-229d4a909064" returned: 0 in 0.432s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:19:50 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-65614ab4-2dff-4e73-b7a4-265ce7fda2fa tempest-SnapshotsActionsTest-618519404 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d01a3a60-aacf-4183-a2c5-769747c37d7a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87747) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 03:19:50 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-65614ab4-2dff-4e73-b7a4-265ce7fda2fa tempest-SnapshotsActionsTest-618519404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.dbba0708-cfc5-40fc-b162-8dc1da6c5aca {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:19:50 devstack sudo[93840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.dbba0708-cfc5-40fc-b162-8dc1da6c5aca Jul 22 03:19:50 devstack sudo[93840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:19:51 devstack sudo[93840]: pam_unix(sudo:session): session closed for user root Jul 22 03:19:51 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-65614ab4-2dff-4e73-b7a4-265ce7fda2fa tempest-SnapshotsActionsTest-618519404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.dbba0708-cfc5-40fc-b162-8dc1da6c5aca" returned: 0 in 0.500s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:19:51 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-65614ab4-2dff-4e73-b7a4-265ce7fda2fa tempest-SnapshotsActionsTest-618519404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.dbba0708-cfc5-40fc-b162-8dc1da6c5aca {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:19:51 devstack sudo[93846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.dbba0708-cfc5-40fc-b162-8dc1da6c5aca Jul 22 03:19:51 devstack sudo[93846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:19:51 devstack sudo[93846]: pam_unix(sudo:session): session closed for user root Jul 22 03:19:51 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-65614ab4-2dff-4e73-b7a4-265ce7fda2fa tempest-SnapshotsActionsTest-618519404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.dbba0708-cfc5-40fc-b162-8dc1da6c5aca" returned: 0 in 0.283s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:19:51 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-65614ab4-2dff-4e73-b7a4-265ce7fda2fa tempest-SnapshotsActionsTest-618519404 None] Lock "cinder-quobyte-dbba0708-cfc5-40fc-b162-8dc1da6c5aca" released by "_delete_snapshot" :: held 1.825s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:19:51 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-65614ab4-2dff-4e73-b7a4-265ce7fda2fa tempest-SnapshotsActionsTest-618519404 None] Lock "cinder-quobyte-d01a3a60-aacf-4183-a2c5-769747c37d7a" released by "delete_snapshot" :: held 1.856s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:19:51 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-65614ab4-2dff-4e73-b7a4-265ce7fda2fa tempest-SnapshotsActionsTest-618519404 None] Created reservations ['f77722a1-ec3b-4daa-9e16-d8efaa9c973e', 'a9f57651-810c-4361-84eb-6a2860b526b9', '7f8d0210-27e4-4f64-9a03-557a0ef19ff9', '3437816f-a853-4370-9fc0-c5f4aefd26f2'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:19:51 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-65614ab4-2dff-4e73-b7a4-265ce7fda2fa tempest-SnapshotsActionsTest-618519404 None] Delete snapshot completed successfully. Jul 22 03:19:51 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-65614ab4-2dff-4e73-b7a4-265ce7fda2fa tempest-SnapshotsActionsTest-618519404 None] Lock "cinder-dbba0708-cfc5-40fc-b162-8dc1da6c5aca-delete_snapshot" released by "delete_snapshot" :: held 2.036s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:19:52 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-0f10fb79-1830-4395-9e94-b00fadae52f6 tempest-SnapshotsActionsTest-1329048363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:19:52 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-0f10fb79-1830-4395-9e94-b00fadae52f6 tempest-SnapshotsActionsTest-1329048363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:19:52 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-0f10fb79-1830-4395-9e94-b00fadae52f6 tempest-SnapshotsActionsTest-1329048363 None] Creating offline snapshot 554ea818-0216-4272-aa3d-1b33bd7a81c7 of volume d01a3a60-aacf-4183-a2c5-769747c37d7a {{(pid=87747) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 03:19:52 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc3c538-c385-41a3-aef7-1d78c8828e0a]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:19:52 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-0f10fb79-1830-4395-9e94-b00fadae52f6 tempest-SnapshotsActionsTest-1329048363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.97226f74-0159-4b9a-b538-229d4a909064 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:19:52 devstack sudo[93849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.97226f74-0159-4b9a-b538-229d4a909064 Jul 22 03:19:52 devstack sudo[93849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:19:52 devstack sudo[93849]: pam_unix(sudo:session): session closed for user root Jul 22 03:19:52 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-0f10fb79-1830-4395-9e94-b00fadae52f6 tempest-SnapshotsActionsTest-1329048363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.97226f74-0159-4b9a-b538-229d4a909064" returned: 0 in 0.401s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:19:52 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-0f10fb79-1830-4395-9e94-b00fadae52f6 tempest-SnapshotsActionsTest-1329048363 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d01a3a60-aacf-4183-a2c5-769747c37d7a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87747) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 03:19:52 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-0f10fb79-1830-4395-9e94-b00fadae52f6 tempest-SnapshotsActionsTest-1329048363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.97226f74-0159-4b9a-b538-229d4a909064,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.554ea818-0216-4272-aa3d-1b33bd7a81c7 1G {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:19:52 devstack sudo[93854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.97226f74-0159-4b9a-b538-229d4a909064,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.554ea818-0216-4272-aa3d-1b33bd7a81c7 1G Jul 22 03:19:52 devstack sudo[93854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:19:53 devstack sudo[93854]: pam_unix(sudo:session): session closed for user root Jul 22 03:19:53 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-0f10fb79-1830-4395-9e94-b00fadae52f6 tempest-SnapshotsActionsTest-1329048363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.97226f74-0159-4b9a-b538-229d4a909064,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.554ea818-0216-4272-aa3d-1b33bd7a81c7 1G" returned: 0 in 0.528s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:19:53 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-0f10fb79-1830-4395-9e94-b00fadae52f6 tempest-SnapshotsActionsTest-1329048363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.97226f74-0159-4b9a-b538-229d4a909064 -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.554ea818-0216-4272-aa3d-1b33bd7a81c7 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:19:53 devstack sudo[93861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.97226f74-0159-4b9a-b538-229d4a909064 -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.554ea818-0216-4272-aa3d-1b33bd7a81c7 Jul 22 03:19:53 devstack sudo[93861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:19:53 devstack sudo[93861]: pam_unix(sudo:session): session closed for user root Jul 22 03:19:53 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-0f10fb79-1830-4395-9e94-b00fadae52f6 tempest-SnapshotsActionsTest-1329048363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.97226f74-0159-4b9a-b538-229d4a909064 -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.554ea818-0216-4272-aa3d-1b33bd7a81c7" returned: 0 in 0.338s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:19:53 devstack cinder-volume[87747]: WARNING cinder.volume.drivers.remotefs [None req-0f10fb79-1830-4395-9e94-b00fadae52f6 tempest-SnapshotsActionsTest-1329048363 None] /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.554ea818-0216-4272-aa3d-1b33bd7a81c7 is being set with open permissions: ugo+rw Jul 22 03:19:53 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-0f10fb79-1830-4395-9e94-b00fadae52f6 tempest-SnapshotsActionsTest-1329048363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.554ea818-0216-4272-aa3d-1b33bd7a81c7 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:19:53 devstack sudo[93866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.554ea818-0216-4272-aa3d-1b33bd7a81c7 Jul 22 03:19:53 devstack sudo[93866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:19:53 devstack sudo[93866]: pam_unix(sudo:session): session closed for user root Jul 22 03:19:53 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-0f10fb79-1830-4395-9e94-b00fadae52f6 tempest-SnapshotsActionsTest-1329048363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.554ea818-0216-4272-aa3d-1b33bd7a81c7" returned: 0 in 0.321s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:19:53 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-0f10fb79-1830-4395-9e94-b00fadae52f6 tempest-SnapshotsActionsTest-1329048363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.698s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:19:53 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-0f10fb79-1830-4395-9e94-b00fadae52f6 tempest-SnapshotsActionsTest-1329048363 None] Create snapshot completed successfully Jul 22 03:19:54 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-0fd7b17b-9619-4a63-98cc-2a8d1d2f385c tempest-SnapshotsActionsTest-618519404 None] Acquiring lock "cinder-554ea818-0216-4272-aa3d-1b33bd7a81c7-delete_snapshot" by "delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:19:54 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-0fd7b17b-9619-4a63-98cc-2a8d1d2f385c tempest-SnapshotsActionsTest-618519404 None] Lock "cinder-554ea818-0216-4272-aa3d-1b33bd7a81c7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:19:54 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-0fd7b17b-9619-4a63-98cc-2a8d1d2f385c tempest-SnapshotsActionsTest-618519404 None] Acquiring lock "cinder-quobyte-d01a3a60-aacf-4183-a2c5-769747c37d7a" by "delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:19:54 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-0fd7b17b-9619-4a63-98cc-2a8d1d2f385c tempest-SnapshotsActionsTest-618519404 None] Lock "cinder-quobyte-d01a3a60-aacf-4183-a2c5-769747c37d7a" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:19:54 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-0fd7b17b-9619-4a63-98cc-2a8d1d2f385c tempest-SnapshotsActionsTest-618519404 None] Acquiring lock "cinder-quobyte-554ea818-0216-4272-aa3d-1b33bd7a81c7" by "_delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:19:54 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-0fd7b17b-9619-4a63-98cc-2a8d1d2f385c tempest-SnapshotsActionsTest-618519404 None] Lock "cinder-quobyte-554ea818-0216-4272-aa3d-1b33bd7a81c7" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:19:54 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-0fd7b17b-9619-4a63-98cc-2a8d1d2f385c tempest-SnapshotsActionsTest-618519404 None] Deleting offline snapshot 554ea818-0216-4272-aa3d-1b33bd7a81c7 of volume d01a3a60-aacf-4183-a2c5-769747c37d7a {{(pid=87747) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 03:19:54 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-0fd7b17b-9619-4a63-98cc-2a8d1d2f385c tempest-SnapshotsActionsTest-618519404 None] snapshot_file for this snap is: volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.554ea818-0216-4272-aa3d-1b33bd7a81c7 {{(pid=87747) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 03:19:54 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff8e548a-b700-448a-a74a-cea72dfbfc20]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:19:54 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-0fd7b17b-9619-4a63-98cc-2a8d1d2f385c tempest-SnapshotsActionsTest-618519404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.554ea818-0216-4272-aa3d-1b33bd7a81c7 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:19:54 devstack sudo[93869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.554ea818-0216-4272-aa3d-1b33bd7a81c7 Jul 22 03:19:54 devstack sudo[93869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:19:54 devstack sudo[93869]: pam_unix(sudo:session): session closed for user root Jul 22 03:19:54 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-0fd7b17b-9619-4a63-98cc-2a8d1d2f385c tempest-SnapshotsActionsTest-618519404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.554ea818-0216-4272-aa3d-1b33bd7a81c7" returned: 0 in 0.449s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:19:54 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-0fd7b17b-9619-4a63-98cc-2a8d1d2f385c tempest-SnapshotsActionsTest-618519404 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d01a3a60-aacf-4183-a2c5-769747c37d7a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87747) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 03:19:55 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[b30f2167-efab-4e36-a964-c16de2d6cbca]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:19:55 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-0fd7b17b-9619-4a63-98cc-2a8d1d2f385c tempest-SnapshotsActionsTest-618519404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.97226f74-0159-4b9a-b538-229d4a909064 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:19:55 devstack sudo[93874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.97226f74-0159-4b9a-b538-229d4a909064 Jul 22 03:19:55 devstack sudo[93874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:19:55 devstack sudo[93874]: pam_unix(sudo:session): session closed for user root Jul 22 03:19:55 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-0fd7b17b-9619-4a63-98cc-2a8d1d2f385c tempest-SnapshotsActionsTest-618519404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.97226f74-0159-4b9a-b538-229d4a909064" returned: 0 in 0.729s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:19:55 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-0fd7b17b-9619-4a63-98cc-2a8d1d2f385c tempest-SnapshotsActionsTest-618519404 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d01a3a60-aacf-4183-a2c5-769747c37d7a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87747) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 03:19:55 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-0fd7b17b-9619-4a63-98cc-2a8d1d2f385c tempest-SnapshotsActionsTest-618519404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.554ea818-0216-4272-aa3d-1b33bd7a81c7 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:19:55 devstack sudo[93879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.554ea818-0216-4272-aa3d-1b33bd7a81c7 Jul 22 03:19:55 devstack sudo[93879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:19:56 devstack sudo[93879]: pam_unix(sudo:session): session closed for user root Jul 22 03:19:56 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-0fd7b17b-9619-4a63-98cc-2a8d1d2f385c tempest-SnapshotsActionsTest-618519404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.554ea818-0216-4272-aa3d-1b33bd7a81c7" returned: 0 in 0.573s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:19:56 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-0fd7b17b-9619-4a63-98cc-2a8d1d2f385c tempest-SnapshotsActionsTest-618519404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.554ea818-0216-4272-aa3d-1b33bd7a81c7 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:19:56 devstack sudo[93888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.554ea818-0216-4272-aa3d-1b33bd7a81c7 Jul 22 03:19:56 devstack sudo[93888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:19:56 devstack sudo[93888]: pam_unix(sudo:session): session closed for user root Jul 22 03:19:56 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-0fd7b17b-9619-4a63-98cc-2a8d1d2f385c tempest-SnapshotsActionsTest-618519404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.554ea818-0216-4272-aa3d-1b33bd7a81c7" returned: 0 in 0.338s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:19:56 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-0fd7b17b-9619-4a63-98cc-2a8d1d2f385c tempest-SnapshotsActionsTest-618519404 None] Lock "cinder-quobyte-554ea818-0216-4272-aa3d-1b33bd7a81c7" released by "_delete_snapshot" :: held 2.238s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:19:56 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-0fd7b17b-9619-4a63-98cc-2a8d1d2f385c tempest-SnapshotsActionsTest-618519404 None] Lock "cinder-quobyte-d01a3a60-aacf-4183-a2c5-769747c37d7a" released by "delete_snapshot" :: held 2.275s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:19:56 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-0fd7b17b-9619-4a63-98cc-2a8d1d2f385c tempest-SnapshotsActionsTest-618519404 None] Created reservations ['cc6bf913-594e-4a51-86fa-a46168988bab', 'c13e9156-3a4e-4ca6-9a37-1828833e74f1', '54ba18da-355f-4f34-972d-dd8cc41cf6d9', 'b157fd65-060b-4a9a-9508-295650565230'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:19:56 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-0fd7b17b-9619-4a63-98cc-2a8d1d2f385c tempest-SnapshotsActionsTest-618519404 None] Delete snapshot completed successfully. Jul 22 03:19:57 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-0fd7b17b-9619-4a63-98cc-2a8d1d2f385c tempest-SnapshotsActionsTest-618519404 None] Lock "cinder-554ea818-0216-4272-aa3d-1b33bd7a81c7-delete_snapshot" released by "delete_snapshot" :: held 2.569s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:19:58 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-fa3f9bb4-af31-4f80-bb03-5713bbc54fc2 tempest-SnapshotsActionsTest-1329048363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:19:58 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-fa3f9bb4-af31-4f80-bb03-5713bbc54fc2 tempest-SnapshotsActionsTest-1329048363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:19:58 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-fa3f9bb4-af31-4f80-bb03-5713bbc54fc2 tempest-SnapshotsActionsTest-1329048363 None] Creating offline snapshot b293e0e4-fae0-44fb-b33a-3976c431e700 of volume d01a3a60-aacf-4183-a2c5-769747c37d7a {{(pid=87747) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 03:19:58 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[6514f10d-d97f-43f7-a0e7-9be21b0296e4]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:19:58 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-fa3f9bb4-af31-4f80-bb03-5713bbc54fc2 tempest-SnapshotsActionsTest-1329048363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.97226f74-0159-4b9a-b538-229d4a909064 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:19:58 devstack sudo[93912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.97226f74-0159-4b9a-b538-229d4a909064 Jul 22 03:19:58 devstack sudo[93912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:19:58 devstack sudo[93912]: pam_unix(sudo:session): session closed for user root Jul 22 03:19:58 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-fa3f9bb4-af31-4f80-bb03-5713bbc54fc2 tempest-SnapshotsActionsTest-1329048363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.97226f74-0159-4b9a-b538-229d4a909064" returned: 0 in 0.418s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:19:58 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-fa3f9bb4-af31-4f80-bb03-5713bbc54fc2 tempest-SnapshotsActionsTest-1329048363 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d01a3a60-aacf-4183-a2c5-769747c37d7a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87747) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 03:19:58 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-fa3f9bb4-af31-4f80-bb03-5713bbc54fc2 tempest-SnapshotsActionsTest-1329048363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.97226f74-0159-4b9a-b538-229d4a909064,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.b293e0e4-fae0-44fb-b33a-3976c431e700 1G {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:19:58 devstack sudo[93917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.97226f74-0159-4b9a-b538-229d4a909064,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.b293e0e4-fae0-44fb-b33a-3976c431e700 1G Jul 22 03:19:58 devstack sudo[93917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:19:59 devstack sudo[93917]: pam_unix(sudo:session): session closed for user root Jul 22 03:19:59 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-fa3f9bb4-af31-4f80-bb03-5713bbc54fc2 tempest-SnapshotsActionsTest-1329048363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.97226f74-0159-4b9a-b538-229d4a909064,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.b293e0e4-fae0-44fb-b33a-3976c431e700 1G" returned: 0 in 0.562s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:19:59 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-fa3f9bb4-af31-4f80-bb03-5713bbc54fc2 tempest-SnapshotsActionsTest-1329048363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.97226f74-0159-4b9a-b538-229d4a909064 -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.b293e0e4-fae0-44fb-b33a-3976c431e700 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:19:59 devstack sudo[93924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.97226f74-0159-4b9a-b538-229d4a909064 -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.b293e0e4-fae0-44fb-b33a-3976c431e700 Jul 22 03:19:59 devstack sudo[93924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:19:59 devstack sudo[93924]: pam_unix(sudo:session): session closed for user root Jul 22 03:19:59 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-fa3f9bb4-af31-4f80-bb03-5713bbc54fc2 tempest-SnapshotsActionsTest-1329048363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.97226f74-0159-4b9a-b538-229d4a909064 -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.b293e0e4-fae0-44fb-b33a-3976c431e700" returned: 0 in 0.361s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:19:59 devstack cinder-volume[87747]: WARNING cinder.volume.drivers.remotefs [None req-fa3f9bb4-af31-4f80-bb03-5713bbc54fc2 tempest-SnapshotsActionsTest-1329048363 None] /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.b293e0e4-fae0-44fb-b33a-3976c431e700 is being set with open permissions: ugo+rw Jul 22 03:19:59 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-fa3f9bb4-af31-4f80-bb03-5713bbc54fc2 tempest-SnapshotsActionsTest-1329048363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.b293e0e4-fae0-44fb-b33a-3976c431e700 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:19:59 devstack sudo[93930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.b293e0e4-fae0-44fb-b33a-3976c431e700 Jul 22 03:19:59 devstack sudo[93930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:19:59 devstack sudo[93930]: pam_unix(sudo:session): session closed for user root Jul 22 03:19:59 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-fa3f9bb4-af31-4f80-bb03-5713bbc54fc2 tempest-SnapshotsActionsTest-1329048363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.b293e0e4-fae0-44fb-b33a-3976c431e700" returned: 0 in 0.315s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:19:59 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-fa3f9bb4-af31-4f80-bb03-5713bbc54fc2 tempest-SnapshotsActionsTest-1329048363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.769s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:19:59 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-fa3f9bb4-af31-4f80-bb03-5713bbc54fc2 tempest-SnapshotsActionsTest-1329048363 None] Create snapshot completed successfully Jul 22 03:20:00 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-d4cb785f-38d1-41b2-a810-596533f9d8d9 tempest-SnapshotsActionsTest-618519404 None] Acquiring lock "cinder-b293e0e4-fae0-44fb-b33a-3976c431e700-delete_snapshot" by "delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:20:00 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-d4cb785f-38d1-41b2-a810-596533f9d8d9 tempest-SnapshotsActionsTest-618519404 None] Lock "cinder-b293e0e4-fae0-44fb-b33a-3976c431e700-delete_snapshot" acquired by "delete_snapshot" :: waited 0.050s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:20:00 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-d4cb785f-38d1-41b2-a810-596533f9d8d9 tempest-SnapshotsActionsTest-618519404 None] Acquiring lock "cinder-quobyte-d01a3a60-aacf-4183-a2c5-769747c37d7a" by "delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:20:00 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-d4cb785f-38d1-41b2-a810-596533f9d8d9 tempest-SnapshotsActionsTest-618519404 None] Lock "cinder-quobyte-d01a3a60-aacf-4183-a2c5-769747c37d7a" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:20:00 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-d4cb785f-38d1-41b2-a810-596533f9d8d9 tempest-SnapshotsActionsTest-618519404 None] Acquiring lock "cinder-quobyte-b293e0e4-fae0-44fb-b33a-3976c431e700" by "_delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:20:00 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-d4cb785f-38d1-41b2-a810-596533f9d8d9 tempest-SnapshotsActionsTest-618519404 None] Lock "cinder-quobyte-b293e0e4-fae0-44fb-b33a-3976c431e700" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:20:00 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-d4cb785f-38d1-41b2-a810-596533f9d8d9 tempest-SnapshotsActionsTest-618519404 None] Deleting offline snapshot b293e0e4-fae0-44fb-b33a-3976c431e700 of volume d01a3a60-aacf-4183-a2c5-769747c37d7a {{(pid=87747) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 03:20:00 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-d4cb785f-38d1-41b2-a810-596533f9d8d9 tempest-SnapshotsActionsTest-618519404 None] snapshot_file for this snap is: volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.b293e0e4-fae0-44fb-b33a-3976c431e700 {{(pid=87747) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 03:20:00 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[db20faa4-95ad-40bb-915a-105fc6945659]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:20:00 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d4cb785f-38d1-41b2-a810-596533f9d8d9 tempest-SnapshotsActionsTest-618519404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.b293e0e4-fae0-44fb-b33a-3976c431e700 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:20:00 devstack sudo[93936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.b293e0e4-fae0-44fb-b33a-3976c431e700 Jul 22 03:20:00 devstack sudo[93936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:20:01 devstack sudo[93936]: pam_unix(sudo:session): session closed for user root Jul 22 03:20:01 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d4cb785f-38d1-41b2-a810-596533f9d8d9 tempest-SnapshotsActionsTest-618519404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.b293e0e4-fae0-44fb-b33a-3976c431e700" returned: 0 in 0.498s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:20:01 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-d4cb785f-38d1-41b2-a810-596533f9d8d9 tempest-SnapshotsActionsTest-618519404 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d01a3a60-aacf-4183-a2c5-769747c37d7a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87747) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 03:20:01 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ebad251-4e67-43d3-9419-237262f288fa]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:20:01 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d4cb785f-38d1-41b2-a810-596533f9d8d9 tempest-SnapshotsActionsTest-618519404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.97226f74-0159-4b9a-b538-229d4a909064 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:20:01 devstack sudo[93941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.97226f74-0159-4b9a-b538-229d4a909064 Jul 22 03:20:01 devstack sudo[93941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:20:01 devstack sudo[93941]: pam_unix(sudo:session): session closed for user root Jul 22 03:20:01 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d4cb785f-38d1-41b2-a810-596533f9d8d9 tempest-SnapshotsActionsTest-618519404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.97226f74-0159-4b9a-b538-229d4a909064" returned: 0 in 0.502s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:20:01 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-d4cb785f-38d1-41b2-a810-596533f9d8d9 tempest-SnapshotsActionsTest-618519404 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d01a3a60-aacf-4183-a2c5-769747c37d7a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87747) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 03:20:01 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d4cb785f-38d1-41b2-a810-596533f9d8d9 tempest-SnapshotsActionsTest-618519404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.b293e0e4-fae0-44fb-b33a-3976c431e700 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:20:01 devstack sudo[93946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.b293e0e4-fae0-44fb-b33a-3976c431e700 Jul 22 03:20:01 devstack sudo[93946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:20:02 devstack sudo[93946]: pam_unix(sudo:session): session closed for user root Jul 22 03:20:02 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d4cb785f-38d1-41b2-a810-596533f9d8d9 tempest-SnapshotsActionsTest-618519404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.b293e0e4-fae0-44fb-b33a-3976c431e700" returned: 0 in 0.498s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:20:02 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d4cb785f-38d1-41b2-a810-596533f9d8d9 tempest-SnapshotsActionsTest-618519404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.b293e0e4-fae0-44fb-b33a-3976c431e700 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:20:02 devstack sudo[93951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.b293e0e4-fae0-44fb-b33a-3976c431e700 Jul 22 03:20:02 devstack sudo[93951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:20:02 devstack sudo[93951]: pam_unix(sudo:session): session closed for user root Jul 22 03:20:02 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d4cb785f-38d1-41b2-a810-596533f9d8d9 tempest-SnapshotsActionsTest-618519404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.b293e0e4-fae0-44fb-b33a-3976c431e700" returned: 0 in 0.254s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:20:02 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-d4cb785f-38d1-41b2-a810-596533f9d8d9 tempest-SnapshotsActionsTest-618519404 None] Lock "cinder-quobyte-b293e0e4-fae0-44fb-b33a-3976c431e700" released by "_delete_snapshot" :: held 1.918s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:20:02 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-d4cb785f-38d1-41b2-a810-596533f9d8d9 tempest-SnapshotsActionsTest-618519404 None] Lock "cinder-quobyte-d01a3a60-aacf-4183-a2c5-769747c37d7a" released by "delete_snapshot" :: held 1.982s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:20:02 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-d4cb785f-38d1-41b2-a810-596533f9d8d9 tempest-SnapshotsActionsTest-618519404 None] Created reservations ['42158539-9d55-4030-a94e-4fd0a7eac559', '3334f790-0c35-45e6-b04f-41c87a2d942c', 'cd77bc5c-6849-4a21-a73a-ae48d2c702b1', '3060148a-b8aa-4cf9-9aa8-7c59f40947a2'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:20:02 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-d4cb785f-38d1-41b2-a810-596533f9d8d9 tempest-SnapshotsActionsTest-618519404 None] Delete snapshot completed successfully. Jul 22 03:20:02 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-d4cb785f-38d1-41b2-a810-596533f9d8d9 tempest-SnapshotsActionsTest-618519404 None] Lock "cinder-b293e0e4-fae0-44fb-b33a-3976c431e700-delete_snapshot" released by "delete_snapshot" :: held 2.216s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:20:04 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-97ce2e0b-a935-4851-8878-06d17f5abce0 tempest-SnapshotsActionsTest-1329048363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:20:04 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-97ce2e0b-a935-4851-8878-06d17f5abce0 tempest-SnapshotsActionsTest-1329048363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:20:04 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-97ce2e0b-a935-4851-8878-06d17f5abce0 tempest-SnapshotsActionsTest-1329048363 None] Creating offline snapshot 476f33e9-6adc-4d83-aaee-59e21028e23c of volume d01a3a60-aacf-4183-a2c5-769747c37d7a {{(pid=87747) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 03:20:04 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[da6db50c-6536-47d2-a01b-c74defb17dcb]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:20:04 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-97ce2e0b-a935-4851-8878-06d17f5abce0 tempest-SnapshotsActionsTest-1329048363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.97226f74-0159-4b9a-b538-229d4a909064 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:20:04 devstack sudo[93955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.97226f74-0159-4b9a-b538-229d4a909064 Jul 22 03:20:04 devstack sudo[93955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:20:04 devstack sudo[93955]: pam_unix(sudo:session): session closed for user root Jul 22 03:20:04 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-97ce2e0b-a935-4851-8878-06d17f5abce0 tempest-SnapshotsActionsTest-1329048363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.97226f74-0159-4b9a-b538-229d4a909064" returned: 0 in 0.379s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:20:04 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-97ce2e0b-a935-4851-8878-06d17f5abce0 tempest-SnapshotsActionsTest-1329048363 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d01a3a60-aacf-4183-a2c5-769747c37d7a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87747) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 03:20:04 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-97ce2e0b-a935-4851-8878-06d17f5abce0 tempest-SnapshotsActionsTest-1329048363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.97226f74-0159-4b9a-b538-229d4a909064,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.476f33e9-6adc-4d83-aaee-59e21028e23c 1G {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:20:04 devstack sudo[93961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.97226f74-0159-4b9a-b538-229d4a909064,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.476f33e9-6adc-4d83-aaee-59e21028e23c 1G Jul 22 03:20:04 devstack sudo[93961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:20:05 devstack sudo[93961]: pam_unix(sudo:session): session closed for user root Jul 22 03:20:05 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-97ce2e0b-a935-4851-8878-06d17f5abce0 tempest-SnapshotsActionsTest-1329048363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.97226f74-0159-4b9a-b538-229d4a909064,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.476f33e9-6adc-4d83-aaee-59e21028e23c 1G" returned: 0 in 0.586s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:20:05 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-97ce2e0b-a935-4851-8878-06d17f5abce0 tempest-SnapshotsActionsTest-1329048363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.97226f74-0159-4b9a-b538-229d4a909064 -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.476f33e9-6adc-4d83-aaee-59e21028e23c {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:20:05 devstack sudo[93967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.97226f74-0159-4b9a-b538-229d4a909064 -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.476f33e9-6adc-4d83-aaee-59e21028e23c Jul 22 03:20:05 devstack sudo[93967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:20:05 devstack sudo[93967]: pam_unix(sudo:session): session closed for user root Jul 22 03:20:05 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-97ce2e0b-a935-4851-8878-06d17f5abce0 tempest-SnapshotsActionsTest-1329048363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.97226f74-0159-4b9a-b538-229d4a909064 -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.476f33e9-6adc-4d83-aaee-59e21028e23c" returned: 0 in 0.348s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:20:05 devstack cinder-volume[87747]: WARNING cinder.volume.drivers.remotefs [None req-97ce2e0b-a935-4851-8878-06d17f5abce0 tempest-SnapshotsActionsTest-1329048363 None] /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.476f33e9-6adc-4d83-aaee-59e21028e23c is being set with open permissions: ugo+rw Jul 22 03:20:05 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-97ce2e0b-a935-4851-8878-06d17f5abce0 tempest-SnapshotsActionsTest-1329048363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.476f33e9-6adc-4d83-aaee-59e21028e23c {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:20:05 devstack sudo[93972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.476f33e9-6adc-4d83-aaee-59e21028e23c Jul 22 03:20:05 devstack sudo[93972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:20:05 devstack sudo[93972]: pam_unix(sudo:session): session closed for user root Jul 22 03:20:05 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-97ce2e0b-a935-4851-8878-06d17f5abce0 tempest-SnapshotsActionsTest-1329048363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.476f33e9-6adc-4d83-aaee-59e21028e23c" returned: 0 in 0.273s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:20:05 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-97ce2e0b-a935-4851-8878-06d17f5abce0 tempest-SnapshotsActionsTest-1329048363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.775s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:20:05 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-97ce2e0b-a935-4851-8878-06d17f5abce0 tempest-SnapshotsActionsTest-1329048363 None] Create snapshot completed successfully Jul 22 03:20:06 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-46c0c19b-1f40-4a4f-823b-44e41048cd3c tempest-SnapshotsActionsTest-618519404 None] Acquiring lock "cinder-476f33e9-6adc-4d83-aaee-59e21028e23c-delete_snapshot" by "delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:20:06 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-46c0c19b-1f40-4a4f-823b-44e41048cd3c tempest-SnapshotsActionsTest-618519404 None] Lock "cinder-476f33e9-6adc-4d83-aaee-59e21028e23c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:20:06 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-46c0c19b-1f40-4a4f-823b-44e41048cd3c tempest-SnapshotsActionsTest-618519404 None] Acquiring lock "cinder-quobyte-d01a3a60-aacf-4183-a2c5-769747c37d7a" by "delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:20:06 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-46c0c19b-1f40-4a4f-823b-44e41048cd3c tempest-SnapshotsActionsTest-618519404 None] Lock "cinder-quobyte-d01a3a60-aacf-4183-a2c5-769747c37d7a" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:20:06 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-46c0c19b-1f40-4a4f-823b-44e41048cd3c tempest-SnapshotsActionsTest-618519404 None] Acquiring lock "cinder-quobyte-476f33e9-6adc-4d83-aaee-59e21028e23c" by "_delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:20:06 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-46c0c19b-1f40-4a4f-823b-44e41048cd3c tempest-SnapshotsActionsTest-618519404 None] Lock "cinder-quobyte-476f33e9-6adc-4d83-aaee-59e21028e23c" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:20:06 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-46c0c19b-1f40-4a4f-823b-44e41048cd3c tempest-SnapshotsActionsTest-618519404 None] Deleting offline snapshot 476f33e9-6adc-4d83-aaee-59e21028e23c of volume d01a3a60-aacf-4183-a2c5-769747c37d7a {{(pid=87747) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 03:20:06 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-46c0c19b-1f40-4a4f-823b-44e41048cd3c tempest-SnapshotsActionsTest-618519404 None] snapshot_file for this snap is: volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.476f33e9-6adc-4d83-aaee-59e21028e23c {{(pid=87747) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 03:20:06 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f1f3bcc-7f73-4d03-86e9-2b6b1efca118]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:20:06 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-46c0c19b-1f40-4a4f-823b-44e41048cd3c tempest-SnapshotsActionsTest-618519404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.476f33e9-6adc-4d83-aaee-59e21028e23c {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:20:06 devstack sudo[93975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.476f33e9-6adc-4d83-aaee-59e21028e23c Jul 22 03:20:06 devstack sudo[93975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:20:06 devstack sudo[93975]: pam_unix(sudo:session): session closed for user root Jul 22 03:20:06 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-46c0c19b-1f40-4a4f-823b-44e41048cd3c tempest-SnapshotsActionsTest-618519404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.476f33e9-6adc-4d83-aaee-59e21028e23c" returned: 0 in 0.405s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:20:06 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-46c0c19b-1f40-4a4f-823b-44e41048cd3c tempest-SnapshotsActionsTest-618519404 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d01a3a60-aacf-4183-a2c5-769747c37d7a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87747) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 03:20:06 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b2b124e-f226-45f2-97af-8482e53dd0f7]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:20:06 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-46c0c19b-1f40-4a4f-823b-44e41048cd3c tempest-SnapshotsActionsTest-618519404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.97226f74-0159-4b9a-b538-229d4a909064 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:20:07 devstack sudo[93982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.97226f74-0159-4b9a-b538-229d4a909064 Jul 22 03:20:07 devstack sudo[93982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:20:07 devstack sudo[93982]: pam_unix(sudo:session): session closed for user root Jul 22 03:20:07 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-46c0c19b-1f40-4a4f-823b-44e41048cd3c tempest-SnapshotsActionsTest-618519404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.97226f74-0159-4b9a-b538-229d4a909064" returned: 0 in 0.432s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:20:07 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-46c0c19b-1f40-4a4f-823b-44e41048cd3c tempest-SnapshotsActionsTest-618519404 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d01a3a60-aacf-4183-a2c5-769747c37d7a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87747) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 03:20:07 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-46c0c19b-1f40-4a4f-823b-44e41048cd3c tempest-SnapshotsActionsTest-618519404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.476f33e9-6adc-4d83-aaee-59e21028e23c {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:20:07 devstack sudo[93987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.476f33e9-6adc-4d83-aaee-59e21028e23c Jul 22 03:20:07 devstack sudo[93987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:20:08 devstack sudo[93987]: pam_unix(sudo:session): session closed for user root Jul 22 03:20:08 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-46c0c19b-1f40-4a4f-823b-44e41048cd3c tempest-SnapshotsActionsTest-618519404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.476f33e9-6adc-4d83-aaee-59e21028e23c" returned: 0 in 0.624s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:20:08 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-46c0c19b-1f40-4a4f-823b-44e41048cd3c tempest-SnapshotsActionsTest-618519404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.476f33e9-6adc-4d83-aaee-59e21028e23c {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:20:08 devstack sudo[93992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.476f33e9-6adc-4d83-aaee-59e21028e23c Jul 22 03:20:08 devstack sudo[93992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:20:08 devstack sudo[93992]: pam_unix(sudo:session): session closed for user root Jul 22 03:20:08 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-46c0c19b-1f40-4a4f-823b-44e41048cd3c tempest-SnapshotsActionsTest-618519404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.476f33e9-6adc-4d83-aaee-59e21028e23c" returned: 0 in 0.315s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:20:08 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-46c0c19b-1f40-4a4f-823b-44e41048cd3c tempest-SnapshotsActionsTest-618519404 None] Lock "cinder-quobyte-476f33e9-6adc-4d83-aaee-59e21028e23c" released by "_delete_snapshot" :: held 1.907s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:20:08 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-46c0c19b-1f40-4a4f-823b-44e41048cd3c tempest-SnapshotsActionsTest-618519404 None] Lock "cinder-quobyte-d01a3a60-aacf-4183-a2c5-769747c37d7a" released by "delete_snapshot" :: held 1.937s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:20:08 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-46c0c19b-1f40-4a4f-823b-44e41048cd3c tempest-SnapshotsActionsTest-618519404 None] Created reservations ['943a80af-6c04-4e1a-8c34-6fdec2555e31', 'af8080fa-dad9-48a0-be12-719f5f744a0f', '5f31ffaf-d39f-4b4d-94fd-cbbb8a9b7ae8', '80704122-f002-4c39-b12c-fec6a0f83946'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:20:08 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-46c0c19b-1f40-4a4f-823b-44e41048cd3c tempest-SnapshotsActionsTest-618519404 None] Delete snapshot completed successfully. Jul 22 03:20:08 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-46c0c19b-1f40-4a4f-823b-44e41048cd3c tempest-SnapshotsActionsTest-618519404 None] Lock "cinder-476f33e9-6adc-4d83-aaee-59e21028e23c-delete_snapshot" released by "delete_snapshot" :: held 2.164s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:20:09 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-54212c80-68d4-47dc-bae6-b2fc953d8b15 tempest-VolumesActionsTest-1044123451 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:20:09 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-54212c80-68d4-47dc-bae6-b2fc953d8b15 tempest-VolumesActionsTest-1044123451 None] Flow 'volume_create_manager' (612c0133-40a0-4e95-8fb5-eccc7cd39fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:20:09 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-54212c80-68d4-47dc-bae6-b2fc953d8b15 tempest-VolumesActionsTest-1044123451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1ed2736-78eb-4f78-b8b1-52f20980f7f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:20:09 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-54212c80-68d4-47dc-bae6-b2fc953d8b15 tempest-VolumesActionsTest-1044123451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1ed2736-78eb-4f78-b8b1-52f20980f7f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:20:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-969303330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=861a18d3-74d2-49b7-b057-ac67f6d6bea3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a4e40104fc8413ca473a2a23a04dd72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:20:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:20:09Z,use_quota=True,user_id='d4d23ceac5e54234bd7c11489e2e90ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:20:09 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-54212c80-68d4-47dc-bae6-b2fc953d8b15 tempest-VolumesActionsTest-1044123451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1411e47b-0e4f-4817-bdbb-14b65cc006ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:20:09 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-54212c80-68d4-47dc-bae6-b2fc953d8b15 tempest-VolumesActionsTest-1044123451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1411e47b-0e4f-4817-bdbb-14b65cc006ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:20:09 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-54212c80-68d4-47dc-bae6-b2fc953d8b15 tempest-VolumesActionsTest-1044123451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06a3d218-1705-46e3-a28f-ee31383309d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:20:09 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-54212c80-68d4-47dc-bae6-b2fc953d8b15 tempest-VolumesActionsTest-1044123451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06a3d218-1705-46e3-a28f-ee31383309d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '861a18d3-74d2-49b7-b057-ac67f6d6bea3', 'volume_name': 'volume-861a18d3-74d2-49b7-b057-ac67f6d6bea3', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:20:09 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-54212c80-68d4-47dc-bae6-b2fc953d8b15 tempest-VolumesActionsTest-1044123451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ac54f4e-9638-4aea-8c6e-7e6a94397bab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:20:09 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-54212c80-68d4-47dc-bae6-b2fc953d8b15 tempest-VolumesActionsTest-1044123451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ac54f4e-9638-4aea-8c6e-7e6a94397bab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:20:09 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-54212c80-68d4-47dc-bae6-b2fc953d8b15 tempest-VolumesActionsTest-1044123451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df354fa1-3d01-426d-8d9e-f82a45144e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:20:09 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-54212c80-68d4-47dc-bae6-b2fc953d8b15 tempest-VolumesActionsTest-1044123451 None] Volume 861a18d3-74d2-49b7-b057-ac67f6d6bea3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-861a18d3-74d2-49b7-b057-ac67f6d6bea3', 'volume_size': 1} Jul 22 03:20:09 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-54212c80-68d4-47dc-bae6-b2fc953d8b15 tempest-VolumesActionsTest-1044123451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:20:09 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-54212c80-68d4-47dc-bae6-b2fc953d8b15 tempest-VolumesActionsTest-1044123451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:20:09 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-54212c80-68d4-47dc-bae6-b2fc953d8b15 tempest-VolumesActionsTest-1044123451 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:20:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-969303330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=861a18d3-74d2-49b7-b057-ac67f6d6bea3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a4e40104fc8413ca473a2a23a04dd72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:20:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:20:09Z,use_quota=True,user_id='d4d23ceac5e54234bd7c11489e2e90ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:20:09 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-54212c80-68d4-47dc-bae6-b2fc953d8b15 tempest-VolumesActionsTest-1044123451 None] Creating volume 861a18d3-74d2-49b7-b057-ac67f6d6bea3 {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:20:09 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-54212c80-68d4-47dc-bae6-b2fc953d8b15 tempest-VolumesActionsTest-1044123451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:20:09 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-54212c80-68d4-47dc-bae6-b2fc953d8b15 tempest-VolumesActionsTest-1044123451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:20:09 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-54212c80-68d4-47dc-bae6-b2fc953d8b15 tempest-VolumesActionsTest-1044123451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:20:09 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-54212c80-68d4-47dc-bae6-b2fc953d8b15 tempest-VolumesActionsTest-1044123451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:20:09 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-54212c80-68d4-47dc-bae6-b2fc953d8b15 tempest-VolumesActionsTest-1044123451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:20:09 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-54212c80-68d4-47dc-bae6-b2fc953d8b15 tempest-VolumesActionsTest-1044123451 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:20:09 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-54212c80-68d4-47dc-bae6-b2fc953d8b15 tempest-VolumesActionsTest-1044123451 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:20:09 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-54212c80-68d4-47dc-bae6-b2fc953d8b15 tempest-VolumesActionsTest-1044123451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-861a18d3-74d2-49b7-b057-ac67f6d6bea3 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:20:09 devstack sudo[93995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-861a18d3-74d2-49b7-b057-ac67f6d6bea3 1073741824 Jul 22 03:20:09 devstack sudo[93995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:20:09 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-5f346ef4-2ee0-410d-8da7-a20e626b7f2f tempest-AttachVolumeShelveTestJSON-597292271 None] Acquiring lock "cinder-1719ff05-ee15-4be4-9d6d-8c5532022bda-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:20:09 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-5f346ef4-2ee0-410d-8da7-a20e626b7f2f tempest-AttachVolumeShelveTestJSON-597292271 None] Lock "cinder-1719ff05-ee15-4be4-9d6d-8c5532022bda-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:20:09 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-5f346ef4-2ee0-410d-8da7-a20e626b7f2f tempest-AttachVolumeShelveTestJSON-597292271 None] Acquiring lock "cinder-quobyte-1719ff05-ee15-4be4-9d6d-8c5532022bda" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:20:09 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-5f346ef4-2ee0-410d-8da7-a20e626b7f2f tempest-AttachVolumeShelveTestJSON-597292271 None] Lock "cinder-quobyte-1719ff05-ee15-4be4-9d6d-8c5532022bda" acquired by "delete_volume" :: waited 0.035s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:20:09 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7dae5b8-75df-4b55-a8b8-1b808deb01bf]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:20:09 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5f346ef4-2ee0-410d-8da7-a20e626b7f2f tempest-AttachVolumeShelveTestJSON-597292271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1719ff05-ee15-4be4-9d6d-8c5532022bda {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:20:09 devstack sudo[93995]: pam_unix(sudo:session): session closed for user root Jul 22 03:20:09 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-54212c80-68d4-47dc-bae6-b2fc953d8b15 tempest-VolumesActionsTest-1044123451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-861a18d3-74d2-49b7-b057-ac67f6d6bea3 1073741824" returned: 0 in 0.593s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:20:09 devstack sudo[94000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1719ff05-ee15-4be4-9d6d-8c5532022bda Jul 22 03:20:09 devstack sudo[94000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:20:09 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-54212c80-68d4-47dc-bae6-b2fc953d8b15 tempest-VolumesActionsTest-1044123451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-861a18d3-74d2-49b7-b057-ac67f6d6bea3 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:20:09 devstack sudo[94003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-861a18d3-74d2-49b7-b057-ac67f6d6bea3 Jul 22 03:20:09 devstack sudo[94003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:20:10 devstack sudo[94000]: pam_unix(sudo:session): session closed for user root Jul 22 03:20:10 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5f346ef4-2ee0-410d-8da7-a20e626b7f2f tempest-AttachVolumeShelveTestJSON-597292271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1719ff05-ee15-4be4-9d6d-8c5532022bda" returned: 0 in 0.525s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:20:10 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5f346ef4-2ee0-410d-8da7-a20e626b7f2f tempest-AttachVolumeShelveTestJSON-597292271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1719ff05-ee15-4be4-9d6d-8c5532022bda {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:20:10 devstack sudo[94008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1719ff05-ee15-4be4-9d6d-8c5532022bda Jul 22 03:20:10 devstack sudo[94008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:20:10 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-2b079fdf-2fc5-4c99-b243-564808e9080e tempest-SnapshotsActionsTest-1329048363 None] Acquiring lock "cinder-97226f74-0159-4b9a-b538-229d4a909064-delete_snapshot" by "delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:20:10 devstack sudo[94003]: pam_unix(sudo:session): session closed for user root Jul 22 03:20:10 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-54212c80-68d4-47dc-bae6-b2fc953d8b15 tempest-VolumesActionsTest-1044123451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-861a18d3-74d2-49b7-b057-ac67f6d6bea3" returned: 0 in 0.411s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:20:10 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-54212c80-68d4-47dc-bae6-b2fc953d8b15 tempest-VolumesActionsTest-1044123451 None] <== create_volume: return (1075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:20:10 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-54212c80-68d4-47dc-bae6-b2fc953d8b15 tempest-VolumesActionsTest-1044123451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.078s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:20:10 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-54212c80-68d4-47dc-bae6-b2fc953d8b15 tempest-VolumesActionsTest-1044123451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df354fa1-3d01-426d-8d9e-f82a45144e64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-861a18d3-74d2-49b7-b057-ac67f6d6bea3', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:20:10 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-54212c80-68d4-47dc-bae6-b2fc953d8b15 tempest-VolumesActionsTest-1044123451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b20b7a3-5713-40bd-9d13-82687ba536b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:20:10 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-2b079fdf-2fc5-4c99-b243-564808e9080e tempest-SnapshotsActionsTest-1329048363 None] Lock "cinder-97226f74-0159-4b9a-b538-229d4a909064-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:20:10 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-2b079fdf-2fc5-4c99-b243-564808e9080e tempest-SnapshotsActionsTest-1329048363 None] Acquiring lock "cinder-quobyte-d01a3a60-aacf-4183-a2c5-769747c37d7a" by "delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:20:10 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-54212c80-68d4-47dc-bae6-b2fc953d8b15 tempest-VolumesActionsTest-1044123451 None] Volume volume-861a18d3-74d2-49b7-b057-ac67f6d6bea3 (861a18d3-74d2-49b7-b057-ac67f6d6bea3): created successfully Jul 22 03:20:10 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-54212c80-68d4-47dc-bae6-b2fc953d8b15 tempest-VolumesActionsTest-1044123451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b20b7a3-5713-40bd-9d13-82687ba536b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:20:10 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-54212c80-68d4-47dc-bae6-b2fc953d8b15 tempest-VolumesActionsTest-1044123451 None] Flow 'volume_create_manager' (612c0133-40a0-4e95-8fb5-eccc7cd39fb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:20:10 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-2b079fdf-2fc5-4c99-b243-564808e9080e tempest-SnapshotsActionsTest-1329048363 None] Lock "cinder-quobyte-d01a3a60-aacf-4183-a2c5-769747c37d7a" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:20:10 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-2b079fdf-2fc5-4c99-b243-564808e9080e tempest-SnapshotsActionsTest-1329048363 None] Acquiring lock "cinder-quobyte-97226f74-0159-4b9a-b538-229d4a909064" by "_delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:20:10 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-54212c80-68d4-47dc-bae6-b2fc953d8b15 tempest-VolumesActionsTest-1044123451 None] Created volume successfully. Jul 22 03:20:10 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-2b079fdf-2fc5-4c99-b243-564808e9080e tempest-SnapshotsActionsTest-1329048363 None] Lock "cinder-quobyte-97226f74-0159-4b9a-b538-229d4a909064" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:20:10 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-2b079fdf-2fc5-4c99-b243-564808e9080e tempest-SnapshotsActionsTest-1329048363 None] Deleting offline snapshot 97226f74-0159-4b9a-b538-229d4a909064 of volume d01a3a60-aacf-4183-a2c5-769747c37d7a {{(pid=87747) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 03:20:10 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-2b079fdf-2fc5-4c99-b243-564808e9080e tempest-SnapshotsActionsTest-1329048363 None] snapshot_file for this snap is: volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.97226f74-0159-4b9a-b538-229d4a909064 {{(pid=87747) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 03:20:10 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[00996cb3-b31f-4d29-81b0-1d6944a2cde0]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:20:10 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2b079fdf-2fc5-4c99-b243-564808e9080e tempest-SnapshotsActionsTest-1329048363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.97226f74-0159-4b9a-b538-229d4a909064 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:20:10 devstack sudo[94008]: pam_unix(sudo:session): session closed for user root Jul 22 03:20:10 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5f346ef4-2ee0-410d-8da7-a20e626b7f2f tempest-AttachVolumeShelveTestJSON-597292271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1719ff05-ee15-4be4-9d6d-8c5532022bda" returned: 0 in 0.330s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:20:10 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-5f346ef4-2ee0-410d-8da7-a20e626b7f2f tempest-AttachVolumeShelveTestJSON-597292271 None] Lock "cinder-quobyte-1719ff05-ee15-4be4-9d6d-8c5532022bda" released by "delete_volume" :: held 0.915s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:20:10 devstack sudo[94011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.97226f74-0159-4b9a-b538-229d4a909064 Jul 22 03:20:10 devstack sudo[94011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:20:10 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-5f346ef4-2ee0-410d-8da7-a20e626b7f2f tempest-AttachVolumeShelveTestJSON-597292271 None] Created reservations ['2e9c083d-8f7a-405b-9d52-1795b8d92122', '9ee4fb6c-f713-45b3-ad5c-a19955589b13', '44fd82d8-8623-4767-b491-f8a3d48ab25c', '06a17033-c60c-4353-8536-aeef95d88f50'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:20:10 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-5f346ef4-2ee0-410d-8da7-a20e626b7f2f tempest-AttachVolumeShelveTestJSON-597292271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:20:10 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-5f346ef4-2ee0-410d-8da7-a20e626b7f2f tempest-AttachVolumeShelveTestJSON-597292271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:20:10 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-5f346ef4-2ee0-410d-8da7-a20e626b7f2f tempest-AttachVolumeShelveTestJSON-597292271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:20:10 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-5f346ef4-2ee0-410d-8da7-a20e626b7f2f tempest-AttachVolumeShelveTestJSON-597292271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:20:10 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-5f346ef4-2ee0-410d-8da7-a20e626b7f2f tempest-AttachVolumeShelveTestJSON-597292271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:20:10 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5f346ef4-2ee0-410d-8da7-a20e626b7f2f tempest-AttachVolumeShelveTestJSON-597292271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:20:10 devstack sudo[94014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:20:10 devstack sudo[94014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:20:10 devstack sudo[94011]: pam_unix(sudo:session): session closed for user root Jul 22 03:20:10 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2b079fdf-2fc5-4c99-b243-564808e9080e tempest-SnapshotsActionsTest-1329048363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.97226f74-0159-4b9a-b538-229d4a909064" returned: 0 in 0.501s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:20:10 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-2b079fdf-2fc5-4c99-b243-564808e9080e tempest-SnapshotsActionsTest-1329048363 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d01a3a60-aacf-4183-a2c5-769747c37d7a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87747) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 03:20:10 devstack sudo[94014]: pam_unix(sudo:session): session closed for user root Jul 22 03:20:10 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5f346ef4-2ee0-410d-8da7-a20e626b7f2f tempest-AttachVolumeShelveTestJSON-597292271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.273s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:20:10 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-5f346ef4-2ee0-410d-8da7-a20e626b7f2f tempest-AttachVolumeShelveTestJSON-597292271 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:20:10 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a6b55c-d94f-4ee6-9aab-0a29846c3263]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:20:10 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2b079fdf-2fc5-4c99-b243-564808e9080e tempest-SnapshotsActionsTest-1329048363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:20:10 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-5f346ef4-2ee0-410d-8da7-a20e626b7f2f tempest-AttachVolumeShelveTestJSON-597292271 None] Deleted volume successfully. Jul 22 03:20:11 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-5f346ef4-2ee0-410d-8da7-a20e626b7f2f tempest-AttachVolumeShelveTestJSON-597292271 None] Lock "cinder-1719ff05-ee15-4be4-9d6d-8c5532022bda-delete_volume" released by "delete_volume" :: held 1.502s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:20:11 devstack sudo[94020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a Jul 22 03:20:11 devstack sudo[94020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:20:11 devstack sudo[94020]: pam_unix(sudo:session): session closed for user root Jul 22 03:20:11 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2b079fdf-2fc5-4c99-b243-564808e9080e tempest-SnapshotsActionsTest-1329048363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a" returned: 0 in 0.474s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:20:11 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2b079fdf-2fc5-4c99-b243-564808e9080e tempest-SnapshotsActionsTest-1329048363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.97226f74-0159-4b9a-b538-229d4a909064 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:20:11 devstack sudo[94025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.97226f74-0159-4b9a-b538-229d4a909064 Jul 22 03:20:11 devstack sudo[94025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:20:11 devstack sudo[94025]: pam_unix(sudo:session): session closed for user root Jul 22 03:20:11 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2b079fdf-2fc5-4c99-b243-564808e9080e tempest-SnapshotsActionsTest-1329048363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.97226f74-0159-4b9a-b538-229d4a909064" returned: 0 in 0.463s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:20:11 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2b079fdf-2fc5-4c99-b243-564808e9080e tempest-SnapshotsActionsTest-1329048363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.97226f74-0159-4b9a-b538-229d4a909064 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:20:11 devstack sudo[94035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.97226f74-0159-4b9a-b538-229d4a909064 Jul 22 03:20:11 devstack sudo[94035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:20:12 devstack sudo[94035]: pam_unix(sudo:session): session closed for user root Jul 22 03:20:12 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2b079fdf-2fc5-4c99-b243-564808e9080e tempest-SnapshotsActionsTest-1329048363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a.97226f74-0159-4b9a-b538-229d4a909064" returned: 0 in 0.293s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:20:12 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-2b079fdf-2fc5-4c99-b243-564808e9080e tempest-SnapshotsActionsTest-1329048363 None] Lock "cinder-quobyte-97226f74-0159-4b9a-b538-229d4a909064" released by "_delete_snapshot" :: held 1.872s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:20:12 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-2b079fdf-2fc5-4c99-b243-564808e9080e tempest-SnapshotsActionsTest-1329048363 None] Lock "cinder-quobyte-d01a3a60-aacf-4183-a2c5-769747c37d7a" released by "delete_snapshot" :: held 1.908s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:20:12 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-2b079fdf-2fc5-4c99-b243-564808e9080e tempest-SnapshotsActionsTest-1329048363 None] Created reservations ['fa2e46de-6f7e-4c1a-9fa1-e0033aba2625', '84a63ebb-20f4-467c-a3c5-f45fe2e56830', '11692f3d-2092-44d6-94fe-266ea9ceda6d', '8b56bdfa-3666-42f6-8e8d-92040a0f799e'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:20:12 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-2b079fdf-2fc5-4c99-b243-564808e9080e tempest-SnapshotsActionsTest-1329048363 None] Delete snapshot completed successfully. Jul 22 03:20:12 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-2b079fdf-2fc5-4c99-b243-564808e9080e tempest-SnapshotsActionsTest-1329048363 None] Lock "cinder-97226f74-0159-4b9a-b538-229d4a909064-delete_snapshot" released by "delete_snapshot" :: held 2.069s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:20:12 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-d725f4af-9952-4fe7-9404-ee6d5234c567 tempest-SnapshotsActionsTest-1329048363 None] Acquiring lock "cinder-d01a3a60-aacf-4183-a2c5-769747c37d7a-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:20:12 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-d725f4af-9952-4fe7-9404-ee6d5234c567 tempest-SnapshotsActionsTest-1329048363 None] Lock "cinder-d01a3a60-aacf-4183-a2c5-769747c37d7a-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:20:12 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-d725f4af-9952-4fe7-9404-ee6d5234c567 tempest-SnapshotsActionsTest-1329048363 None] Acquiring lock "cinder-quobyte-d01a3a60-aacf-4183-a2c5-769747c37d7a" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:20:12 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-d725f4af-9952-4fe7-9404-ee6d5234c567 tempest-SnapshotsActionsTest-1329048363 None] Lock "cinder-quobyte-d01a3a60-aacf-4183-a2c5-769747c37d7a" acquired by "delete_volume" :: waited 0.023s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:20:12 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b4429f-ef43-41b2-887a-6dfe5b3a89fa]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:20:12 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d725f4af-9952-4fe7-9404-ee6d5234c567 tempest-SnapshotsActionsTest-1329048363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:20:12 devstack sudo[94040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a Jul 22 03:20:12 devstack sudo[94040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:20:13 devstack sudo[94040]: pam_unix(sudo:session): session closed for user root Jul 22 03:20:13 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d725f4af-9952-4fe7-9404-ee6d5234c567 tempest-SnapshotsActionsTest-1329048363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a" returned: 0 in 0.389s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:20:13 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d725f4af-9952-4fe7-9404-ee6d5234c567 tempest-SnapshotsActionsTest-1329048363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:20:13 devstack sudo[94048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a Jul 22 03:20:13 devstack sudo[94048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:20:13 devstack sudo[94048]: pam_unix(sudo:session): session closed for user root Jul 22 03:20:13 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d725f4af-9952-4fe7-9404-ee6d5234c567 tempest-SnapshotsActionsTest-1329048363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d01a3a60-aacf-4183-a2c5-769747c37d7a" returned: 0 in 0.298s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:20:13 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-d725f4af-9952-4fe7-9404-ee6d5234c567 tempest-SnapshotsActionsTest-1329048363 None] Lock "cinder-quobyte-d01a3a60-aacf-4183-a2c5-769747c37d7a" released by "delete_volume" :: held 0.752s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:20:13 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-d725f4af-9952-4fe7-9404-ee6d5234c567 tempest-SnapshotsActionsTest-1329048363 None] Created reservations ['2f5fa7b3-36ee-4087-9ad2-e38a91c02fc7', '5b55df7c-d0c1-4022-b3c1-b0ffdee66b39', '475026ad-ef14-4a2f-b1be-6922bcef51d4', 'f63f8395-21f5-4461-9458-cdf93fa106e2'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:20:13 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-d725f4af-9952-4fe7-9404-ee6d5234c567 tempest-SnapshotsActionsTest-1329048363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:20:13 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-d725f4af-9952-4fe7-9404-ee6d5234c567 tempest-SnapshotsActionsTest-1329048363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:20:13 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-d725f4af-9952-4fe7-9404-ee6d5234c567 tempest-SnapshotsActionsTest-1329048363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:20:13 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-d725f4af-9952-4fe7-9404-ee6d5234c567 tempest-SnapshotsActionsTest-1329048363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:20:13 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-d725f4af-9952-4fe7-9404-ee6d5234c567 tempest-SnapshotsActionsTest-1329048363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:20:13 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d725f4af-9952-4fe7-9404-ee6d5234c567 tempest-SnapshotsActionsTest-1329048363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:20:13 devstack sudo[94051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:20:13 devstack sudo[94051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:20:13 devstack sudo[94051]: pam_unix(sudo:session): session closed for user root Jul 22 03:20:13 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d725f4af-9952-4fe7-9404-ee6d5234c567 tempest-SnapshotsActionsTest-1329048363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.390s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:20:13 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-d725f4af-9952-4fe7-9404-ee6d5234c567 tempest-SnapshotsActionsTest-1329048363 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:20:13 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-d725f4af-9952-4fe7-9404-ee6d5234c567 tempest-SnapshotsActionsTest-1329048363 None] Deleted volume successfully. Jul 22 03:20:14 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-d725f4af-9952-4fe7-9404-ee6d5234c567 tempest-SnapshotsActionsTest-1329048363 None] Lock "cinder-d01a3a60-aacf-4183-a2c5-769747c37d7a-delete_volume" released by "delete_volume" :: held 1.437s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:20:22 devstack cinder-volume[87747]: DEBUG oslo_service.periodic_task [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87747) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 03:20:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:20:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:20:22 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:20:22 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:20:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:20:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:20:22 devstack sudo[94076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:20:22 devstack sudo[94076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:20:22 devstack sudo[94076]: pam_unix(sudo:session): session closed for user root Jul 22 03:20:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.422s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:20:22 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:20:22 devstack cinder-volume[87747]: DEBUG oslo_service.periodic_task [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Running periodic task VolumeManager._thread_info {{(pid=87747) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 03:20:22 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] thread count: 8 {{(pid=87747) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 22 03:20:22 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] thread info: [<_MainThread(MainThread, started 132775275860096)>, , , , , , , ] {{(pid=87747) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 22 03:20:23 devstack cinder-volume[87747]: DEBUG dbcounter [-] [87747] Writing DB stats cinder:UPDATE=123,cinder:SELECT=86,cinder:DELETE=9,cinder:INSERT=26 {{(pid=87747) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 03:20:23 devstack cinder-volume[87747]: DEBUG dbcounter [-] [87747] Writing DB stats cinder:SELECT=98,cinder:INSERT=35,cinder:UPDATE=117,cinder:DELETE=12 {{(pid=87747) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 03:20:24 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-68d0f951-0dde-4e07-bcf8-e1abfdbcbeb5 tempest-VolumeQuotasAdminTestJSON-261145528 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:20:24 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-68d0f951-0dde-4e07-bcf8-e1abfdbcbeb5 tempest-VolumeQuotasAdminTestJSON-261145528 None] Flow 'volume_create_manager' (8e6e85d2-28e6-4b6b-8022-92498fa91a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:20:24 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-68d0f951-0dde-4e07-bcf8-e1abfdbcbeb5 tempest-VolumeQuotasAdminTestJSON-261145528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c887a268-309e-4e7c-8847-5e73372d83d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:20:24 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-68d0f951-0dde-4e07-bcf8-e1abfdbcbeb5 tempest-VolumeQuotasAdminTestJSON-261145528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c887a268-309e-4e7c-8847-5e73372d83d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:20:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1999432251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d239c9d-111a-4c32-9231-dc2ec0000d17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4f2f2b0809e4da3929cc01f51598e08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:20:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:20:24Z,use_quota=True,user_id='491e73b06d9f446e8de9144ec1fc3aa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:20:24 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-68d0f951-0dde-4e07-bcf8-e1abfdbcbeb5 tempest-VolumeQuotasAdminTestJSON-261145528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1784f12-7a2d-4b83-8272-827d3766d795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:20:24 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-68d0f951-0dde-4e07-bcf8-e1abfdbcbeb5 tempest-VolumeQuotasAdminTestJSON-261145528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1784f12-7a2d-4b83-8272-827d3766d795) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:20:24 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-68d0f951-0dde-4e07-bcf8-e1abfdbcbeb5 tempest-VolumeQuotasAdminTestJSON-261145528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a3b5ab3-285b-461c-befc-825b9730c473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:20:24 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-68d0f951-0dde-4e07-bcf8-e1abfdbcbeb5 tempest-VolumeQuotasAdminTestJSON-261145528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a3b5ab3-285b-461c-befc-825b9730c473) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d239c9d-111a-4c32-9231-dc2ec0000d17', 'volume_name': 'volume-0d239c9d-111a-4c32-9231-dc2ec0000d17', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:20:24 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-68d0f951-0dde-4e07-bcf8-e1abfdbcbeb5 tempest-VolumeQuotasAdminTestJSON-261145528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (882238db-e8e8-44ee-bc84-ef359b76abfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:20:24 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-68d0f951-0dde-4e07-bcf8-e1abfdbcbeb5 tempest-VolumeQuotasAdminTestJSON-261145528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (882238db-e8e8-44ee-bc84-ef359b76abfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:20:24 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-68d0f951-0dde-4e07-bcf8-e1abfdbcbeb5 tempest-VolumeQuotasAdminTestJSON-261145528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bb68bed-061d-493f-adfa-f8fb429460c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:20:24 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-68d0f951-0dde-4e07-bcf8-e1abfdbcbeb5 tempest-VolumeQuotasAdminTestJSON-261145528 None] Volume 0d239c9d-111a-4c32-9231-dc2ec0000d17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d239c9d-111a-4c32-9231-dc2ec0000d17', 'volume_size': 1} Jul 22 03:20:24 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-68d0f951-0dde-4e07-bcf8-e1abfdbcbeb5 tempest-VolumeQuotasAdminTestJSON-261145528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:20:24 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-68d0f951-0dde-4e07-bcf8-e1abfdbcbeb5 tempest-VolumeQuotasAdminTestJSON-261145528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:20:24 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-68d0f951-0dde-4e07-bcf8-e1abfdbcbeb5 tempest-VolumeQuotasAdminTestJSON-261145528 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:20:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1999432251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d239c9d-111a-4c32-9231-dc2ec0000d17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4f2f2b0809e4da3929cc01f51598e08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:20:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:20:24Z,use_quota=True,user_id='491e73b06d9f446e8de9144ec1fc3aa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:20:24 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-68d0f951-0dde-4e07-bcf8-e1abfdbcbeb5 tempest-VolumeQuotasAdminTestJSON-261145528 None] Creating volume 0d239c9d-111a-4c32-9231-dc2ec0000d17 {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:20:24 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-68d0f951-0dde-4e07-bcf8-e1abfdbcbeb5 tempest-VolumeQuotasAdminTestJSON-261145528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:20:24 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-68d0f951-0dde-4e07-bcf8-e1abfdbcbeb5 tempest-VolumeQuotasAdminTestJSON-261145528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:20:24 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-68d0f951-0dde-4e07-bcf8-e1abfdbcbeb5 tempest-VolumeQuotasAdminTestJSON-261145528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:20:24 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-68d0f951-0dde-4e07-bcf8-e1abfdbcbeb5 tempest-VolumeQuotasAdminTestJSON-261145528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:20:24 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-68d0f951-0dde-4e07-bcf8-e1abfdbcbeb5 tempest-VolumeQuotasAdminTestJSON-261145528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:20:24 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-68d0f951-0dde-4e07-bcf8-e1abfdbcbeb5 tempest-VolumeQuotasAdminTestJSON-261145528 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:20:24 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-68d0f951-0dde-4e07-bcf8-e1abfdbcbeb5 tempest-VolumeQuotasAdminTestJSON-261145528 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:20:24 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-68d0f951-0dde-4e07-bcf8-e1abfdbcbeb5 tempest-VolumeQuotasAdminTestJSON-261145528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0d239c9d-111a-4c32-9231-dc2ec0000d17 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:20:24 devstack sudo[94101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0d239c9d-111a-4c32-9231-dc2ec0000d17 1073741824 Jul 22 03:20:24 devstack sudo[94101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:20:25 devstack sudo[94101]: pam_unix(sudo:session): session closed for user root Jul 22 03:20:25 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-68d0f951-0dde-4e07-bcf8-e1abfdbcbeb5 tempest-VolumeQuotasAdminTestJSON-261145528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0d239c9d-111a-4c32-9231-dc2ec0000d17 1073741824" returned: 0 in 0.879s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:20:25 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-68d0f951-0dde-4e07-bcf8-e1abfdbcbeb5 tempest-VolumeQuotasAdminTestJSON-261145528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0d239c9d-111a-4c32-9231-dc2ec0000d17 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:20:25 devstack sudo[94151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0d239c9d-111a-4c32-9231-dc2ec0000d17 Jul 22 03:20:25 devstack sudo[94151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:20:25 devstack sudo[94151]: pam_unix(sudo:session): session closed for user root Jul 22 03:20:25 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-68d0f951-0dde-4e07-bcf8-e1abfdbcbeb5 tempest-VolumeQuotasAdminTestJSON-261145528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0d239c9d-111a-4c32-9231-dc2ec0000d17" returned: 0 in 0.415s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:20:25 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-68d0f951-0dde-4e07-bcf8-e1abfdbcbeb5 tempest-VolumeQuotasAdminTestJSON-261145528 None] <== create_volume: return (1402ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:20:25 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-68d0f951-0dde-4e07-bcf8-e1abfdbcbeb5 tempest-VolumeQuotasAdminTestJSON-261145528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.405s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:20:26 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-68d0f951-0dde-4e07-bcf8-e1abfdbcbeb5 tempest-VolumeQuotasAdminTestJSON-261145528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bb68bed-061d-493f-adfa-f8fb429460c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d239c9d-111a-4c32-9231-dc2ec0000d17', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:20:26 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-68d0f951-0dde-4e07-bcf8-e1abfdbcbeb5 tempest-VolumeQuotasAdminTestJSON-261145528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53ec55b8-b190-4ec1-84ff-221f650a6224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:20:26 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-68d0f951-0dde-4e07-bcf8-e1abfdbcbeb5 tempest-VolumeQuotasAdminTestJSON-261145528 None] Volume volume-0d239c9d-111a-4c32-9231-dc2ec0000d17 (0d239c9d-111a-4c32-9231-dc2ec0000d17): created successfully Jul 22 03:20:26 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-68d0f951-0dde-4e07-bcf8-e1abfdbcbeb5 tempest-VolumeQuotasAdminTestJSON-261145528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53ec55b8-b190-4ec1-84ff-221f650a6224) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:20:26 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-68d0f951-0dde-4e07-bcf8-e1abfdbcbeb5 tempest-VolumeQuotasAdminTestJSON-261145528 None] Flow 'volume_create_manager' (8e6e85d2-28e6-4b6b-8022-92498fa91a53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:20:26 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-68d0f951-0dde-4e07-bcf8-e1abfdbcbeb5 tempest-VolumeQuotasAdminTestJSON-261145528 None] Created volume successfully. Jul 22 03:20:26 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-bd191dda-560f-4117-b342-71df22b40bc0 tempest-VolumeQuotasAdminTestJSON-261145528 None] Acquiring lock "cinder-0d239c9d-111a-4c32-9231-dc2ec0000d17-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:20:26 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-bd191dda-560f-4117-b342-71df22b40bc0 tempest-VolumeQuotasAdminTestJSON-261145528 None] Lock "cinder-0d239c9d-111a-4c32-9231-dc2ec0000d17-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:20:26 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-bd191dda-560f-4117-b342-71df22b40bc0 tempest-VolumeQuotasAdminTestJSON-261145528 None] Acquiring lock "cinder-quobyte-0d239c9d-111a-4c32-9231-dc2ec0000d17" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:20:26 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-bd191dda-560f-4117-b342-71df22b40bc0 tempest-VolumeQuotasAdminTestJSON-261145528 None] Lock "cinder-quobyte-0d239c9d-111a-4c32-9231-dc2ec0000d17" acquired by "delete_volume" :: waited 0.032s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:20:26 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[e72d3cc7-c82c-46f9-9ea9-6418fa52f2ac]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:20:26 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-bd191dda-560f-4117-b342-71df22b40bc0 tempest-VolumeQuotasAdminTestJSON-261145528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0d239c9d-111a-4c32-9231-dc2ec0000d17 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:20:27 devstack sudo[94157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0d239c9d-111a-4c32-9231-dc2ec0000d17 Jul 22 03:20:27 devstack sudo[94157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:20:27 devstack sudo[94157]: pam_unix(sudo:session): session closed for user root Jul 22 03:20:27 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-bd191dda-560f-4117-b342-71df22b40bc0 tempest-VolumeQuotasAdminTestJSON-261145528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0d239c9d-111a-4c32-9231-dc2ec0000d17" returned: 0 in 0.708s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:20:27 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-bd191dda-560f-4117-b342-71df22b40bc0 tempest-VolumeQuotasAdminTestJSON-261145528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0d239c9d-111a-4c32-9231-dc2ec0000d17 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:20:27 devstack sudo[94163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0d239c9d-111a-4c32-9231-dc2ec0000d17 Jul 22 03:20:27 devstack sudo[94163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:20:28 devstack sudo[94163]: pam_unix(sudo:session): session closed for user root Jul 22 03:20:28 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-bd191dda-560f-4117-b342-71df22b40bc0 tempest-VolumeQuotasAdminTestJSON-261145528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0d239c9d-111a-4c32-9231-dc2ec0000d17" returned: 0 in 0.416s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:20:28 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-bd191dda-560f-4117-b342-71df22b40bc0 tempest-VolumeQuotasAdminTestJSON-261145528 None] Lock "cinder-quobyte-0d239c9d-111a-4c32-9231-dc2ec0000d17" released by "delete_volume" :: held 1.202s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:20:28 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-bd191dda-560f-4117-b342-71df22b40bc0 tempest-VolumeQuotasAdminTestJSON-261145528 None] Created reservations ['ae8ce84e-aef8-42b5-8f27-9bd5476aad11', '987a4fb5-50e3-4dba-9375-bb895c5bc812', '61068613-3c27-4aae-9d3f-b8a449294c4e', 'd5e7a87f-475a-4825-9dc0-ec0b744f388e'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:20:28 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-bd191dda-560f-4117-b342-71df22b40bc0 tempest-VolumeQuotasAdminTestJSON-261145528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:20:28 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-bd191dda-560f-4117-b342-71df22b40bc0 tempest-VolumeQuotasAdminTestJSON-261145528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:20:28 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-bd191dda-560f-4117-b342-71df22b40bc0 tempest-VolumeQuotasAdminTestJSON-261145528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:20:28 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-bd191dda-560f-4117-b342-71df22b40bc0 tempest-VolumeQuotasAdminTestJSON-261145528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:20:28 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-bd191dda-560f-4117-b342-71df22b40bc0 tempest-VolumeQuotasAdminTestJSON-261145528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:20:28 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-bd191dda-560f-4117-b342-71df22b40bc0 tempest-VolumeQuotasAdminTestJSON-261145528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:20:28 devstack sudo[94200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:20:28 devstack sudo[94200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:20:28 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-32b25ea6-867a-4c8e-913c-ec86c5261906 tempest-TestShelveInstance-1884963064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:20:28 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-32b25ea6-867a-4c8e-913c-ec86c5261906 tempest-TestShelveInstance-1884963064 None] Flow 'volume_create_manager' (ec11dcd4-73c6-4f70-9c05-3f94f53e4fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:20:28 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-32b25ea6-867a-4c8e-913c-ec86c5261906 tempest-TestShelveInstance-1884963064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dfbd768-19f1-4eb7-a613-580567971b2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:20:28 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-32b25ea6-867a-4c8e-913c-ec86c5261906 tempest-TestShelveInstance-1884963064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dfbd768-19f1-4eb7-a613-580567971b2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:20:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1412731818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76f8ddaa-d64c-4017-b69f-ca776a2c2e07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf50114d54ec4c28bc6601284d3a59e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:20:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:20:29Z,use_quota=True,user_id='66f57090617c45beae183d290fbf0389',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:20:28 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-32b25ea6-867a-4c8e-913c-ec86c5261906 tempest-TestShelveInstance-1884963064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb6761f4-9e5e-49cf-a1aa-e1a15193417e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:20:28 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-32b25ea6-867a-4c8e-913c-ec86c5261906 tempest-TestShelveInstance-1884963064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb6761f4-9e5e-49cf-a1aa-e1a15193417e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:20:28 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-32b25ea6-867a-4c8e-913c-ec86c5261906 tempest-TestShelveInstance-1884963064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f120d5c-7a85-4fa6-8915-2b9b0b3f82ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:20:28 devstack cinder-volume[87747]: DEBUG cinder.image.glance [None req-32b25ea6-867a-4c8e-913c-ec86c5261906 tempest-TestShelveInstance-1884963064 None] Creating Keystone auth plugin from conf {{(pid=87747) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 22 03:20:28 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-3eee8c8c-0af8-4681-a263-ed699af68c6d tempest-VolumesActionsTest-1044123451 None] Acquiring lock "cinder-861a18d3-74d2-49b7-b057-ac67f6d6bea3" by "attach_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:20:28 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-3eee8c8c-0af8-4681-a263-ed699af68c6d tempest-VolumesActionsTest-1044123451 None] Lock "cinder-861a18d3-74d2-49b7-b057-ac67f6d6bea3" acquired by "attach_volume" :: waited 0.026s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:20:29 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-3eee8c8c-0af8-4681-a263-ed699af68c6d tempest-VolumesActionsTest-1044123451 None] Attaching volume 861a18d3-74d2-49b7-b057-ac67f6d6bea3 to instance 59c5a7ad-74ee-4b01-933b-f251addf9966 at mountpoint /dev/vdb on host None. Jul 22 03:20:29 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-3eee8c8c-0af8-4681-a263-ed699af68c6d tempest-VolumesActionsTest-1044123451 None] Attach volume completed successfully. Jul 22 03:20:29 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-3eee8c8c-0af8-4681-a263-ed699af68c6d tempest-VolumesActionsTest-1044123451 None] Lock "cinder-861a18d3-74d2-49b7-b057-ac67f6d6bea3" released by "attach_volume" :: held 0.185s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:20:29 devstack sudo[94200]: pam_unix(sudo:session): session closed for user root Jul 22 03:20:29 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-bd191dda-560f-4117-b342-71df22b40bc0 tempest-VolumeQuotasAdminTestJSON-261145528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.844s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:20:29 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-bd191dda-560f-4117-b342-71df22b40bc0 tempest-VolumeQuotasAdminTestJSON-261145528 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:20:29 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-bd191dda-560f-4117-b342-71df22b40bc0 tempest-VolumeQuotasAdminTestJSON-261145528 None] Deleted volume successfully. Jul 22 03:20:29 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-bd191dda-560f-4117-b342-71df22b40bc0 tempest-VolumeQuotasAdminTestJSON-261145528 None] Lock "cinder-0d239c9d-111a-4c32-9231-dc2ec0000d17-delete_volume" released by "delete_volume" :: held 2.587s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:20:29 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-1cbacda0-cefa-4ec6-92c1-c2307d7c3179 tempest-VolumesActionsTest-1044123451 None] Acquiring lock "cinder-861a18d3-74d2-49b7-b057-ac67f6d6bea3-detach_volume" by "detach_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:20:29 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-1cbacda0-cefa-4ec6-92c1-c2307d7c3179 tempest-VolumesActionsTest-1044123451 None] Lock "cinder-861a18d3-74d2-49b7-b057-ac67f6d6bea3-detach_volume" acquired by "detach_volume" :: waited 0.022s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:20:29 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-1cbacda0-cefa-4ec6-92c1-c2307d7c3179 tempest-VolumesActionsTest-1044123451 None] Detaching volume 861a18d3-74d2-49b7-b057-ac67f6d6bea3 from instance 59c5a7ad-74ee-4b01-933b-f251addf9966. Jul 22 03:20:29 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-1cbacda0-cefa-4ec6-92c1-c2307d7c3179 tempest-VolumesActionsTest-1044123451 None] Detach volume completed successfully. Jul 22 03:20:29 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-1cbacda0-cefa-4ec6-92c1-c2307d7c3179 tempest-VolumesActionsTest-1044123451 None] Lock "cinder-861a18d3-74d2-49b7-b057-ac67f6d6bea3-detach_volume" released by "detach_volume" :: held 0.151s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:20:29 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-32b25ea6-867a-4c8e-913c-ec86c5261906 tempest-TestShelveInstance-1884963064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f120d5c-7a85-4fa6-8915-2b9b0b3f82ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '76f8ddaa-d64c-4017-b69f-ca776a2c2e07', 'volume_name': 'volume-76f8ddaa-d64c-4017-b69f-ca776a2c2e07', 'volume_size': 1, 'image_id': 'a3efde48-babd-4b04-b205-71cd843dec16', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a3efde48-babd-4b04-b205-71cd843dec16', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '37328413017b49c4b4fe75bae83dd2ac', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a3efde48-babd-4b04-b205-71cd843dec16', 'created_at': datetime.datetime(2026, 7, 22, 1, 8, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 22, 1, 8, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a3efde48-babd-4b04-b205-71cd843dec16/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:20:29 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-32b25ea6-867a-4c8e-913c-ec86c5261906 tempest-TestShelveInstance-1884963064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a031660-9c6d-453c-8262-b03fd1d1aca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:20:30 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-32b25ea6-867a-4c8e-913c-ec86c5261906 tempest-TestShelveInstance-1884963064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a031660-9c6d-453c-8262-b03fd1d1aca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:20:30 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-32b25ea6-867a-4c8e-913c-ec86c5261906 tempest-TestShelveInstance-1884963064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89ed9b49-8060-4fc8-85f4-fb16d186bd0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:20:30 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-32b25ea6-867a-4c8e-913c-ec86c5261906 tempest-TestShelveInstance-1884963064 None] Volume 76f8ddaa-d64c-4017-b69f-ca776a2c2e07: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-76f8ddaa-d64c-4017-b69f-ca776a2c2e07', 'volume_size': 1, 'image_id': 'a3efde48-babd-4b04-b205-71cd843dec16', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a3efde48-babd-4b04-b205-71cd843dec16', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '37328413017b49c4b4fe75bae83dd2ac', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a3efde48-babd-4b04-b205-71cd843dec16', 'created_at': datetime.datetime(2026, 7, 22, 1, 8, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 22, 1, 8, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a3efde48-babd-4b04-b205-71cd843dec16/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 22 03:20:30 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-32b25ea6-867a-4c8e-913c-ec86c5261906 tempest-TestShelveInstance-1884963064 None] Trying to clone 76f8ddaa-d64c-4017-b69f-ca776a2c2e07 from image a3efde48-babd-4b04-b205-71cd843dec16 at location (None, [{'url': 'file:///opt/stack/data/glance/images/a3efde48-babd-4b04-b205-71cd843dec16', 'metadata': {}}]). {{(pid=87747) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 22 03:20:30 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e7601b1-9444-4903-b940-8c34fc072c0e tempest-VolumeQuotasAdminTestJSON-261145528 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:20:30 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-6e7601b1-9444-4903-b940-8c34fc072c0e tempest-VolumeQuotasAdminTestJSON-261145528 None] Flow 'volume_create_manager' (5c15abdd-a1a5-45cd-ad18-8dd5152fac1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:20:30 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-6e7601b1-9444-4903-b940-8c34fc072c0e tempest-VolumeQuotasAdminTestJSON-261145528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fbb1bc8-32ce-441f-8bab-f735ff2286c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:20:30 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-6e7601b1-9444-4903-b940-8c34fc072c0e tempest-VolumeQuotasAdminTestJSON-261145528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fbb1bc8-32ce-441f-8bab-f735ff2286c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:20:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1058875793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bb58a23-4417-4a52-b6d0-3416b9758088,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4f2f2b0809e4da3929cc01f51598e08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:20:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:20:30Z,use_quota=True,user_id='491e73b06d9f446e8de9144ec1fc3aa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:20:30 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-6e7601b1-9444-4903-b940-8c34fc072c0e tempest-VolumeQuotasAdminTestJSON-261145528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1a6b264-ef22-48ee-9543-259953973da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:20:30 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-6e7601b1-9444-4903-b940-8c34fc072c0e tempest-VolumeQuotasAdminTestJSON-261145528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1a6b264-ef22-48ee-9543-259953973da3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:20:30 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-6e7601b1-9444-4903-b940-8c34fc072c0e tempest-VolumeQuotasAdminTestJSON-261145528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c8d6f92-3984-4e03-bbbd-e6455e5eb2c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:20:30 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-6e7601b1-9444-4903-b940-8c34fc072c0e tempest-VolumeQuotasAdminTestJSON-261145528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c8d6f92-3984-4e03-bbbd-e6455e5eb2c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4bb58a23-4417-4a52-b6d0-3416b9758088', 'volume_name': 'volume-4bb58a23-4417-4a52-b6d0-3416b9758088', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:20:30 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-6e7601b1-9444-4903-b940-8c34fc072c0e tempest-VolumeQuotasAdminTestJSON-261145528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15f8d0b6-83fd-4ce2-8788-87e90c3217d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:20:30 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-6e7601b1-9444-4903-b940-8c34fc072c0e tempest-VolumeQuotasAdminTestJSON-261145528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15f8d0b6-83fd-4ce2-8788-87e90c3217d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:20:30 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-6e7601b1-9444-4903-b940-8c34fc072c0e tempest-VolumeQuotasAdminTestJSON-261145528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec1f3792-6a01-48ef-8294-e236790d82a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:20:30 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-6e7601b1-9444-4903-b940-8c34fc072c0e tempest-VolumeQuotasAdminTestJSON-261145528 None] Volume 4bb58a23-4417-4a52-b6d0-3416b9758088: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4bb58a23-4417-4a52-b6d0-3416b9758088', 'volume_size': 1} Jul 22 03:20:30 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-6e7601b1-9444-4903-b940-8c34fc072c0e tempest-VolumeQuotasAdminTestJSON-261145528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:20:30 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-6e7601b1-9444-4903-b940-8c34fc072c0e tempest-VolumeQuotasAdminTestJSON-261145528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:20:30 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-6e7601b1-9444-4903-b940-8c34fc072c0e tempest-VolumeQuotasAdminTestJSON-261145528 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:20:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1058875793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bb58a23-4417-4a52-b6d0-3416b9758088,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4f2f2b0809e4da3929cc01f51598e08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:20:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:20:30Z,use_quota=True,user_id='491e73b06d9f446e8de9144ec1fc3aa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:20:30 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-6e7601b1-9444-4903-b940-8c34fc072c0e tempest-VolumeQuotasAdminTestJSON-261145528 None] Creating volume 4bb58a23-4417-4a52-b6d0-3416b9758088 {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:20:30 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-6e7601b1-9444-4903-b940-8c34fc072c0e tempest-VolumeQuotasAdminTestJSON-261145528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:20:30 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-6e7601b1-9444-4903-b940-8c34fc072c0e tempest-VolumeQuotasAdminTestJSON-261145528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:20:30 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-6e7601b1-9444-4903-b940-8c34fc072c0e tempest-VolumeQuotasAdminTestJSON-261145528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:20:30 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-6e7601b1-9444-4903-b940-8c34fc072c0e tempest-VolumeQuotasAdminTestJSON-261145528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:20:30 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-6e7601b1-9444-4903-b940-8c34fc072c0e tempest-VolumeQuotasAdminTestJSON-261145528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:20:30 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-6e7601b1-9444-4903-b940-8c34fc072c0e tempest-VolumeQuotasAdminTestJSON-261145528 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:20:30 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-6e7601b1-9444-4903-b940-8c34fc072c0e tempest-VolumeQuotasAdminTestJSON-261145528 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:20:30 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-6e7601b1-9444-4903-b940-8c34fc072c0e tempest-VolumeQuotasAdminTestJSON-261145528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4bb58a23-4417-4a52-b6d0-3416b9758088 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:20:30 devstack sudo[94238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4bb58a23-4417-4a52-b6d0-3416b9758088 1073741824 Jul 22 03:20:30 devstack sudo[94238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:20:30 devstack cinder-volume[87747]: DEBUG cinder.image.image_utils [None req-32b25ea6-867a-4c8e-913c-ec86c5261906 tempest-TestShelveInstance-1884963064 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a3efde48-babd-4b04-b205-71cd843dec16_6ezi9phydevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87747) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 22 03:20:30 devstack cinder-volume[87747]: INFO cinder.image.image_utils [None req-32b25ea6-867a-4c8e-913c-ec86c5261906 tempest-TestShelveInstance-1884963064 None] Image download 20.69 MB at 20.69 MB/s Jul 22 03:20:31 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[653f5ad7-026d-470d-823b-27afa5fdec79]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:20:31 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-32b25ea6-867a-4c8e-913c-ec86c5261906 tempest-TestShelveInstance-1884963064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a3efde48-babd-4b04-b205-71cd843dec16_6ezi9phydevstack@QuobyteHD {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:20:31 devstack sudo[94249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a3efde48-babd-4b04-b205-71cd843dec16_6ezi9phydevstack@QuobyteHD Jul 22 03:20:31 devstack sudo[94249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:20:31 devstack sudo[94238]: pam_unix(sudo:session): session closed for user root Jul 22 03:20:31 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-6e7601b1-9444-4903-b940-8c34fc072c0e tempest-VolumeQuotasAdminTestJSON-261145528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4bb58a23-4417-4a52-b6d0-3416b9758088 1073741824" returned: 0 in 0.720s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:20:31 devstack sudo[94249]: pam_unix(sudo:session): session closed for user root Jul 22 03:20:31 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-32b25ea6-867a-4c8e-913c-ec86c5261906 tempest-TestShelveInstance-1884963064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a3efde48-babd-4b04-b205-71cd843dec16_6ezi9phydevstack@QuobyteHD" returned: 0 in 0.449s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:20:31 devstack cinder-volume[87747]: DEBUG cinder.image.image_utils [None req-32b25ea6-867a-4c8e-913c-ec86c5261906 tempest-TestShelveInstance-1884963064 None] Temporary image a3efde48-babd-4b04-b205-71cd843dec16 is fetched for user 66f57090617c45beae183d290fbf0389. {{(pid=87747) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 22 03:20:31 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-6e7601b1-9444-4903-b940-8c34fc072c0e tempest-VolumeQuotasAdminTestJSON-261145528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4bb58a23-4417-4a52-b6d0-3416b9758088 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:20:31 devstack sudo[94262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4bb58a23-4417-4a52-b6d0-3416b9758088 Jul 22 03:20:31 devstack sudo[94262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:20:31 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8aadadb-00f9-4ba9-9820-3a352161c8a3]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:20:31 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-32b25ea6-867a-4c8e-913c-ec86c5261906 tempest-TestShelveInstance-1884963064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a3efde48-babd-4b04-b205-71cd843dec16_6ezi9phydevstack@QuobyteHD {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:20:31 devstack sudo[94264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a3efde48-babd-4b04-b205-71cd843dec16_6ezi9phydevstack@QuobyteHD Jul 22 03:20:31 devstack sudo[94264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:20:31 devstack sudo[94262]: pam_unix(sudo:session): session closed for user root Jul 22 03:20:31 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-6e7601b1-9444-4903-b940-8c34fc072c0e tempest-VolumeQuotasAdminTestJSON-261145528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4bb58a23-4417-4a52-b6d0-3416b9758088" returned: 0 in 0.328s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:20:31 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-6e7601b1-9444-4903-b940-8c34fc072c0e tempest-VolumeQuotasAdminTestJSON-261145528 None] <== create_volume: return (1111ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:20:31 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-6e7601b1-9444-4903-b940-8c34fc072c0e tempest-VolumeQuotasAdminTestJSON-261145528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.114s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:20:31 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-6e7601b1-9444-4903-b940-8c34fc072c0e tempest-VolumeQuotasAdminTestJSON-261145528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec1f3792-6a01-48ef-8294-e236790d82a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4bb58a23-4417-4a52-b6d0-3416b9758088', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:20:31 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-6e7601b1-9444-4903-b940-8c34fc072c0e tempest-VolumeQuotasAdminTestJSON-261145528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6456847f-f32f-42e4-94bb-c63c1f425a20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:20:31 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-6e7601b1-9444-4903-b940-8c34fc072c0e tempest-VolumeQuotasAdminTestJSON-261145528 None] Volume volume-4bb58a23-4417-4a52-b6d0-3416b9758088 (4bb58a23-4417-4a52-b6d0-3416b9758088): created successfully Jul 22 03:20:31 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-6e7601b1-9444-4903-b940-8c34fc072c0e tempest-VolumeQuotasAdminTestJSON-261145528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6456847f-f32f-42e4-94bb-c63c1f425a20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:20:31 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-6e7601b1-9444-4903-b940-8c34fc072c0e tempest-VolumeQuotasAdminTestJSON-261145528 None] Flow 'volume_create_manager' (5c15abdd-a1a5-45cd-ad18-8dd5152fac1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:20:31 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-6e7601b1-9444-4903-b940-8c34fc072c0e tempest-VolumeQuotasAdminTestJSON-261145528 None] Created volume successfully. Jul 22 03:20:32 devstack sudo[94264]: pam_unix(sudo:session): session closed for user root Jul 22 03:20:32 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-32b25ea6-867a-4c8e-913c-ec86c5261906 tempest-TestShelveInstance-1884963064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a3efde48-babd-4b04-b205-71cd843dec16_6ezi9phydevstack@QuobyteHD" returned: 0 in 0.478s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:20:32 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-32b25ea6-867a-4c8e-913c-ec86c5261906 tempest-TestShelveInstance-1884963064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:20:32 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-32b25ea6-867a-4c8e-913c-ec86c5261906 tempest-TestShelveInstance-1884963064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:20:32 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-32b25ea6-867a-4c8e-913c-ec86c5261906 tempest-TestShelveInstance-1884963064 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:20:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1412731818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76f8ddaa-d64c-4017-b69f-ca776a2c2e07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf50114d54ec4c28bc6601284d3a59e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:20:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:20:29Z,use_quota=True,user_id='66f57090617c45beae183d290fbf0389',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:20:32 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-32b25ea6-867a-4c8e-913c-ec86c5261906 tempest-TestShelveInstance-1884963064 None] Creating volume 76f8ddaa-d64c-4017-b69f-ca776a2c2e07 {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:20:32 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-32b25ea6-867a-4c8e-913c-ec86c5261906 tempest-TestShelveInstance-1884963064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:20:32 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-32b25ea6-867a-4c8e-913c-ec86c5261906 tempest-TestShelveInstance-1884963064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:20:32 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-32b25ea6-867a-4c8e-913c-ec86c5261906 tempest-TestShelveInstance-1884963064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:20:32 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-32b25ea6-867a-4c8e-913c-ec86c5261906 tempest-TestShelveInstance-1884963064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:20:32 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-32b25ea6-867a-4c8e-913c-ec86c5261906 tempest-TestShelveInstance-1884963064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:20:32 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-32b25ea6-867a-4c8e-913c-ec86c5261906 tempest-TestShelveInstance-1884963064 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:20:32 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-32b25ea6-867a-4c8e-913c-ec86c5261906 tempest-TestShelveInstance-1884963064 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:20:32 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-32b25ea6-867a-4c8e-913c-ec86c5261906 tempest-TestShelveInstance-1884963064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-76f8ddaa-d64c-4017-b69f-ca776a2c2e07 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:20:32 devstack sudo[94270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-76f8ddaa-d64c-4017-b69f-ca776a2c2e07 1073741824 Jul 22 03:20:32 devstack sudo[94270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:20:32 devstack sudo[94270]: pam_unix(sudo:session): session closed for user root Jul 22 03:20:32 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-32b25ea6-867a-4c8e-913c-ec86c5261906 tempest-TestShelveInstance-1884963064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-76f8ddaa-d64c-4017-b69f-ca776a2c2e07 1073741824" returned: 0 in 0.714s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:20:32 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-32b25ea6-867a-4c8e-913c-ec86c5261906 tempest-TestShelveInstance-1884963064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-76f8ddaa-d64c-4017-b69f-ca776a2c2e07 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:20:32 devstack sudo[94279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-76f8ddaa-d64c-4017-b69f-ca776a2c2e07 Jul 22 03:20:32 devstack sudo[94279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:20:33 devstack sudo[94279]: pam_unix(sudo:session): session closed for user root Jul 22 03:20:33 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-32b25ea6-867a-4c8e-913c-ec86c5261906 tempest-TestShelveInstance-1884963064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-76f8ddaa-d64c-4017-b69f-ca776a2c2e07" returned: 0 in 0.397s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:20:33 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-32b25ea6-867a-4c8e-913c-ec86c5261906 tempest-TestShelveInstance-1884963064 None] <== create_volume: return (1174ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:20:33 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-32b25ea6-867a-4c8e-913c-ec86c5261906 tempest-TestShelveInstance-1884963064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.178s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:20:33 devstack cinder-volume[87747]: DEBUG cinder.volume.volume_utils [None req-32b25ea6-867a-4c8e-913c-ec86c5261906 tempest-TestShelveInstance-1884963064 None] Attempting download of a3efde48-babd-4b04-b205-71cd843dec16 ((None, [{'url': 'file:///opt/stack/data/glance/images/a3efde48-babd-4b04-b205-71cd843dec16', 'metadata': {}}])) to volume 76f8ddaa-d64c-4017-b69f-ca776a2c2e07. {{(pid=87747) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 22 03:20:33 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bac0505-b148-4a42-ac1d-6468f0a14808]: (4, 'raw') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:20:33 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-32b25ea6-867a-4c8e-913c-ec86c5261906 tempest-TestShelveInstance-1884963064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a3efde48-babd-4b04-b205-71cd843dec16_f_r77qai {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:20:33 devstack sudo[94282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a3efde48-babd-4b04-b205-71cd843dec16_f_r77qai Jul 22 03:20:33 devstack sudo[94282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:20:33 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-fd8881f4-b790-4ba1-970f-ca3e8373ead1 tempest-VolumeQuotasAdminTestJSON-306114340 None] Transfer volume completed successfully. Jul 22 03:20:33 devstack sudo[94282]: pam_unix(sudo:session): session closed for user root Jul 22 03:20:34 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-32b25ea6-867a-4c8e-913c-ec86c5261906 tempest-TestShelveInstance-1884963064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a3efde48-babd-4b04-b205-71cd843dec16_f_r77qai" returned: 0 in 0.539s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:20:34 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-32b25ea6-867a-4c8e-913c-ec86c5261906 tempest-TestShelveInstance-1884963064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a3efde48-babd-4b04-b205-71cd843dec16_f_r77qai {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:20:34 devstack sudo[94286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a3efde48-babd-4b04-b205-71cd843dec16_f_r77qai Jul 22 03:20:34 devstack sudo[94286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:20:34 devstack sudo[94286]: pam_unix(sudo:session): session closed for user root Jul 22 03:20:34 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-32b25ea6-867a-4c8e-913c-ec86c5261906 tempest-TestShelveInstance-1884963064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a3efde48-babd-4b04-b205-71cd843dec16_f_r77qai" returned: 1 in 0.465s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:20:34 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-32b25ea6-867a-4c8e-913c-ec86c5261906 tempest-TestShelveInstance-1884963064 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a3efde48-babd-4b04-b205-71cd843dec16_f_r77qai' failed. Not Retrying. {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 22 03:20:34 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[341cf747-4e12-4c0b-a114-af514ead77e5]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:20:34 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-32b25ea6-867a-4c8e-913c-ec86c5261906 tempest-TestShelveInstance-1884963064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a3efde48-babd-4b04-b205-71cd843dec16_6ezi9phydevstack@QuobyteHD {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:20:34 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-a6146e38-b098-486a-b439-2495282500ae tempest-VolumeQuotasAdminTestJSON-480836593 None] Acquiring lock "cinder-4bb58a23-4417-4a52-b6d0-3416b9758088-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:20:34 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-a6146e38-b098-486a-b439-2495282500ae tempest-VolumeQuotasAdminTestJSON-480836593 None] Lock "cinder-4bb58a23-4417-4a52-b6d0-3416b9758088-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:20:34 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-a6146e38-b098-486a-b439-2495282500ae tempest-VolumeQuotasAdminTestJSON-480836593 None] Acquiring lock "cinder-quobyte-4bb58a23-4417-4a52-b6d0-3416b9758088" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:20:34 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-a6146e38-b098-486a-b439-2495282500ae tempest-VolumeQuotasAdminTestJSON-480836593 None] Lock "cinder-quobyte-4bb58a23-4417-4a52-b6d0-3416b9758088" acquired by "delete_volume" :: waited 0.035s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:20:34 devstack sudo[94290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a3efde48-babd-4b04-b205-71cd843dec16_6ezi9phydevstack@QuobyteHD Jul 22 03:20:34 devstack sudo[94290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:20:34 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ec18b49-7699-4b5d-8088-7ecbad932793]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:20:34 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-a6146e38-b098-486a-b439-2495282500ae tempest-VolumeQuotasAdminTestJSON-480836593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4bb58a23-4417-4a52-b6d0-3416b9758088 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:20:34 devstack sudo[94292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4bb58a23-4417-4a52-b6d0-3416b9758088 Jul 22 03:20:34 devstack sudo[94292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:20:35 devstack sudo[94290]: pam_unix(sudo:session): session closed for user root Jul 22 03:20:35 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-32b25ea6-867a-4c8e-913c-ec86c5261906 tempest-TestShelveInstance-1884963064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a3efde48-babd-4b04-b205-71cd843dec16_6ezi9phydevstack@QuobyteHD" returned: 0 in 0.546s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:20:35 devstack cinder-volume[87747]: DEBUG cinder.image.image_utils [None req-32b25ea6-867a-4c8e-913c-ec86c5261906 tempest-TestShelveInstance-1884963064 None] a3efde48-babd-4b04-b205-71cd843dec16 was qcow2, converting to qcow2 {{(pid=87747) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 22 03:20:35 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-32b25ea6-867a-4c8e-913c-ec86c5261906 tempest-TestShelveInstance-1884963064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a3efde48-babd-4b04-b205-71cd843dec16_6ezi9phydevstack@QuobyteHD /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-76f8ddaa-d64c-4017-b69f-ca776a2c2e07 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:20:35 devstack sudo[94298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a3efde48-babd-4b04-b205-71cd843dec16_6ezi9phydevstack@QuobyteHD /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-76f8ddaa-d64c-4017-b69f-ca776a2c2e07 Jul 22 03:20:35 devstack sudo[94298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:20:35 devstack sudo[94292]: pam_unix(sudo:session): session closed for user root Jul 22 03:20:35 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-a6146e38-b098-486a-b439-2495282500ae tempest-VolumeQuotasAdminTestJSON-480836593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4bb58a23-4417-4a52-b6d0-3416b9758088" returned: 0 in 0.620s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:20:35 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-a6146e38-b098-486a-b439-2495282500ae tempest-VolumeQuotasAdminTestJSON-480836593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4bb58a23-4417-4a52-b6d0-3416b9758088 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:20:35 devstack sudo[94306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4bb58a23-4417-4a52-b6d0-3416b9758088 Jul 22 03:20:35 devstack sudo[94306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:20:35 devstack sudo[94306]: pam_unix(sudo:session): session closed for user root Jul 22 03:20:35 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-a6146e38-b098-486a-b439-2495282500ae tempest-VolumeQuotasAdminTestJSON-480836593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4bb58a23-4417-4a52-b6d0-3416b9758088" returned: 0 in 0.320s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:20:35 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-a6146e38-b098-486a-b439-2495282500ae tempest-VolumeQuotasAdminTestJSON-480836593 None] Lock "cinder-quobyte-4bb58a23-4417-4a52-b6d0-3416b9758088" released by "delete_volume" :: held 1.049s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:20:35 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-a6146e38-b098-486a-b439-2495282500ae tempest-VolumeQuotasAdminTestJSON-480836593 None] Created reservations ['56c68446-37ce-42be-94fc-f98fbb4a6675', '29e3933f-24dc-4356-aa7e-c22107feb909', '23b24b18-3ac2-432b-b545-a7efda4e99d0', '3066c92f-4012-4292-a935-c33833c5dc32'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:20:35 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-a6146e38-b098-486a-b439-2495282500ae tempest-VolumeQuotasAdminTestJSON-480836593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:20:35 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-a6146e38-b098-486a-b439-2495282500ae tempest-VolumeQuotasAdminTestJSON-480836593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:20:35 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-a6146e38-b098-486a-b439-2495282500ae tempest-VolumeQuotasAdminTestJSON-480836593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:20:35 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-a6146e38-b098-486a-b439-2495282500ae tempest-VolumeQuotasAdminTestJSON-480836593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:20:35 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-a6146e38-b098-486a-b439-2495282500ae tempest-VolumeQuotasAdminTestJSON-480836593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:20:35 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-a6146e38-b098-486a-b439-2495282500ae tempest-VolumeQuotasAdminTestJSON-480836593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:20:35 devstack sudo[94316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:20:35 devstack sudo[94316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:20:36 devstack sudo[94316]: pam_unix(sudo:session): session closed for user root Jul 22 03:20:36 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-a6146e38-b098-486a-b439-2495282500ae tempest-VolumeQuotasAdminTestJSON-480836593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.351s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:20:36 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-a6146e38-b098-486a-b439-2495282500ae tempest-VolumeQuotasAdminTestJSON-480836593 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:20:36 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-a6146e38-b098-486a-b439-2495282500ae tempest-VolumeQuotasAdminTestJSON-480836593 None] Deleted volume successfully. Jul 22 03:20:36 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-a6146e38-b098-486a-b439-2495282500ae tempest-VolumeQuotasAdminTestJSON-480836593 None] Lock "cinder-4bb58a23-4417-4a52-b6d0-3416b9758088-delete_volume" released by "delete_volume" :: held 1.782s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:20:37 devstack sudo[94298]: pam_unix(sudo:session): session closed for user root Jul 22 03:20:37 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-32b25ea6-867a-4c8e-913c-ec86c5261906 tempest-TestShelveInstance-1884963064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a3efde48-babd-4b04-b205-71cd843dec16_6ezi9phydevstack@QuobyteHD /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-76f8ddaa-d64c-4017-b69f-ca776a2c2e07" returned: 0 in 2.598s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:20:37 devstack cinder-volume[87747]: DEBUG cinder.image.image_utils [None req-32b25ea6-867a-4c8e-913c-ec86c5261906 tempest-TestShelveInstance-1884963064 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a3efde48-babd-4b04-b205-71cd843dec16_6ezi9phydevstack@QuobyteHD, size 112.00 MB, duration 2.60 sec, destination /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-76f8ddaa-d64c-4017-b69f-ca776a2c2e07 {{(pid=87747) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 22 03:20:37 devstack cinder-volume[87747]: INFO cinder.image.image_utils [None req-32b25ea6-867a-4c8e-913c-ec86c5261906 tempest-TestShelveInstance-1884963064 None] Converted 112.00 MB image at 43.07 MB/s Jul 22 03:20:37 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-32b25ea6-867a-4c8e-913c-ec86c5261906 tempest-TestShelveInstance-1884963064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-76f8ddaa-d64c-4017-b69f-ca776a2c2e07 1G {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:20:37 devstack sudo[94321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-76f8ddaa-d64c-4017-b69f-ca776a2c2e07 1G Jul 22 03:20:37 devstack sudo[94321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:20:38 devstack sudo[94321]: pam_unix(sudo:session): session closed for user root Jul 22 03:20:38 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-32b25ea6-867a-4c8e-913c-ec86c5261906 tempest-TestShelveInstance-1884963064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-76f8ddaa-d64c-4017-b69f-ca776a2c2e07 1G" returned: 0 in 0.464s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:20:38 devstack cinder-volume[87747]: DEBUG cinder.volume.volume_utils [None req-32b25ea6-867a-4c8e-913c-ec86c5261906 tempest-TestShelveInstance-1884963064 None] Downloaded image a3efde48-babd-4b04-b205-71cd843dec16 ((None, [{'url': 'file:///opt/stack/data/glance/images/a3efde48-babd-4b04-b205-71cd843dec16', 'metadata': {}}])) to volume 76f8ddaa-d64c-4017-b69f-ca776a2c2e07 successfully. {{(pid=87747) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 22 03:20:38 devstack cinder-volume[87747]: DEBUG cinder.image.image_utils [None req-32b25ea6-867a-4c8e-913c-ec86c5261906 tempest-TestShelveInstance-1884963064 None] Temporary image a3efde48-babd-4b04-b205-71cd843dec16 for user 66f57090617c45beae183d290fbf0389 is deleted. {{(pid=87747) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 22 03:20:38 devstack cinder-volume[87747]: DEBUG cinder.volume.volume_utils [None req-32b25ea6-867a-4c8e-913c-ec86c5261906 tempest-TestShelveInstance-1884963064 None] Marking volume 76f8ddaa-d64c-4017-b69f-ca776a2c2e07 as bootable. {{(pid=87747) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 22 03:20:38 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-32b25ea6-867a-4c8e-913c-ec86c5261906 tempest-TestShelveInstance-1884963064 None] Copying metadata from image a3efde48-babd-4b04-b205-71cd843dec16 to 76f8ddaa-d64c-4017-b69f-ca776a2c2e07. {{(pid=87747) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 22 03:20:38 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-32b25ea6-867a-4c8e-913c-ec86c5261906 tempest-TestShelveInstance-1884963064 None] Creating volume glance metadata for volume 76f8ddaa-d64c-4017-b69f-ca776a2c2e07 backed by image a3efde48-babd-4b04-b205-71cd843dec16 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'a3efde48-babd-4b04-b205-71cd843dec16', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87747) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 22 03:20:38 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-32b25ea6-867a-4c8e-913c-ec86c5261906 tempest-TestShelveInstance-1884963064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89ed9b49-8060-4fc8-85f4-fb16d186bd0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76f8ddaa-d64c-4017-b69f-ca776a2c2e07', 'volume_size': 1, 'image_id': 'a3efde48-babd-4b04-b205-71cd843dec16', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a3efde48-babd-4b04-b205-71cd843dec16', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '37328413017b49c4b4fe75bae83dd2ac', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a3efde48-babd-4b04-b205-71cd843dec16', 'created_at': datetime.datetime(2026, 7, 22, 1, 8, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 22, 1, 8, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a3efde48-babd-4b04-b205-71cd843dec16/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:20:38 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-32b25ea6-867a-4c8e-913c-ec86c5261906 tempest-TestShelveInstance-1884963064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3db551d8-00ab-4d42-b982-ae25b38b3ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:20:38 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-32b25ea6-867a-4c8e-913c-ec86c5261906 tempest-TestShelveInstance-1884963064 None] Volume volume-76f8ddaa-d64c-4017-b69f-ca776a2c2e07 (76f8ddaa-d64c-4017-b69f-ca776a2c2e07): created successfully Jul 22 03:20:38 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-32b25ea6-867a-4c8e-913c-ec86c5261906 tempest-TestShelveInstance-1884963064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3db551d8-00ab-4d42-b982-ae25b38b3ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:20:38 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-32b25ea6-867a-4c8e-913c-ec86c5261906 tempest-TestShelveInstance-1884963064 None] Flow 'volume_create_manager' (ec11dcd4-73c6-4f70-9c05-3f94f53e4fe7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:20:38 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-32b25ea6-867a-4c8e-913c-ec86c5261906 tempest-TestShelveInstance-1884963064 None] Created volume successfully. Jul 22 03:20:44 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [req-370f7a50-39a9-41f4-a70c-d6f33768f6af req-f41c6185-7a72-477c-813b-03b25368856e tempest-TestShelveInstance-1884963064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:20:44 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [req-370f7a50-39a9-41f4-a70c-d6f33768f6af req-f41c6185-7a72-477c-813b-03b25368856e tempest-TestShelveInstance-1884963064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:20:44 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [req-370f7a50-39a9-41f4-a70c-d6f33768f6af req-f41c6185-7a72-477c-813b-03b25368856e tempest-TestShelveInstance-1884963064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.050s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:20:44 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [req-370f7a50-39a9-41f4-a70c-d6f33768f6af req-f41c6185-7a72-477c-813b-03b25368856e tempest-TestShelveInstance-1884963064 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f', 'name': 'volume-76f8ddaa-d64c-4017-b69f-ca776a2c2e07', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '21e11cc4-abe8-420e-b905-cf0ec00dd072', 'enforce_multipath': True} {{(pid=87747) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 22 03:20:44 devstack cinder-volume[87747]: INFO cinder.volume.manager [req-370f7a50-39a9-41f4-a70c-d6f33768f6af req-f41c6185-7a72-477c-813b-03b25368856e tempest-TestShelveInstance-1884963064 None] attachment_update completed successfully. Jul 22 03:20:45 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-98496725-cf33-46ac-8471-862248a74b92 tempest-VolumesActionsTest-1044123451 None] Acquiring lock "cinder-861a18d3-74d2-49b7-b057-ac67f6d6bea3" by "attach_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:20:45 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-98496725-cf33-46ac-8471-862248a74b92 tempest-VolumesActionsTest-1044123451 None] Lock "cinder-861a18d3-74d2-49b7-b057-ac67f6d6bea3" acquired by "attach_volume" :: waited 0.041s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:20:45 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-98496725-cf33-46ac-8471-862248a74b92 tempest-VolumesActionsTest-1044123451 None] Attaching volume 861a18d3-74d2-49b7-b057-ac67f6d6bea3 to instance e300f845-c64b-4ce5-89ed-c8b9123ebfac at mountpoint /dev/vdb on host None. Jul 22 03:20:46 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-98496725-cf33-46ac-8471-862248a74b92 tempest-VolumesActionsTest-1044123451 None] Attach volume completed successfully. Jul 22 03:20:46 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-98496725-cf33-46ac-8471-862248a74b92 tempest-VolumesActionsTest-1044123451 None] Lock "cinder-861a18d3-74d2-49b7-b057-ac67f6d6bea3" released by "attach_volume" :: held 0.244s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:20:46 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-ba3ac5b6-718b-4893-93eb-9aa7899bd18e tempest-VolumesActionsTest-1044123451 None] Acquiring lock "cinder-861a18d3-74d2-49b7-b057-ac67f6d6bea3-detach_volume" by "detach_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:20:46 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-ba3ac5b6-718b-4893-93eb-9aa7899bd18e tempest-VolumesActionsTest-1044123451 None] Lock "cinder-861a18d3-74d2-49b7-b057-ac67f6d6bea3-detach_volume" acquired by "detach_volume" :: waited 0.029s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:20:46 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-ba3ac5b6-718b-4893-93eb-9aa7899bd18e tempest-VolumesActionsTest-1044123451 None] Detaching volume 861a18d3-74d2-49b7-b057-ac67f6d6bea3 from instance e300f845-c64b-4ce5-89ed-c8b9123ebfac. Jul 22 03:20:46 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-ba3ac5b6-718b-4893-93eb-9aa7899bd18e tempest-VolumesActionsTest-1044123451 None] Detach volume completed successfully. Jul 22 03:20:46 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-ba3ac5b6-718b-4893-93eb-9aa7899bd18e tempest-VolumesActionsTest-1044123451 None] Lock "cinder-861a18d3-74d2-49b7-b057-ac67f6d6bea3-detach_volume" released by "detach_volume" :: held 0.094s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:20:49 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-53941758-973f-41d5-9ff5-30a44615af97 tempest-VolumeRetypeWithoutMigrationTest-195954978 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:20:49 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-53941758-973f-41d5-9ff5-30a44615af97 tempest-VolumeRetypeWithoutMigrationTest-195954978 None] Flow 'volume_create_manager' (8a0c05b1-c3c5-4587-b7d3-e6f45b6dd62a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:20:49 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-53941758-973f-41d5-9ff5-30a44615af97 tempest-VolumeRetypeWithoutMigrationTest-195954978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee1b2361-7cbc-43db-8dd8-7c5b2a2fbdd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:20:49 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-53941758-973f-41d5-9ff5-30a44615af97 tempest-VolumeRetypeWithoutMigrationTest-195954978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee1b2361-7cbc-43db-8dd8-7c5b2a2fbdd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:20:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1253609807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4531f1b6-ef46-4847-b2fb-be62b41de35f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56c93c22943d43ee897f1325ce604c0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:20:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:20:49Z,use_quota=True,user_id='8853b68344354e0886fb4394ebcd57da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c90dcf-8d10-4ae3-a03d-0ef06c708ecf),volume_type_id=c7c90dcf-8d10-4ae3-a03d-0ef06c708ecf)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:20:49 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-53941758-973f-41d5-9ff5-30a44615af97 tempest-VolumeRetypeWithoutMigrationTest-195954978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e8334b7-837a-4707-be68-fdb803abb924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:20:49 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-53941758-973f-41d5-9ff5-30a44615af97 tempest-VolumeRetypeWithoutMigrationTest-195954978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e8334b7-837a-4707-be68-fdb803abb924) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:20:49 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-53941758-973f-41d5-9ff5-30a44615af97 tempest-VolumeRetypeWithoutMigrationTest-195954978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb99ee16-8a97-463c-b789-7546b2a38257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:20:49 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-53941758-973f-41d5-9ff5-30a44615af97 tempest-VolumeRetypeWithoutMigrationTest-195954978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb99ee16-8a97-463c-b789-7546b2a38257) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4531f1b6-ef46-4847-b2fb-be62b41de35f', 'volume_name': 'volume-4531f1b6-ef46-4847-b2fb-be62b41de35f', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:20:49 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-53941758-973f-41d5-9ff5-30a44615af97 tempest-VolumeRetypeWithoutMigrationTest-195954978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23a7fd65-4136-4c0d-9a2a-36d3fa40ab6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:20:49 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-53941758-973f-41d5-9ff5-30a44615af97 tempest-VolumeRetypeWithoutMigrationTest-195954978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23a7fd65-4136-4c0d-9a2a-36d3fa40ab6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:20:49 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-53941758-973f-41d5-9ff5-30a44615af97 tempest-VolumeRetypeWithoutMigrationTest-195954978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5eaffd43-65a6-4647-8752-bef33d69c55a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:20:49 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-53941758-973f-41d5-9ff5-30a44615af97 tempest-VolumeRetypeWithoutMigrationTest-195954978 None] Volume 4531f1b6-ef46-4847-b2fb-be62b41de35f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4531f1b6-ef46-4847-b2fb-be62b41de35f', 'volume_size': 1} Jul 22 03:20:49 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-53941758-973f-41d5-9ff5-30a44615af97 tempest-VolumeRetypeWithoutMigrationTest-195954978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:20:49 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-53941758-973f-41d5-9ff5-30a44615af97 tempest-VolumeRetypeWithoutMigrationTest-195954978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:20:49 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-53941758-973f-41d5-9ff5-30a44615af97 tempest-VolumeRetypeWithoutMigrationTest-195954978 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:20:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1253609807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4531f1b6-ef46-4847-b2fb-be62b41de35f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56c93c22943d43ee897f1325ce604c0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:20:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:20:49Z,use_quota=True,user_id='8853b68344354e0886fb4394ebcd57da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c90dcf-8d10-4ae3-a03d-0ef06c708ecf),volume_type_id=c7c90dcf-8d10-4ae3-a03d-0ef06c708ecf)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:20:49 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-53941758-973f-41d5-9ff5-30a44615af97 tempest-VolumeRetypeWithoutMigrationTest-195954978 None] Creating volume 4531f1b6-ef46-4847-b2fb-be62b41de35f {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:20:49 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-53941758-973f-41d5-9ff5-30a44615af97 tempest-VolumeRetypeWithoutMigrationTest-195954978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:20:49 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-53941758-973f-41d5-9ff5-30a44615af97 tempest-VolumeRetypeWithoutMigrationTest-195954978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:20:49 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-53941758-973f-41d5-9ff5-30a44615af97 tempest-VolumeRetypeWithoutMigrationTest-195954978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:20:49 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-53941758-973f-41d5-9ff5-30a44615af97 tempest-VolumeRetypeWithoutMigrationTest-195954978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:20:49 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-53941758-973f-41d5-9ff5-30a44615af97 tempest-VolumeRetypeWithoutMigrationTest-195954978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:20:49 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-53941758-973f-41d5-9ff5-30a44615af97 tempest-VolumeRetypeWithoutMigrationTest-195954978 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:20:49 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-53941758-973f-41d5-9ff5-30a44615af97 tempest-VolumeRetypeWithoutMigrationTest-195954978 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:20:49 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-53941758-973f-41d5-9ff5-30a44615af97 tempest-VolumeRetypeWithoutMigrationTest-195954978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4531f1b6-ef46-4847-b2fb-be62b41de35f 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:20:49 devstack sudo[94571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4531f1b6-ef46-4847-b2fb-be62b41de35f 1073741824 Jul 22 03:20:49 devstack sudo[94571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:20:50 devstack sudo[94571]: pam_unix(sudo:session): session closed for user root Jul 22 03:20:50 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-53941758-973f-41d5-9ff5-30a44615af97 tempest-VolumeRetypeWithoutMigrationTest-195954978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4531f1b6-ef46-4847-b2fb-be62b41de35f 1073741824" returned: 0 in 1.015s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:20:50 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-53941758-973f-41d5-9ff5-30a44615af97 tempest-VolumeRetypeWithoutMigrationTest-195954978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4531f1b6-ef46-4847-b2fb-be62b41de35f {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:20:50 devstack sudo[94923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4531f1b6-ef46-4847-b2fb-be62b41de35f Jul 22 03:20:50 devstack sudo[94923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:20:51 devstack sudo[94923]: pam_unix(sudo:session): session closed for user root Jul 22 03:20:51 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-53941758-973f-41d5-9ff5-30a44615af97 tempest-VolumeRetypeWithoutMigrationTest-195954978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4531f1b6-ef46-4847-b2fb-be62b41de35f" returned: 0 in 0.480s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:20:51 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-53941758-973f-41d5-9ff5-30a44615af97 tempest-VolumeRetypeWithoutMigrationTest-195954978 None] <== create_volume: return (1595ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:20:51 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-53941758-973f-41d5-9ff5-30a44615af97 tempest-VolumeRetypeWithoutMigrationTest-195954978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.602s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:20:51 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-53941758-973f-41d5-9ff5-30a44615af97 tempest-VolumeRetypeWithoutMigrationTest-195954978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5eaffd43-65a6-4647-8752-bef33d69c55a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4531f1b6-ef46-4847-b2fb-be62b41de35f', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:20:51 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-53941758-973f-41d5-9ff5-30a44615af97 tempest-VolumeRetypeWithoutMigrationTest-195954978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8cd75f5-4e9d-42ef-8878-72d339b06a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:20:51 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-53941758-973f-41d5-9ff5-30a44615af97 tempest-VolumeRetypeWithoutMigrationTest-195954978 None] Volume volume-4531f1b6-ef46-4847-b2fb-be62b41de35f (4531f1b6-ef46-4847-b2fb-be62b41de35f): created successfully Jul 22 03:20:51 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-53941758-973f-41d5-9ff5-30a44615af97 tempest-VolumeRetypeWithoutMigrationTest-195954978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8cd75f5-4e9d-42ef-8878-72d339b06a17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:20:51 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-53941758-973f-41d5-9ff5-30a44615af97 tempest-VolumeRetypeWithoutMigrationTest-195954978 None] Flow 'volume_create_manager' (8a0c05b1-c3c5-4587-b7d3-e6f45b6dd62a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:20:51 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-53941758-973f-41d5-9ff5-30a44615af97 tempest-VolumeRetypeWithoutMigrationTest-195954978 None] Created volume successfully. Jul 22 03:20:52 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-40372ca8-cb63-4908-b487-5ec74f65019d tempest-VolumeRetypeWithoutMigrationTest-195954978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:20:52 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-40372ca8-cb63-4908-b487-5ec74f65019d tempest-VolumeRetypeWithoutMigrationTest-195954978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:20:52 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-40372ca8-cb63-4908-b487-5ec74f65019d tempest-VolumeRetypeWithoutMigrationTest-195954978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:20:52 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-40372ca8-cb63-4908-b487-5ec74f65019d tempest-VolumeRetypeWithoutMigrationTest-195954978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:20:52 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-40372ca8-cb63-4908-b487-5ec74f65019d tempest-VolumeRetypeWithoutMigrationTest-195954978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:20:52 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-40372ca8-cb63-4908-b487-5ec74f65019d tempest-VolumeRetypeWithoutMigrationTest-195954978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:20:52 devstack sudo[94985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:20:52 devstack sudo[94985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:20:53 devstack sudo[94985]: pam_unix(sudo:session): session closed for user root Jul 22 03:20:53 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-40372ca8-cb63-4908-b487-5ec74f65019d tempest-VolumeRetypeWithoutMigrationTest-195954978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.750s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:20:53 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-40372ca8-cb63-4908-b487-5ec74f65019d tempest-VolumeRetypeWithoutMigrationTest-195954978 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:20:53 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-40372ca8-cb63-4908-b487-5ec74f65019d tempest-VolumeRetypeWithoutMigrationTest-195954978 None] Retype volume completed successfully. Jul 22 03:20:53 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-e6cfae0a-50d0-4caa-a98d-f3ad4e8ebc4a tempest-VolumeRetypeWithoutMigrationTest-195954978 None] Acquiring lock "cinder-4531f1b6-ef46-4847-b2fb-be62b41de35f-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:20:53 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-e6cfae0a-50d0-4caa-a98d-f3ad4e8ebc4a tempest-VolumeRetypeWithoutMigrationTest-195954978 None] Lock "cinder-4531f1b6-ef46-4847-b2fb-be62b41de35f-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:20:54 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-e6cfae0a-50d0-4caa-a98d-f3ad4e8ebc4a tempest-VolumeRetypeWithoutMigrationTest-195954978 None] Acquiring lock "cinder-quobyte-4531f1b6-ef46-4847-b2fb-be62b41de35f" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:20:54 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-e6cfae0a-50d0-4caa-a98d-f3ad4e8ebc4a tempest-VolumeRetypeWithoutMigrationTest-195954978 None] Lock "cinder-quobyte-4531f1b6-ef46-4847-b2fb-be62b41de35f" acquired by "delete_volume" :: waited 0.022s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:20:54 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[50a3bad2-0b19-4f00-a47d-24d825e54344]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:20:54 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-e6cfae0a-50d0-4caa-a98d-f3ad4e8ebc4a tempest-VolumeRetypeWithoutMigrationTest-195954978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4531f1b6-ef46-4847-b2fb-be62b41de35f {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:20:54 devstack sudo[94993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4531f1b6-ef46-4847-b2fb-be62b41de35f Jul 22 03:20:54 devstack sudo[94993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:20:54 devstack sudo[94993]: pam_unix(sudo:session): session closed for user root Jul 22 03:20:54 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-e6cfae0a-50d0-4caa-a98d-f3ad4e8ebc4a tempest-VolumeRetypeWithoutMigrationTest-195954978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4531f1b6-ef46-4847-b2fb-be62b41de35f" returned: 0 in 0.612s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:20:54 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-e6cfae0a-50d0-4caa-a98d-f3ad4e8ebc4a tempest-VolumeRetypeWithoutMigrationTest-195954978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4531f1b6-ef46-4847-b2fb-be62b41de35f {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:20:54 devstack sudo[95000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4531f1b6-ef46-4847-b2fb-be62b41de35f Jul 22 03:20:54 devstack sudo[95000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:20:55 devstack sudo[95000]: pam_unix(sudo:session): session closed for user root Jul 22 03:20:55 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-e6cfae0a-50d0-4caa-a98d-f3ad4e8ebc4a tempest-VolumeRetypeWithoutMigrationTest-195954978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4531f1b6-ef46-4847-b2fb-be62b41de35f" returned: 0 in 0.634s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:20:55 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-e6cfae0a-50d0-4caa-a98d-f3ad4e8ebc4a tempest-VolumeRetypeWithoutMigrationTest-195954978 None] Lock "cinder-quobyte-4531f1b6-ef46-4847-b2fb-be62b41de35f" released by "delete_volume" :: held 1.320s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:20:55 devstack cinder-volume[87747]: WARNING cinder.quota [None req-e6cfae0a-50d0-4caa-a98d-f3ad4e8ebc4a tempest-VolumeRetypeWithoutMigrationTest-195954978 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 22 03:20:55 devstack cinder-volume[87747]: WARNING cinder.quota [None req-e6cfae0a-50d0-4caa-a98d-f3ad4e8ebc4a tempest-VolumeRetypeWithoutMigrationTest-195954978 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 22 03:20:55 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-e6cfae0a-50d0-4caa-a98d-f3ad4e8ebc4a tempest-VolumeRetypeWithoutMigrationTest-195954978 None] Created reservations ['75b3410a-3799-426b-bc10-61b074cd6aae', 'ae8b36a1-6dbf-4ae6-ad0d-a39ef383a76b', '1995bf69-0028-40c5-a7bb-95f1b479a648', '55993e6c-a6f5-4d04-8c26-1c752571193c'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:20:55 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-e6cfae0a-50d0-4caa-a98d-f3ad4e8ebc4a tempest-VolumeRetypeWithoutMigrationTest-195954978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:20:55 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-e6cfae0a-50d0-4caa-a98d-f3ad4e8ebc4a tempest-VolumeRetypeWithoutMigrationTest-195954978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:20:55 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-e6cfae0a-50d0-4caa-a98d-f3ad4e8ebc4a tempest-VolumeRetypeWithoutMigrationTest-195954978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:20:55 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-e6cfae0a-50d0-4caa-a98d-f3ad4e8ebc4a tempest-VolumeRetypeWithoutMigrationTest-195954978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:20:55 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-e6cfae0a-50d0-4caa-a98d-f3ad4e8ebc4a tempest-VolumeRetypeWithoutMigrationTest-195954978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:20:55 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-e6cfae0a-50d0-4caa-a98d-f3ad4e8ebc4a tempest-VolumeRetypeWithoutMigrationTest-195954978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:20:55 devstack sudo[95003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:20:55 devstack sudo[95003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:20:56 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-947f44a7-ef0b-4a5a-b099-33488989ea60 tempest-VolumesActionsTest-1044123451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:20:56 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-947f44a7-ef0b-4a5a-b099-33488989ea60 tempest-VolumesActionsTest-1044123451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:20:56 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[6896f6e5-2ee1-4687-879b-b291fa29d499]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:20:56 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-947f44a7-ef0b-4a5a-b099-33488989ea60 tempest-VolumesActionsTest-1044123451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-861a18d3-74d2-49b7-b057-ac67f6d6bea3 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:20:56 devstack sudo[95003]: pam_unix(sudo:session): session closed for user root Jul 22 03:20:56 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-e6cfae0a-50d0-4caa-a98d-f3ad4e8ebc4a tempest-VolumeRetypeWithoutMigrationTest-195954978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.454s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:20:56 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-e6cfae0a-50d0-4caa-a98d-f3ad4e8ebc4a tempest-VolumeRetypeWithoutMigrationTest-195954978 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:20:56 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-e6cfae0a-50d0-4caa-a98d-f3ad4e8ebc4a tempest-VolumeRetypeWithoutMigrationTest-195954978 None] Deleted volume successfully. Jul 22 03:20:56 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-e6cfae0a-50d0-4caa-a98d-f3ad4e8ebc4a tempest-VolumeRetypeWithoutMigrationTest-195954978 None] Lock "cinder-4531f1b6-ef46-4847-b2fb-be62b41de35f-delete_volume" released by "delete_volume" :: held 2.228s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:20:56 devstack sudo[95007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-861a18d3-74d2-49b7-b057-ac67f6d6bea3 Jul 22 03:20:56 devstack sudo[95007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:20:56 devstack sudo[95007]: pam_unix(sudo:session): session closed for user root Jul 22 03:20:56 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-947f44a7-ef0b-4a5a-b099-33488989ea60 tempest-VolumesActionsTest-1044123451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-861a18d3-74d2-49b7-b057-ac67f6d6bea3" returned: 0 in 0.751s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:20:56 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8e71a77-d5dc-4262-9554-4ed258b5a635]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:20:56 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-947f44a7-ef0b-4a5a-b099-33488989ea60 tempest-VolumesActionsTest-1044123451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-861a18d3-74d2-49b7-b057-ac67f6d6bea3 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:20:57 devstack sudo[95012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-861a18d3-74d2-49b7-b057-ac67f6d6bea3 Jul 22 03:20:57 devstack sudo[95012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:20:57 devstack sudo[95012]: pam_unix(sudo:session): session closed for user root Jul 22 03:20:57 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-947f44a7-ef0b-4a5a-b099-33488989ea60 tempest-VolumesActionsTest-1044123451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-861a18d3-74d2-49b7-b057-ac67f6d6bea3" returned: 0 in 0.752s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:20:57 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-947f44a7-ef0b-4a5a-b099-33488989ea60 tempest-VolumesActionsTest-1044123451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-861a18d3-74d2-49b7-b057-ac67f6d6bea3 /opt/stack/data/cinder/conversion/861a18d3-74d2-49b7-b057-ac67f6d6bea3.temp_image.3cd932b3-df59-43d8-a409-a31773bfd3437wie6tyy.img {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:20:57 devstack sudo[95017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-861a18d3-74d2-49b7-b057-ac67f6d6bea3 /opt/stack/data/cinder/conversion/861a18d3-74d2-49b7-b057-ac67f6d6bea3.temp_image.3cd932b3-df59-43d8-a409-a31773bfd3437wie6tyy.img Jul 22 03:20:57 devstack sudo[95017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:21:05 devstack cinder-volume[87747]: DEBUG dbcounter [-] [87747] Writing DB stats cinder:SELECT=62,cinder:UPDATE=54,cinder:INSERT=15,cinder:DELETE=2 {{(pid=87747) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 03:21:06 devstack cinder-volume[87747]: DEBUG dbcounter [-] [87747] Writing DB stats cinder:UPDATE=45,cinder:SELECT=54,cinder:INSERT=18,cinder:DELETE=5 {{(pid=87747) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 03:21:07 devstack sudo[95017]: pam_unix(sudo:session): session closed for user root Jul 22 03:21:07 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-947f44a7-ef0b-4a5a-b099-33488989ea60 tempest-VolumesActionsTest-1044123451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-861a18d3-74d2-49b7-b057-ac67f6d6bea3 /opt/stack/data/cinder/conversion/861a18d3-74d2-49b7-b057-ac67f6d6bea3.temp_image.3cd932b3-df59-43d8-a409-a31773bfd3437wie6tyy.img" returned: 0 in 9.584s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:21:07 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[351acb11-7287-4454-bccc-b967fe8174ba]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:21:07 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-947f44a7-ef0b-4a5a-b099-33488989ea60 tempest-VolumesActionsTest-1044123451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-861a18d3-74d2-49b7-b057-ac67f6d6bea3 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:21:07 devstack sudo[95037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-861a18d3-74d2-49b7-b057-ac67f6d6bea3 Jul 22 03:21:07 devstack sudo[95037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:21:08 devstack sudo[95037]: pam_unix(sudo:session): session closed for user root Jul 22 03:21:08 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-947f44a7-ef0b-4a5a-b099-33488989ea60 tempest-VolumesActionsTest-1044123451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-861a18d3-74d2-49b7-b057-ac67f6d6bea3" returned: 0 in 0.882s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:21:08 devstack cinder-volume[87747]: DEBUG cinder.image.image_utils [None req-947f44a7-ef0b-4a5a-b099-33488989ea60 tempest-VolumesActionsTest-1044123451 None] Image conversion details: src /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-861a18d3-74d2-49b7-b057-ac67f6d6bea3, size 1024.00 MB, duration 9.59 sec, destination /opt/stack/data/cinder/conversion/861a18d3-74d2-49b7-b057-ac67f6d6bea3.temp_image.3cd932b3-df59-43d8-a409-a31773bfd3437wie6tyy.img {{(pid=87747) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 22 03:21:08 devstack cinder-volume[87747]: INFO cinder.image.image_utils [None req-947f44a7-ef0b-4a5a-b099-33488989ea60 tempest-VolumesActionsTest-1044123451 None] Converted 1024.00 MB image at 106.78 MB/s Jul 22 03:21:08 devstack cinder-volume[87747]: DEBUG cinder.image.image_utils [None req-947f44a7-ef0b-4a5a-b099-33488989ea60 tempest-VolumesActionsTest-1044123451 None] 3cd932b3-df59-43d8-a409-a31773bfd343 was raw, no need to convert to raw {{(pid=87747) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 22 03:21:18 devstack cinder-volume[87747]: DEBUG dbcounter [-] [87747] Writing DB stats cinder:SELECT=1 {{(pid=87747) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 03:21:18 devstack cinder-volume[87747]: DEBUG dbcounter [-] [87747] Writing DB stats cinder:SELECT=1 {{(pid=87747) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 03:21:18 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-e545d121-d4f2-4b17-9e21-690d68332e95 tempest-VolumesListAdminTestJSON-1035312698 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:21:18 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-e545d121-d4f2-4b17-9e21-690d68332e95 tempest-VolumesListAdminTestJSON-1035312698 None] Flow 'volume_create_manager' (c2ea6aae-3ba6-473e-9bb5-91def04c4062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:21:18 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-e545d121-d4f2-4b17-9e21-690d68332e95 tempest-VolumesListAdminTestJSON-1035312698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbc5855b-e96c-441b-b19a-6d02cbe06117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:21:18 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-e545d121-d4f2-4b17-9e21-690d68332e95 tempest-VolumesListAdminTestJSON-1035312698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbc5855b-e96c-441b-b19a-6d02cbe06117) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:21:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2098439395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c8a72de-bfb9-4b2a-b5a6-829e9499bebe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='700ec071b0ed408c8307ca7aabc5a473',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:21:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:21:19Z,use_quota=True,user_id='6886a6e3aa5a46d285b0639eaf474984',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:21:18 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-e545d121-d4f2-4b17-9e21-690d68332e95 tempest-VolumesListAdminTestJSON-1035312698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36f648da-1969-453b-b417-a62b10df406e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:21:18 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-e545d121-d4f2-4b17-9e21-690d68332e95 tempest-VolumesListAdminTestJSON-1035312698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36f648da-1969-453b-b417-a62b10df406e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:21:18 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-e545d121-d4f2-4b17-9e21-690d68332e95 tempest-VolumesListAdminTestJSON-1035312698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5db8dcf0-4eab-4953-9400-278840bebbca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:21:18 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-e545d121-d4f2-4b17-9e21-690d68332e95 tempest-VolumesListAdminTestJSON-1035312698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5db8dcf0-4eab-4953-9400-278840bebbca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c8a72de-bfb9-4b2a-b5a6-829e9499bebe', 'volume_name': 'volume-0c8a72de-bfb9-4b2a-b5a6-829e9499bebe', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:21:18 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-e545d121-d4f2-4b17-9e21-690d68332e95 tempest-VolumesListAdminTestJSON-1035312698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5d2fdd6-b7a8-4790-a758-777de2b732e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:21:18 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-e545d121-d4f2-4b17-9e21-690d68332e95 tempest-VolumesListAdminTestJSON-1035312698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5d2fdd6-b7a8-4790-a758-777de2b732e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:21:18 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-e545d121-d4f2-4b17-9e21-690d68332e95 tempest-VolumesListAdminTestJSON-1035312698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47b374f5-9fa5-4caf-9f75-20076e7b0913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:21:18 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-e545d121-d4f2-4b17-9e21-690d68332e95 tempest-VolumesListAdminTestJSON-1035312698 None] Volume 0c8a72de-bfb9-4b2a-b5a6-829e9499bebe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c8a72de-bfb9-4b2a-b5a6-829e9499bebe', 'volume_size': 1} Jul 22 03:21:18 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-e545d121-d4f2-4b17-9e21-690d68332e95 tempest-VolumesListAdminTestJSON-1035312698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:21:22 devstack cinder-volume[87747]: DEBUG oslo_service.periodic_task [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Running periodic task VolumeManager._thread_info {{(pid=87747) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 03:21:22 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] thread count: 28 {{(pid=87747) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 22 03:21:22 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] thread info: [<_MainThread(MainThread, started 132775275860096)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87747) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 22 03:21:22 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-f941402e-eddf-4bdf-b6ff-b418da9e814c tempest-AttachVolumeNegativeTest-443471683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:21:22 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f941402e-eddf-4bdf-b6ff-b418da9e814c tempest-AttachVolumeNegativeTest-443471683 None] Flow 'volume_create_manager' (c75ce9da-1355-479e-928e-f934606ea0c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:21:22 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f941402e-eddf-4bdf-b6ff-b418da9e814c tempest-AttachVolumeNegativeTest-443471683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10a19e60-796e-49be-a164-e17181416551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:21:22 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f941402e-eddf-4bdf-b6ff-b418da9e814c tempest-AttachVolumeNegativeTest-443471683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10a19e60-796e-49be-a164-e17181416551) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:21:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1930536897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=731543a0-29f4-4de9-9c28-aa80043cc188,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d96401bdfbf4ea0b40cc88eccd9c07f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:21:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:21:22Z,use_quota=True,user_id='3a91996b03c94127b821ad7a93a4066b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:21:22 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f941402e-eddf-4bdf-b6ff-b418da9e814c tempest-AttachVolumeNegativeTest-443471683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (941cc401-abd8-45ba-b277-07e8eb060cca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:21:22 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f941402e-eddf-4bdf-b6ff-b418da9e814c tempest-AttachVolumeNegativeTest-443471683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (941cc401-abd8-45ba-b277-07e8eb060cca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:21:22 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f941402e-eddf-4bdf-b6ff-b418da9e814c tempest-AttachVolumeNegativeTest-443471683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a91f510a-a4f0-4c1f-a136-632f7af7ac50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:21:22 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f941402e-eddf-4bdf-b6ff-b418da9e814c tempest-AttachVolumeNegativeTest-443471683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a91f510a-a4f0-4c1f-a136-632f7af7ac50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '731543a0-29f4-4de9-9c28-aa80043cc188', 'volume_name': 'volume-731543a0-29f4-4de9-9c28-aa80043cc188', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:21:22 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f941402e-eddf-4bdf-b6ff-b418da9e814c tempest-AttachVolumeNegativeTest-443471683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2eeee18-c9f4-4715-ac85-f0ce3d2148c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:21:22 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f941402e-eddf-4bdf-b6ff-b418da9e814c tempest-AttachVolumeNegativeTest-443471683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2eeee18-c9f4-4715-ac85-f0ce3d2148c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:21:22 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f941402e-eddf-4bdf-b6ff-b418da9e814c tempest-AttachVolumeNegativeTest-443471683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd6f0d78-44b6-4a4e-8aba-120b08a02339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:21:22 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-f941402e-eddf-4bdf-b6ff-b418da9e814c tempest-AttachVolumeNegativeTest-443471683 None] Volume 731543a0-29f4-4de9-9c28-aa80043cc188: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-731543a0-29f4-4de9-9c28-aa80043cc188', 'volume_size': 1} Jul 22 03:21:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-f941402e-eddf-4bdf-b6ff-b418da9e814c tempest-AttachVolumeNegativeTest-443471683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:21:25 devstack cinder-volume[87747]: INFO cinder.volume.manager [req-60df7510-e5b5-4d54-8b6c-abf5b121840e req-5add7719-9a43-4caf-b8c2-a039a4020bbc tempest-TestShelveInstance-1884963064 None] Terminate volume connection completed successfully. Jul 22 03:21:25 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [req-60df7510-e5b5-4d54-8b6c-abf5b121840e req-5add7719-9a43-4caf-b8c2-a039a4020bbc tempest-TestShelveInstance-1884963064 None] Deleting attachment 21e11cc4-abe8-420e-b905-cf0ec00dd072. {{(pid=87747) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 22 03:21:28 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [req-7926d5b2-e7c7-4f86-b1fd-c3f6037e8bc9 req-cea9ad3f-7dc8-49b9-9ce0-bcf24fabf3f3 tempest-TestShelveInstance-1884963064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:21:31 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-947f44a7-ef0b-4a5a-b099-33488989ea60 tempest-VolumesActionsTest-1044123451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 35.085s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:21:31 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-947f44a7-ef0b-4a5a-b099-33488989ea60 tempest-VolumesActionsTest-1044123451 None] Uploaded volume to glance image-id: 3cd932b3-df59-43d8-a409-a31773bfd343. {{(pid=87747) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 22 03:21:31 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-e545d121-d4f2-4b17-9e21-690d68332e95 tempest-VolumesListAdminTestJSON-1035312698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.441s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:21:31 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-e545d121-d4f2-4b17-9e21-690d68332e95 tempest-VolumesListAdminTestJSON-1035312698 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:21:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2098439395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c8a72de-bfb9-4b2a-b5a6-829e9499bebe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='700ec071b0ed408c8307ca7aabc5a473',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:21:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:21:19Z,use_quota=True,user_id='6886a6e3aa5a46d285b0639eaf474984',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:21:31 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-e545d121-d4f2-4b17-9e21-690d68332e95 tempest-VolumesListAdminTestJSON-1035312698 None] Creating volume 0c8a72de-bfb9-4b2a-b5a6-829e9499bebe {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:21:31 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-e545d121-d4f2-4b17-9e21-690d68332e95 tempest-VolumesListAdminTestJSON-1035312698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:21:31 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-e545d121-d4f2-4b17-9e21-690d68332e95 tempest-VolumesListAdminTestJSON-1035312698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:21:31 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-e545d121-d4f2-4b17-9e21-690d68332e95 tempest-VolumesListAdminTestJSON-1035312698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:21:31 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-e545d121-d4f2-4b17-9e21-690d68332e95 tempest-VolumesListAdminTestJSON-1035312698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:21:31 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-e545d121-d4f2-4b17-9e21-690d68332e95 tempest-VolumesListAdminTestJSON-1035312698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:21:31 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-e545d121-d4f2-4b17-9e21-690d68332e95 tempest-VolumesListAdminTestJSON-1035312698 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:21:31 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-e545d121-d4f2-4b17-9e21-690d68332e95 tempest-VolumesListAdminTestJSON-1035312698 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:21:31 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-e545d121-d4f2-4b17-9e21-690d68332e95 tempest-VolumesListAdminTestJSON-1035312698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0c8a72de-bfb9-4b2a-b5a6-829e9499bebe 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:21:31 devstack sudo[95199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0c8a72de-bfb9-4b2a-b5a6-829e9499bebe 1073741824 Jul 22 03:21:31 devstack sudo[95199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:21:31 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-947f44a7-ef0b-4a5a-b099-33488989ea60 tempest-VolumesActionsTest-1044123451 None] Copy volume to image completed successfully. Jul 22 03:21:31 devstack sudo[95199]: pam_unix(sudo:session): session closed for user root Jul 22 03:21:31 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-e545d121-d4f2-4b17-9e21-690d68332e95 tempest-VolumesListAdminTestJSON-1035312698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0c8a72de-bfb9-4b2a-b5a6-829e9499bebe 1073741824" returned: 0 in 0.415s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:21:31 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-e545d121-d4f2-4b17-9e21-690d68332e95 tempest-VolumesListAdminTestJSON-1035312698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0c8a72de-bfb9-4b2a-b5a6-829e9499bebe {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:21:31 devstack sudo[95205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0c8a72de-bfb9-4b2a-b5a6-829e9499bebe Jul 22 03:21:31 devstack sudo[95205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:21:31 devstack sudo[95205]: pam_unix(sudo:session): session closed for user root Jul 22 03:21:31 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-e545d121-d4f2-4b17-9e21-690d68332e95 tempest-VolumesListAdminTestJSON-1035312698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0c8a72de-bfb9-4b2a-b5a6-829e9499bebe" returned: 0 in 0.256s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:21:31 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-e545d121-d4f2-4b17-9e21-690d68332e95 tempest-VolumesListAdminTestJSON-1035312698 None] <== create_volume: return (714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:21:31 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-e545d121-d4f2-4b17-9e21-690d68332e95 tempest-VolumesListAdminTestJSON-1035312698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.720s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:21:31 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-f941402e-eddf-4bdf-b6ff-b418da9e814c tempest-AttachVolumeNegativeTest-443471683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.333s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:21:31 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-f941402e-eddf-4bdf-b6ff-b418da9e814c tempest-AttachVolumeNegativeTest-443471683 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:21:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1930536897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=731543a0-29f4-4de9-9c28-aa80043cc188,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d96401bdfbf4ea0b40cc88eccd9c07f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:21:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:21:22Z,use_quota=True,user_id='3a91996b03c94127b821ad7a93a4066b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:21:31 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-f941402e-eddf-4bdf-b6ff-b418da9e814c tempest-AttachVolumeNegativeTest-443471683 None] Creating volume 731543a0-29f4-4de9-9c28-aa80043cc188 {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:21:31 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-f941402e-eddf-4bdf-b6ff-b418da9e814c tempest-AttachVolumeNegativeTest-443471683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:21:31 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-f941402e-eddf-4bdf-b6ff-b418da9e814c tempest-AttachVolumeNegativeTest-443471683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:21:31 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-f941402e-eddf-4bdf-b6ff-b418da9e814c tempest-AttachVolumeNegativeTest-443471683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:21:31 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-f941402e-eddf-4bdf-b6ff-b418da9e814c tempest-AttachVolumeNegativeTest-443471683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:21:31 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-f941402e-eddf-4bdf-b6ff-b418da9e814c tempest-AttachVolumeNegativeTest-443471683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:21:31 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-f941402e-eddf-4bdf-b6ff-b418da9e814c tempest-AttachVolumeNegativeTest-443471683 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:21:31 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-f941402e-eddf-4bdf-b6ff-b418da9e814c tempest-AttachVolumeNegativeTest-443471683 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:21:31 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f941402e-eddf-4bdf-b6ff-b418da9e814c tempest-AttachVolumeNegativeTest-443471683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-731543a0-29f4-4de9-9c28-aa80043cc188 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:21:31 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-e545d121-d4f2-4b17-9e21-690d68332e95 tempest-VolumesListAdminTestJSON-1035312698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47b374f5-9fa5-4caf-9f75-20076e7b0913) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c8a72de-bfb9-4b2a-b5a6-829e9499bebe', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:21:31 devstack sudo[95208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-731543a0-29f4-4de9-9c28-aa80043cc188 1073741824 Jul 22 03:21:31 devstack sudo[95208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:21:31 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-e545d121-d4f2-4b17-9e21-690d68332e95 tempest-VolumesListAdminTestJSON-1035312698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdf06f87-a92e-45cc-93ee-4b12ab44bb34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:21:31 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-e545d121-d4f2-4b17-9e21-690d68332e95 tempest-VolumesListAdminTestJSON-1035312698 None] Volume volume-0c8a72de-bfb9-4b2a-b5a6-829e9499bebe (0c8a72de-bfb9-4b2a-b5a6-829e9499bebe): created successfully Jul 22 03:21:31 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-e545d121-d4f2-4b17-9e21-690d68332e95 tempest-VolumesListAdminTestJSON-1035312698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdf06f87-a92e-45cc-93ee-4b12ab44bb34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:21:31 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-e545d121-d4f2-4b17-9e21-690d68332e95 tempest-VolumesListAdminTestJSON-1035312698 None] Flow 'volume_create_manager' (c2ea6aae-3ba6-473e-9bb5-91def04c4062) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:21:31 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-e545d121-d4f2-4b17-9e21-690d68332e95 tempest-VolumesListAdminTestJSON-1035312698 None] Created volume successfully. Jul 22 03:21:32 devstack sudo[95208]: pam_unix(sudo:session): session closed for user root Jul 22 03:21:32 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f941402e-eddf-4bdf-b6ff-b418da9e814c tempest-AttachVolumeNegativeTest-443471683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-731543a0-29f4-4de9-9c28-aa80043cc188 1073741824" returned: 0 in 0.453s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:21:32 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f941402e-eddf-4bdf-b6ff-b418da9e814c tempest-AttachVolumeNegativeTest-443471683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-731543a0-29f4-4de9-9c28-aa80043cc188 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:21:32 devstack sudo[95213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-731543a0-29f4-4de9-9c28-aa80043cc188 Jul 22 03:21:32 devstack sudo[95213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:21:32 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-ff28a27d-bc7d-422e-b1bf-e85cf988f754 tempest-VolumesActionsTest-1044123451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:21:32 devstack sudo[95213]: pam_unix(sudo:session): session closed for user root Jul 22 03:21:32 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f941402e-eddf-4bdf-b6ff-b418da9e814c tempest-AttachVolumeNegativeTest-443471683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-731543a0-29f4-4de9-9c28-aa80043cc188" returned: 0 in 0.266s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:21:32 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-f941402e-eddf-4bdf-b6ff-b418da9e814c tempest-AttachVolumeNegativeTest-443471683 None] <== create_volume: return (756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:21:32 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-f941402e-eddf-4bdf-b6ff-b418da9e814c tempest-AttachVolumeNegativeTest-443471683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.759s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:21:32 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [req-7926d5b2-e7c7-4f86-b1fd-c3f6037e8bc9 req-cea9ad3f-7dc8-49b9-9ce0-bcf24fabf3f3 tempest-TestShelveInstance-1884963064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.511s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:21:32 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [req-7926d5b2-e7c7-4f86-b1fd-c3f6037e8bc9 req-cea9ad3f-7dc8-49b9-9ce0-bcf24fabf3f3 tempest-TestShelveInstance-1884963064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:21:32 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-ff28a27d-bc7d-422e-b1bf-e85cf988f754 tempest-VolumesActionsTest-1044123451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.208s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:21:32 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f941402e-eddf-4bdf-b6ff-b418da9e814c tempest-AttachVolumeNegativeTest-443471683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd6f0d78-44b6-4a4e-8aba-120b08a02339) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-731543a0-29f4-4de9-9c28-aa80043cc188', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:21:32 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f941402e-eddf-4bdf-b6ff-b418da9e814c tempest-AttachVolumeNegativeTest-443471683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00aedc29-a114-4264-a5f4-16905d9839d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:21:32 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a0d2907-77fe-4375-8b2f-33162a73c28a]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:21:32 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ff28a27d-bc7d-422e-b1bf-e85cf988f754 tempest-VolumesActionsTest-1044123451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-861a18d3-74d2-49b7-b057-ac67f6d6bea3 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:21:32 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-f941402e-eddf-4bdf-b6ff-b418da9e814c tempest-AttachVolumeNegativeTest-443471683 None] Volume volume-731543a0-29f4-4de9-9c28-aa80043cc188 (731543a0-29f4-4de9-9c28-aa80043cc188): created successfully Jul 22 03:21:32 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f941402e-eddf-4bdf-b6ff-b418da9e814c tempest-AttachVolumeNegativeTest-443471683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00aedc29-a114-4264-a5f4-16905d9839d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:21:32 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f941402e-eddf-4bdf-b6ff-b418da9e814c tempest-AttachVolumeNegativeTest-443471683 None] Flow 'volume_create_manager' (c75ce9da-1355-479e-928e-f934606ea0c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:21:32 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-f941402e-eddf-4bdf-b6ff-b418da9e814c tempest-AttachVolumeNegativeTest-443471683 None] Created volume successfully. Jul 22 03:21:32 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [req-7926d5b2-e7c7-4f86-b1fd-c3f6037e8bc9 req-cea9ad3f-7dc8-49b9-9ce0-bcf24fabf3f3 tempest-TestShelveInstance-1884963064 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f', 'name': 'volume-76f8ddaa-d64c-4017-b69f-ca776a2c2e07', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b5ca2a74-d142-4881-887c-438a872058a4', 'enforce_multipath': True} {{(pid=87747) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 22 03:21:32 devstack sudo[95216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-861a18d3-74d2-49b7-b057-ac67f6d6bea3 Jul 22 03:21:32 devstack sudo[95216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:21:32 devstack cinder-volume[87747]: INFO cinder.volume.manager [req-7926d5b2-e7c7-4f86-b1fd-c3f6037e8bc9 req-cea9ad3f-7dc8-49b9-9ce0-bcf24fabf3f3 tempest-TestShelveInstance-1884963064 None] attachment_update completed successfully. Jul 22 03:21:33 devstack sudo[95216]: pam_unix(sudo:session): session closed for user root Jul 22 03:21:33 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ff28a27d-bc7d-422e-b1bf-e85cf988f754 tempest-VolumesActionsTest-1044123451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-861a18d3-74d2-49b7-b057-ac67f6d6bea3" returned: 0 in 0.506s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:21:33 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3a4c673-0512-485b-9c28-e6cc2f9864fb]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:21:33 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ff28a27d-bc7d-422e-b1bf-e85cf988f754 tempest-VolumesActionsTest-1044123451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-861a18d3-74d2-49b7-b057-ac67f6d6bea3 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:21:33 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-de094386-9e8a-4174-8873-a7bab15d86db tempest-VolumesListAdminTestJSON-1035312698 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:21:33 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-de094386-9e8a-4174-8873-a7bab15d86db tempest-VolumesListAdminTestJSON-1035312698 None] Flow 'volume_create_manager' (399bcd7d-8cd9-4177-9238-26075a959e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:21:33 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-de094386-9e8a-4174-8873-a7bab15d86db tempest-VolumesListAdminTestJSON-1035312698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a763f675-7e80-49d2-ad0c-931576bb9175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:21:33 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-de094386-9e8a-4174-8873-a7bab15d86db tempest-VolumesListAdminTestJSON-1035312698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a763f675-7e80-49d2-ad0c-931576bb9175) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:21:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1734890109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97e1220d-93cf-4563-9c0e-d3406a15e6a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='700ec071b0ed408c8307ca7aabc5a473',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:21:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:21:33Z,use_quota=True,user_id='6886a6e3aa5a46d285b0639eaf474984',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:21:33 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-de094386-9e8a-4174-8873-a7bab15d86db tempest-VolumesListAdminTestJSON-1035312698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be2f03d4-22ee-4ed3-b3b1-34e55aaf57f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:21:33 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-de094386-9e8a-4174-8873-a7bab15d86db tempest-VolumesListAdminTestJSON-1035312698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be2f03d4-22ee-4ed3-b3b1-34e55aaf57f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:21:33 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-de094386-9e8a-4174-8873-a7bab15d86db tempest-VolumesListAdminTestJSON-1035312698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94ab550c-9a15-4f0b-aac4-d5ed835bce14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:21:33 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-de094386-9e8a-4174-8873-a7bab15d86db tempest-VolumesListAdminTestJSON-1035312698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94ab550c-9a15-4f0b-aac4-d5ed835bce14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97e1220d-93cf-4563-9c0e-d3406a15e6a7', 'volume_name': 'volume-97e1220d-93cf-4563-9c0e-d3406a15e6a7', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:21:33 devstack sudo[95222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-861a18d3-74d2-49b7-b057-ac67f6d6bea3 Jul 22 03:21:33 devstack sudo[95222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:21:33 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-de094386-9e8a-4174-8873-a7bab15d86db tempest-VolumesListAdminTestJSON-1035312698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48d1c1e5-e49c-48c8-bcd0-31f265094345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:21:33 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-de094386-9e8a-4174-8873-a7bab15d86db tempest-VolumesListAdminTestJSON-1035312698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48d1c1e5-e49c-48c8-bcd0-31f265094345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:21:33 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-de094386-9e8a-4174-8873-a7bab15d86db tempest-VolumesListAdminTestJSON-1035312698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f2368cf-8ee1-490c-a7bd-6ff1d7dbd326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:21:33 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-de094386-9e8a-4174-8873-a7bab15d86db tempest-VolumesListAdminTestJSON-1035312698 None] Volume 97e1220d-93cf-4563-9c0e-d3406a15e6a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97e1220d-93cf-4563-9c0e-d3406a15e6a7', 'volume_size': 1} Jul 22 03:21:33 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-de094386-9e8a-4174-8873-a7bab15d86db tempest-VolumesListAdminTestJSON-1035312698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:21:33 devstack sudo[95222]: pam_unix(sudo:session): session closed for user root Jul 22 03:21:33 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ff28a27d-bc7d-422e-b1bf-e85cf988f754 tempest-VolumesActionsTest-1044123451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-861a18d3-74d2-49b7-b057-ac67f6d6bea3" returned: 0 in 0.407s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:21:33 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ff28a27d-bc7d-422e-b1bf-e85cf988f754 tempest-VolumesActionsTest-1044123451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-861a18d3-74d2-49b7-b057-ac67f6d6bea3 /opt/stack/data/cinder/conversion/861a18d3-74d2-49b7-b057-ac67f6d6bea3.temp_image.1919b503-8658-4767-958d-5a29c002e4d6_4exuur4.img {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:21:33 devstack sudo[95229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-861a18d3-74d2-49b7-b057-ac67f6d6bea3 /opt/stack/data/cinder/conversion/861a18d3-74d2-49b7-b057-ac67f6d6bea3.temp_image.1919b503-8658-4767-958d-5a29c002e4d6_4exuur4.img Jul 22 03:21:33 devstack sudo[95229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:21:35 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [req-2a0e3ed3-bf89-488f-88f3-668d9cb903f1 req-c21b8667-3540-42d7-9562-c2d50b75a76f tempest-AttachVolumeNegativeTest-443471683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:21:39 devstack sudo[95229]: pam_unix(sudo:session): session closed for user root Jul 22 03:21:39 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ff28a27d-bc7d-422e-b1bf-e85cf988f754 tempest-VolumesActionsTest-1044123451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-861a18d3-74d2-49b7-b057-ac67f6d6bea3 /opt/stack/data/cinder/conversion/861a18d3-74d2-49b7-b057-ac67f6d6bea3.temp_image.1919b503-8658-4767-958d-5a29c002e4d6_4exuur4.img" returned: 0 in 6.000s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:21:39 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[776b1bf1-ffaa-4174-a14d-174bdfd101c8]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:21:39 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ff28a27d-bc7d-422e-b1bf-e85cf988f754 tempest-VolumesActionsTest-1044123451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-861a18d3-74d2-49b7-b057-ac67f6d6bea3 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:21:39 devstack sudo[95666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-861a18d3-74d2-49b7-b057-ac67f6d6bea3 Jul 22 03:21:39 devstack sudo[95666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:21:40 devstack sudo[95666]: pam_unix(sudo:session): session closed for user root Jul 22 03:21:40 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ff28a27d-bc7d-422e-b1bf-e85cf988f754 tempest-VolumesActionsTest-1044123451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-861a18d3-74d2-49b7-b057-ac67f6d6bea3" returned: 0 in 0.989s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:21:40 devstack cinder-volume[87747]: DEBUG cinder.image.image_utils [None req-ff28a27d-bc7d-422e-b1bf-e85cf988f754 tempest-VolumesActionsTest-1044123451 None] Image conversion details: src /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-861a18d3-74d2-49b7-b057-ac67f6d6bea3, size 1024.00 MB, duration 6.00 sec, destination /opt/stack/data/cinder/conversion/861a18d3-74d2-49b7-b057-ac67f6d6bea3.temp_image.1919b503-8658-4767-958d-5a29c002e4d6_4exuur4.img {{(pid=87747) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 22 03:21:40 devstack cinder-volume[87747]: INFO cinder.image.image_utils [None req-ff28a27d-bc7d-422e-b1bf-e85cf988f754 tempest-VolumesActionsTest-1044123451 None] Converted 1024.00 MB image at 170.57 MB/s Jul 22 03:21:40 devstack cinder-volume[87747]: DEBUG cinder.image.image_utils [None req-ff28a27d-bc7d-422e-b1bf-e85cf988f754 tempest-VolumesActionsTest-1044123451 None] 1919b503-8658-4767-958d-5a29c002e4d6 was raw, converting to qcow2 {{(pid=87747) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 22 03:21:40 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1152b9f-007d-4a16-aee6-e2f2d233e82a]: (4, 'raw') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:21:40 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ff28a27d-bc7d-422e-b1bf-e85cf988f754 tempest-VolumesActionsTest-1044123451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/861a18d3-74d2-49b7-b057-ac67f6d6bea3.temp_image.1919b503-8658-4767-958d-5a29c002e4d6_4exuur4.img {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:21:40 devstack sudo[95708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/861a18d3-74d2-49b7-b057-ac67f6d6bea3.temp_image.1919b503-8658-4767-958d-5a29c002e4d6_4exuur4.img Jul 22 03:21:40 devstack sudo[95708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:21:41 devstack sudo[95708]: pam_unix(sudo:session): session closed for user root Jul 22 03:21:41 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ff28a27d-bc7d-422e-b1bf-e85cf988f754 tempest-VolumesActionsTest-1044123451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/861a18d3-74d2-49b7-b057-ac67f6d6bea3.temp_image.1919b503-8658-4767-958d-5a29c002e4d6_4exuur4.img" returned: 0 in 0.434s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:21:41 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ff28a27d-bc7d-422e-b1bf-e85cf988f754 tempest-VolumesActionsTest-1044123451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/861a18d3-74d2-49b7-b057-ac67f6d6bea3.temp_image.1919b503-8658-4767-958d-5a29c002e4d6_4exuur4.img {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:21:41 devstack sudo[95712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/861a18d3-74d2-49b7-b057-ac67f6d6bea3.temp_image.1919b503-8658-4767-958d-5a29c002e4d6_4exuur4.img Jul 22 03:21:41 devstack sudo[95712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:21:41 devstack sudo[95712]: pam_unix(sudo:session): session closed for user root Jul 22 03:21:41 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ff28a27d-bc7d-422e-b1bf-e85cf988f754 tempest-VolumesActionsTest-1044123451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/861a18d3-74d2-49b7-b057-ac67f6d6bea3.temp_image.1919b503-8658-4767-958d-5a29c002e4d6_4exuur4.img" returned: 1 in 0.420s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:21:41 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ff28a27d-bc7d-422e-b1bf-e85cf988f754 tempest-VolumesActionsTest-1044123451 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/861a18d3-74d2-49b7-b057-ac67f6d6bea3.temp_image.1919b503-8658-4767-958d-5a29c002e4d6_4exuur4.img' failed. Not Retrying. {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 22 03:21:41 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ff28a27d-bc7d-422e-b1bf-e85cf988f754 tempest-VolumesActionsTest-1044123451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/861a18d3-74d2-49b7-b057-ac67f6d6bea3.temp_image.1919b503-8658-4767-958d-5a29c002e4d6_4exuur4.img /opt/stack/data/cinder/conversion/vol_upload_zj_q0pm0 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:21:41 devstack sudo[95719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/861a18d3-74d2-49b7-b057-ac67f6d6bea3.temp_image.1919b503-8658-4767-958d-5a29c002e4d6_4exuur4.img /opt/stack/data/cinder/conversion/vol_upload_zj_q0pm0 Jul 22 03:21:41 devstack sudo[95719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:21:41 devstack sudo[95719]: pam_unix(sudo:session): session closed for user root Jul 22 03:21:41 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ff28a27d-bc7d-422e-b1bf-e85cf988f754 tempest-VolumesActionsTest-1044123451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/861a18d3-74d2-49b7-b057-ac67f6d6bea3.temp_image.1919b503-8658-4767-958d-5a29c002e4d6_4exuur4.img /opt/stack/data/cinder/conversion/vol_upload_zj_q0pm0" returned: 0 in 0.273s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:21:41 devstack cinder-volume[87747]: DEBUG cinder.image.image_utils [None req-ff28a27d-bc7d-422e-b1bf-e85cf988f754 tempest-VolumesActionsTest-1044123451 None] Image conversion details: src /opt/stack/data/cinder/conversion/861a18d3-74d2-49b7-b057-ac67f6d6bea3.temp_image.1919b503-8658-4767-958d-5a29c002e4d6_4exuur4.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_zj_q0pm0 {{(pid=87747) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 22 03:21:41 devstack cinder-volume[87747]: INFO cinder.image.image_utils [None req-ff28a27d-bc7d-422e-b1bf-e85cf988f754 tempest-VolumesActionsTest-1044123451 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 22 03:21:41 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[d451c1fe-5480-45c5-9e97-b1b43187bcfe]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:21:41 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ff28a27d-bc7d-422e-b1bf-e85cf988f754 tempest-VolumesActionsTest-1044123451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_zj_q0pm0 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:21:41 devstack sudo[95724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_zj_q0pm0 Jul 22 03:21:41 devstack sudo[95724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:21:42 devstack sudo[95724]: pam_unix(sudo:session): session closed for user root Jul 22 03:21:42 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ff28a27d-bc7d-422e-b1bf-e85cf988f754 tempest-VolumesActionsTest-1044123451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_zj_q0pm0" returned: 0 in 0.368s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:21:43 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-ff28a27d-bc7d-422e-b1bf-e85cf988f754 tempest-VolumesActionsTest-1044123451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 11.017s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:21:43 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-ff28a27d-bc7d-422e-b1bf-e85cf988f754 tempest-VolumesActionsTest-1044123451 None] Uploaded volume to glance image-id: 1919b503-8658-4767-958d-5a29c002e4d6. {{(pid=87747) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 22 03:21:43 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-de094386-9e8a-4174-8873-a7bab15d86db tempest-VolumesListAdminTestJSON-1035312698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.323s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:21:43 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-de094386-9e8a-4174-8873-a7bab15d86db tempest-VolumesListAdminTestJSON-1035312698 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:21:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1734890109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97e1220d-93cf-4563-9c0e-d3406a15e6a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='700ec071b0ed408c8307ca7aabc5a473',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:21:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:21:33Z,use_quota=True,user_id='6886a6e3aa5a46d285b0639eaf474984',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:21:43 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-de094386-9e8a-4174-8873-a7bab15d86db tempest-VolumesListAdminTestJSON-1035312698 None] Creating volume 97e1220d-93cf-4563-9c0e-d3406a15e6a7 {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:21:43 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-de094386-9e8a-4174-8873-a7bab15d86db tempest-VolumesListAdminTestJSON-1035312698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:21:43 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-de094386-9e8a-4174-8873-a7bab15d86db tempest-VolumesListAdminTestJSON-1035312698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:21:43 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-de094386-9e8a-4174-8873-a7bab15d86db tempest-VolumesListAdminTestJSON-1035312698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:21:43 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-de094386-9e8a-4174-8873-a7bab15d86db tempest-VolumesListAdminTestJSON-1035312698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:21:43 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-de094386-9e8a-4174-8873-a7bab15d86db tempest-VolumesListAdminTestJSON-1035312698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:21:43 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-de094386-9e8a-4174-8873-a7bab15d86db tempest-VolumesListAdminTestJSON-1035312698 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:21:43 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-de094386-9e8a-4174-8873-a7bab15d86db tempest-VolumesListAdminTestJSON-1035312698 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:21:43 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-de094386-9e8a-4174-8873-a7bab15d86db tempest-VolumesListAdminTestJSON-1035312698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-97e1220d-93cf-4563-9c0e-d3406a15e6a7 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:21:43 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-ff28a27d-bc7d-422e-b1bf-e85cf988f754 tempest-VolumesActionsTest-1044123451 None] Copy volume to image completed successfully. Jul 22 03:21:43 devstack sudo[95730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-97e1220d-93cf-4563-9c0e-d3406a15e6a7 1073741824 Jul 22 03:21:43 devstack sudo[95730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:21:44 devstack sudo[95730]: pam_unix(sudo:session): session closed for user root Jul 22 03:21:44 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-de094386-9e8a-4174-8873-a7bab15d86db tempest-VolumesListAdminTestJSON-1035312698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-97e1220d-93cf-4563-9c0e-d3406a15e6a7 1073741824" returned: 0 in 0.466s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:21:44 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-de094386-9e8a-4174-8873-a7bab15d86db tempest-VolumesListAdminTestJSON-1035312698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-97e1220d-93cf-4563-9c0e-d3406a15e6a7 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:21:44 devstack sudo[95735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-97e1220d-93cf-4563-9c0e-d3406a15e6a7 Jul 22 03:21:44 devstack sudo[95735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:21:44 devstack sudo[95735]: pam_unix(sudo:session): session closed for user root Jul 22 03:21:44 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-de094386-9e8a-4174-8873-a7bab15d86db tempest-VolumesListAdminTestJSON-1035312698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-97e1220d-93cf-4563-9c0e-d3406a15e6a7" returned: 0 in 0.292s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:21:44 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-de094386-9e8a-4174-8873-a7bab15d86db tempest-VolumesListAdminTestJSON-1035312698 None] <== create_volume: return (813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:21:44 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-de094386-9e8a-4174-8873-a7bab15d86db tempest-VolumesListAdminTestJSON-1035312698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.817s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:21:44 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [req-2a0e3ed3-bf89-488f-88f3-668d9cb903f1 req-c21b8667-3540-42d7-9562-c2d50b75a76f tempest-AttachVolumeNegativeTest-443471683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 9.273s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:21:44 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [req-2a0e3ed3-bf89-488f-88f3-668d9cb903f1 req-c21b8667-3540-42d7-9562-c2d50b75a76f tempest-AttachVolumeNegativeTest-443471683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:21:44 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-de094386-9e8a-4174-8873-a7bab15d86db tempest-VolumesListAdminTestJSON-1035312698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f2368cf-8ee1-490c-a7bd-6ff1d7dbd326) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97e1220d-93cf-4563-9c0e-d3406a15e6a7', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:21:44 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-de094386-9e8a-4174-8873-a7bab15d86db tempest-VolumesListAdminTestJSON-1035312698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d456911b-3fa6-4398-9b6b-e7045dfa8684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:21:44 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-de094386-9e8a-4174-8873-a7bab15d86db tempest-VolumesListAdminTestJSON-1035312698 None] Volume volume-97e1220d-93cf-4563-9c0e-d3406a15e6a7 (97e1220d-93cf-4563-9c0e-d3406a15e6a7): created successfully Jul 22 03:21:44 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-de094386-9e8a-4174-8873-a7bab15d86db tempest-VolumesListAdminTestJSON-1035312698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d456911b-3fa6-4398-9b6b-e7045dfa8684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:21:44 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-de094386-9e8a-4174-8873-a7bab15d86db tempest-VolumesListAdminTestJSON-1035312698 None] Flow 'volume_create_manager' (399bcd7d-8cd9-4177-9238-26075a959e83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:21:44 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-de094386-9e8a-4174-8873-a7bab15d86db tempest-VolumesListAdminTestJSON-1035312698 None] Created volume successfully. Jul 22 03:21:44 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [req-2a0e3ed3-bf89-488f-88f3-668d9cb903f1 req-c21b8667-3540-42d7-9562-c2d50b75a76f tempest-AttachVolumeNegativeTest-443471683 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f', 'name': 'volume-731543a0-29f4-4de9-9c28-aa80043cc188', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a0a16c6f-439e-43e6-bc85-0b511b9cdf97', 'enforce_multipath': True} {{(pid=87747) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 22 03:21:44 devstack cinder-volume[87747]: INFO cinder.volume.manager [req-2a0e3ed3-bf89-488f-88f3-668d9cb903f1 req-c21b8667-3540-42d7-9562-c2d50b75a76f tempest-AttachVolumeNegativeTest-443471683 None] attachment_update completed successfully. Jul 22 03:21:44 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-00cf3679-ee92-402b-9155-a9c610ddf669 tempest-VolumesActionsTest-1044123451 None] Acquiring lock "cinder-861a18d3-74d2-49b7-b057-ac67f6d6bea3-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:21:45 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-00cf3679-ee92-402b-9155-a9c610ddf669 tempest-VolumesActionsTest-1044123451 None] Lock "cinder-861a18d3-74d2-49b7-b057-ac67f6d6bea3-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:21:45 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-00cf3679-ee92-402b-9155-a9c610ddf669 tempest-VolumesActionsTest-1044123451 None] Acquiring lock "cinder-quobyte-861a18d3-74d2-49b7-b057-ac67f6d6bea3" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:21:45 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-00cf3679-ee92-402b-9155-a9c610ddf669 tempest-VolumesActionsTest-1044123451 None] Lock "cinder-quobyte-861a18d3-74d2-49b7-b057-ac67f6d6bea3" acquired by "delete_volume" :: waited 0.029s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:21:45 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac084db2-868b-4ec8-a392-8b7c574b4b59]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:21:45 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-00cf3679-ee92-402b-9155-a9c610ddf669 tempest-VolumesActionsTest-1044123451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-861a18d3-74d2-49b7-b057-ac67f6d6bea3 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:21:45 devstack sudo[95748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-861a18d3-74d2-49b7-b057-ac67f6d6bea3 Jul 22 03:21:45 devstack sudo[95748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:21:45 devstack sudo[95748]: pam_unix(sudo:session): session closed for user root Jul 22 03:21:45 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-00cf3679-ee92-402b-9155-a9c610ddf669 tempest-VolumesActionsTest-1044123451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-861a18d3-74d2-49b7-b057-ac67f6d6bea3" returned: 0 in 0.417s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:21:45 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-00cf3679-ee92-402b-9155-a9c610ddf669 tempest-VolumesActionsTest-1044123451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-861a18d3-74d2-49b7-b057-ac67f6d6bea3 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:21:45 devstack sudo[95754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-861a18d3-74d2-49b7-b057-ac67f6d6bea3 Jul 22 03:21:45 devstack sudo[95754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:21:45 devstack sudo[95754]: pam_unix(sudo:session): session closed for user root Jul 22 03:21:45 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-00cf3679-ee92-402b-9155-a9c610ddf669 tempest-VolumesActionsTest-1044123451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-861a18d3-74d2-49b7-b057-ac67f6d6bea3" returned: 0 in 0.311s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:21:45 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-00cf3679-ee92-402b-9155-a9c610ddf669 tempest-VolumesActionsTest-1044123451 None] Lock "cinder-quobyte-861a18d3-74d2-49b7-b057-ac67f6d6bea3" released by "delete_volume" :: held 0.788s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:21:45 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-00cf3679-ee92-402b-9155-a9c610ddf669 tempest-VolumesActionsTest-1044123451 None] Created reservations ['359d7db1-5431-40de-94be-5c682902557d', 'd008b087-8847-4cb6-ae38-c26ba67e2093', '87f5b5ab-84cd-45e6-8ec7-5753f21d1501', '4fd4fe75-6695-40c6-85d3-8d859efff57f'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:21:46 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-00cf3679-ee92-402b-9155-a9c610ddf669 tempest-VolumesActionsTest-1044123451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:21:46 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-00cf3679-ee92-402b-9155-a9c610ddf669 tempest-VolumesActionsTest-1044123451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:21:46 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-00cf3679-ee92-402b-9155-a9c610ddf669 tempest-VolumesActionsTest-1044123451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:21:46 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-00cf3679-ee92-402b-9155-a9c610ddf669 tempest-VolumesActionsTest-1044123451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:21:46 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-00cf3679-ee92-402b-9155-a9c610ddf669 tempest-VolumesActionsTest-1044123451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:21:46 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-00cf3679-ee92-402b-9155-a9c610ddf669 tempest-VolumesActionsTest-1044123451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:21:46 devstack sudo[95757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:21:46 devstack sudo[95757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:21:46 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-896bb8ef-98af-42f4-84fe-95b4ec5c74ba tempest-VolumesListAdminTestJSON-1035312698 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:21:46 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-896bb8ef-98af-42f4-84fe-95b4ec5c74ba tempest-VolumesListAdminTestJSON-1035312698 None] Flow 'volume_create_manager' (8c6dafb5-bd20-433e-86c0-b0bef2d22326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:21:46 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-896bb8ef-98af-42f4-84fe-95b4ec5c74ba tempest-VolumesListAdminTestJSON-1035312698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d43670af-183f-4fff-abae-1d653d98bfa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:21:46 devstack sudo[95757]: pam_unix(sudo:session): session closed for user root Jul 22 03:21:46 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-896bb8ef-98af-42f4-84fe-95b4ec5c74ba tempest-VolumesListAdminTestJSON-1035312698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d43670af-183f-4fff-abae-1d653d98bfa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:21:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1296124026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3cb4d48-e5e4-42c0-8c4e-2d721a5359c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='700ec071b0ed408c8307ca7aabc5a473',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:21:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:21:46Z,use_quota=True,user_id='6886a6e3aa5a46d285b0639eaf474984',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:21:46 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-896bb8ef-98af-42f4-84fe-95b4ec5c74ba tempest-VolumesListAdminTestJSON-1035312698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aadfe6d2-afc2-4ba8-97d5-80566de1fca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:21:46 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-896bb8ef-98af-42f4-84fe-95b4ec5c74ba tempest-VolumesListAdminTestJSON-1035312698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aadfe6d2-afc2-4ba8-97d5-80566de1fca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:21:46 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-896bb8ef-98af-42f4-84fe-95b4ec5c74ba tempest-VolumesListAdminTestJSON-1035312698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (280e79f5-fdab-4133-a14a-91a1f99665da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:21:46 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-896bb8ef-98af-42f4-84fe-95b4ec5c74ba tempest-VolumesListAdminTestJSON-1035312698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (280e79f5-fdab-4133-a14a-91a1f99665da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3cb4d48-e5e4-42c0-8c4e-2d721a5359c6', 'volume_name': 'volume-a3cb4d48-e5e4-42c0-8c4e-2d721a5359c6', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:21:46 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-896bb8ef-98af-42f4-84fe-95b4ec5c74ba tempest-VolumesListAdminTestJSON-1035312698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7950b15c-4275-4f29-804f-c887866fb3b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:21:46 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-896bb8ef-98af-42f4-84fe-95b4ec5c74ba tempest-VolumesListAdminTestJSON-1035312698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7950b15c-4275-4f29-804f-c887866fb3b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:21:46 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-896bb8ef-98af-42f4-84fe-95b4ec5c74ba tempest-VolumesListAdminTestJSON-1035312698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57ab535a-cc5c-4eee-a958-e5981929837c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:21:46 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-896bb8ef-98af-42f4-84fe-95b4ec5c74ba tempest-VolumesListAdminTestJSON-1035312698 None] Volume a3cb4d48-e5e4-42c0-8c4e-2d721a5359c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3cb4d48-e5e4-42c0-8c4e-2d721a5359c6', 'volume_size': 1} Jul 22 03:21:46 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-896bb8ef-98af-42f4-84fe-95b4ec5c74ba tempest-VolumesListAdminTestJSON-1035312698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:21:46 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-896bb8ef-98af-42f4-84fe-95b4ec5c74ba tempest-VolumesListAdminTestJSON-1035312698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:21:46 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-896bb8ef-98af-42f4-84fe-95b4ec5c74ba tempest-VolumesListAdminTestJSON-1035312698 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:21:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1296124026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3cb4d48-e5e4-42c0-8c4e-2d721a5359c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='700ec071b0ed408c8307ca7aabc5a473',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:21:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:21:46Z,use_quota=True,user_id='6886a6e3aa5a46d285b0639eaf474984',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:21:46 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-896bb8ef-98af-42f4-84fe-95b4ec5c74ba tempest-VolumesListAdminTestJSON-1035312698 None] Creating volume a3cb4d48-e5e4-42c0-8c4e-2d721a5359c6 {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:21:46 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-896bb8ef-98af-42f4-84fe-95b4ec5c74ba tempest-VolumesListAdminTestJSON-1035312698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:21:46 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-896bb8ef-98af-42f4-84fe-95b4ec5c74ba tempest-VolumesListAdminTestJSON-1035312698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:21:46 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-896bb8ef-98af-42f4-84fe-95b4ec5c74ba tempest-VolumesListAdminTestJSON-1035312698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:21:46 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-896bb8ef-98af-42f4-84fe-95b4ec5c74ba tempest-VolumesListAdminTestJSON-1035312698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:21:46 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-896bb8ef-98af-42f4-84fe-95b4ec5c74ba tempest-VolumesListAdminTestJSON-1035312698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:21:46 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-896bb8ef-98af-42f4-84fe-95b4ec5c74ba tempest-VolumesListAdminTestJSON-1035312698 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:21:46 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-896bb8ef-98af-42f4-84fe-95b4ec5c74ba tempest-VolumesListAdminTestJSON-1035312698 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:21:46 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-896bb8ef-98af-42f4-84fe-95b4ec5c74ba tempest-VolumesListAdminTestJSON-1035312698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a3cb4d48-e5e4-42c0-8c4e-2d721a5359c6 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:21:46 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-00cf3679-ee92-402b-9155-a9c610ddf669 tempest-VolumesActionsTest-1044123451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.544s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:21:46 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-00cf3679-ee92-402b-9155-a9c610ddf669 tempest-VolumesActionsTest-1044123451 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:21:46 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-00cf3679-ee92-402b-9155-a9c610ddf669 tempest-VolumesActionsTest-1044123451 None] Deleted volume successfully. Jul 22 03:21:46 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-00cf3679-ee92-402b-9155-a9c610ddf669 tempest-VolumesActionsTest-1044123451 None] Lock "cinder-861a18d3-74d2-49b7-b057-ac67f6d6bea3-delete_volume" released by "delete_volume" :: held 1.677s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:21:46 devstack sudo[95760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a3cb4d48-e5e4-42c0-8c4e-2d721a5359c6 1073741824 Jul 22 03:21:46 devstack sudo[95760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:21:47 devstack sudo[95760]: pam_unix(sudo:session): session closed for user root Jul 22 03:21:47 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-896bb8ef-98af-42f4-84fe-95b4ec5c74ba tempest-VolumesListAdminTestJSON-1035312698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a3cb4d48-e5e4-42c0-8c4e-2d721a5359c6 1073741824" returned: 0 in 0.659s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:21:47 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-896bb8ef-98af-42f4-84fe-95b4ec5c74ba tempest-VolumesListAdminTestJSON-1035312698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a3cb4d48-e5e4-42c0-8c4e-2d721a5359c6 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:21:47 devstack sudo[95766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a3cb4d48-e5e4-42c0-8c4e-2d721a5359c6 Jul 22 03:21:47 devstack sudo[95766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:21:47 devstack sudo[95766]: pam_unix(sudo:session): session closed for user root Jul 22 03:21:47 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-896bb8ef-98af-42f4-84fe-95b4ec5c74ba tempest-VolumesListAdminTestJSON-1035312698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a3cb4d48-e5e4-42c0-8c4e-2d721a5359c6" returned: 0 in 0.311s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:21:47 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-896bb8ef-98af-42f4-84fe-95b4ec5c74ba tempest-VolumesListAdminTestJSON-1035312698 None] <== create_volume: return (1050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:21:47 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-896bb8ef-98af-42f4-84fe-95b4ec5c74ba tempest-VolumesListAdminTestJSON-1035312698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.053s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:21:47 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-896bb8ef-98af-42f4-84fe-95b4ec5c74ba tempest-VolumesListAdminTestJSON-1035312698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57ab535a-cc5c-4eee-a958-e5981929837c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3cb4d48-e5e4-42c0-8c4e-2d721a5359c6', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:21:47 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-896bb8ef-98af-42f4-84fe-95b4ec5c74ba tempest-VolumesListAdminTestJSON-1035312698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52ed097a-6815-41cf-b332-8f9fdaebbbf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:21:47 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-896bb8ef-98af-42f4-84fe-95b4ec5c74ba tempest-VolumesListAdminTestJSON-1035312698 None] Volume volume-a3cb4d48-e5e4-42c0-8c4e-2d721a5359c6 (a3cb4d48-e5e4-42c0-8c4e-2d721a5359c6): created successfully Jul 22 03:21:47 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-896bb8ef-98af-42f4-84fe-95b4ec5c74ba tempest-VolumesListAdminTestJSON-1035312698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52ed097a-6815-41cf-b332-8f9fdaebbbf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:21:47 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-896bb8ef-98af-42f4-84fe-95b4ec5c74ba tempest-VolumesListAdminTestJSON-1035312698 None] Flow 'volume_create_manager' (8c6dafb5-bd20-433e-86c0-b0bef2d22326) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:21:47 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-896bb8ef-98af-42f4-84fe-95b4ec5c74ba tempest-VolumesListAdminTestJSON-1035312698 None] Created volume successfully. Jul 22 03:21:49 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-a61bc469-91c2-48f4-ae30-9291a83111db tempest-VolumesListAdminTestJSON-1085233096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:21:49 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-a61bc469-91c2-48f4-ae30-9291a83111db tempest-VolumesListAdminTestJSON-1085233096 None] Flow 'volume_create_manager' (ede6ff0a-5e8b-40e7-b114-71ab57bb2384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:21:49 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-a61bc469-91c2-48f4-ae30-9291a83111db tempest-VolumesListAdminTestJSON-1085233096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89e58ab9-a33e-4a26-a407-ca28410367b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:21:49 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-a61bc469-91c2-48f4-ae30-9291a83111db tempest-VolumesListAdminTestJSON-1085233096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89e58ab9-a33e-4a26-a407-ca28410367b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:21:49Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff0e4e45-9766-4030-a3b8-7961bb833d73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5be712daf3e462bba3387b556241509',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:21:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:21:50Z,use_quota=True,user_id='0f1cc394b6d64e2db56aa25beefbac98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:21:49 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-a61bc469-91c2-48f4-ae30-9291a83111db tempest-VolumesListAdminTestJSON-1085233096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99d8ba05-eb08-42af-bf4d-6b591ba29c95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:21:49 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-a61bc469-91c2-48f4-ae30-9291a83111db tempest-VolumesListAdminTestJSON-1085233096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99d8ba05-eb08-42af-bf4d-6b591ba29c95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:21:49 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-a61bc469-91c2-48f4-ae30-9291a83111db tempest-VolumesListAdminTestJSON-1085233096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (514a26f0-165e-420e-b6a7-595d70964e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:21:49 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-a61bc469-91c2-48f4-ae30-9291a83111db tempest-VolumesListAdminTestJSON-1085233096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (514a26f0-165e-420e-b6a7-595d70964e9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff0e4e45-9766-4030-a3b8-7961bb833d73', 'volume_name': 'volume-ff0e4e45-9766-4030-a3b8-7961bb833d73', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:21:49 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-a61bc469-91c2-48f4-ae30-9291a83111db tempest-VolumesListAdminTestJSON-1085233096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36451b68-7780-4789-912f-c8481c74af6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:21:49 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-a61bc469-91c2-48f4-ae30-9291a83111db tempest-VolumesListAdminTestJSON-1085233096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36451b68-7780-4789-912f-c8481c74af6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:21:49 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-a61bc469-91c2-48f4-ae30-9291a83111db tempest-VolumesListAdminTestJSON-1085233096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d850d220-a10a-4a9f-bd1a-8338d23c3a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:21:49 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-a61bc469-91c2-48f4-ae30-9291a83111db tempest-VolumesListAdminTestJSON-1085233096 None] Volume ff0e4e45-9766-4030-a3b8-7961bb833d73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff0e4e45-9766-4030-a3b8-7961bb833d73', 'volume_size': 1} Jul 22 03:21:49 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-a61bc469-91c2-48f4-ae30-9291a83111db tempest-VolumesListAdminTestJSON-1085233096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:21:49 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-a61bc469-91c2-48f4-ae30-9291a83111db tempest-VolumesListAdminTestJSON-1085233096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:21:49 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-a61bc469-91c2-48f4-ae30-9291a83111db tempest-VolumesListAdminTestJSON-1085233096 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:21:49Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff0e4e45-9766-4030-a3b8-7961bb833d73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5be712daf3e462bba3387b556241509',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:21:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:21:50Z,use_quota=True,user_id='0f1cc394b6d64e2db56aa25beefbac98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:21:49 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-a61bc469-91c2-48f4-ae30-9291a83111db tempest-VolumesListAdminTestJSON-1085233096 None] Creating volume ff0e4e45-9766-4030-a3b8-7961bb833d73 {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:21:49 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-a61bc469-91c2-48f4-ae30-9291a83111db tempest-VolumesListAdminTestJSON-1085233096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:21:49 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-a61bc469-91c2-48f4-ae30-9291a83111db tempest-VolumesListAdminTestJSON-1085233096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:21:49 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-a61bc469-91c2-48f4-ae30-9291a83111db tempest-VolumesListAdminTestJSON-1085233096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:21:49 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-a61bc469-91c2-48f4-ae30-9291a83111db tempest-VolumesListAdminTestJSON-1085233096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:21:49 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-a61bc469-91c2-48f4-ae30-9291a83111db tempest-VolumesListAdminTestJSON-1085233096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:21:49 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-a61bc469-91c2-48f4-ae30-9291a83111db tempest-VolumesListAdminTestJSON-1085233096 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:21:49 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-a61bc469-91c2-48f4-ae30-9291a83111db tempest-VolumesListAdminTestJSON-1085233096 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:21:49 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-a61bc469-91c2-48f4-ae30-9291a83111db tempest-VolumesListAdminTestJSON-1085233096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ff0e4e45-9766-4030-a3b8-7961bb833d73 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:21:49 devstack sudo[95770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ff0e4e45-9766-4030-a3b8-7961bb833d73 1073741824 Jul 22 03:21:49 devstack sudo[95770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:21:50 devstack sudo[95770]: pam_unix(sudo:session): session closed for user root Jul 22 03:21:50 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-a61bc469-91c2-48f4-ae30-9291a83111db tempest-VolumesListAdminTestJSON-1085233096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ff0e4e45-9766-4030-a3b8-7961bb833d73 1073741824" returned: 0 in 0.985s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:21:50 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-a61bc469-91c2-48f4-ae30-9291a83111db tempest-VolumesListAdminTestJSON-1085233096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ff0e4e45-9766-4030-a3b8-7961bb833d73 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:21:50 devstack sudo[95780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ff0e4e45-9766-4030-a3b8-7961bb833d73 Jul 22 03:21:50 devstack sudo[95780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:21:51 devstack sudo[95780]: pam_unix(sudo:session): session closed for user root Jul 22 03:21:51 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-a61bc469-91c2-48f4-ae30-9291a83111db tempest-VolumesListAdminTestJSON-1085233096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ff0e4e45-9766-4030-a3b8-7961bb833d73" returned: 0 in 0.530s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:21:51 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-a61bc469-91c2-48f4-ae30-9291a83111db tempest-VolumesListAdminTestJSON-1085233096 None] <== create_volume: return (1585ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:21:51 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-a61bc469-91c2-48f4-ae30-9291a83111db tempest-VolumesListAdminTestJSON-1085233096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.588s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:21:51 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-a61bc469-91c2-48f4-ae30-9291a83111db tempest-VolumesListAdminTestJSON-1085233096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d850d220-a10a-4a9f-bd1a-8338d23c3a2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff0e4e45-9766-4030-a3b8-7961bb833d73', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:21:51 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-a61bc469-91c2-48f4-ae30-9291a83111db tempest-VolumesListAdminTestJSON-1085233096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79b7405f-8c6a-4f32-8ae2-3cd9421cff91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:21:51 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-a61bc469-91c2-48f4-ae30-9291a83111db tempest-VolumesListAdminTestJSON-1085233096 None] Volume volume-ff0e4e45-9766-4030-a3b8-7961bb833d73 (ff0e4e45-9766-4030-a3b8-7961bb833d73): created successfully Jul 22 03:21:51 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-a61bc469-91c2-48f4-ae30-9291a83111db tempest-VolumesListAdminTestJSON-1085233096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79b7405f-8c6a-4f32-8ae2-3cd9421cff91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:21:51 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-a61bc469-91c2-48f4-ae30-9291a83111db tempest-VolumesListAdminTestJSON-1085233096 None] Flow 'volume_create_manager' (ede6ff0a-5e8b-40e7-b114-71ab57bb2384) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:21:51 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-a61bc469-91c2-48f4-ae30-9291a83111db tempest-VolumesListAdminTestJSON-1085233096 None] Created volume successfully. Jul 22 03:21:51 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-9bc3f2d0-aa97-44ca-a465-478685349192 tempest-VolumesListAdminTestJSON-1085233096 None] Acquiring lock "cinder-ff0e4e45-9766-4030-a3b8-7961bb833d73-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:21:52 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-9bc3f2d0-aa97-44ca-a465-478685349192 tempest-VolumesListAdminTestJSON-1085233096 None] Lock "cinder-ff0e4e45-9766-4030-a3b8-7961bb833d73-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:21:52 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-9bc3f2d0-aa97-44ca-a465-478685349192 tempest-VolumesListAdminTestJSON-1085233096 None] Acquiring lock "cinder-quobyte-ff0e4e45-9766-4030-a3b8-7961bb833d73" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:21:52 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-9bc3f2d0-aa97-44ca-a465-478685349192 tempest-VolumesListAdminTestJSON-1085233096 None] Lock "cinder-quobyte-ff0e4e45-9766-4030-a3b8-7961bb833d73" acquired by "delete_volume" :: waited 0.053s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:21:52 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d16f006-83b8-4eb4-8300-eab9b5ea0b0d]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:21:52 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-9bc3f2d0-aa97-44ca-a465-478685349192 tempest-VolumesListAdminTestJSON-1085233096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ff0e4e45-9766-4030-a3b8-7961bb833d73 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:21:52 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-97b9b2d0-5c72-4ea2-a8d9-a5759e8d8243 tempest-VolumesListAdminTestJSON-1035312698 None] Acquiring lock "cinder-a3cb4d48-e5e4-42c0-8c4e-2d721a5359c6-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:21:52 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-97b9b2d0-5c72-4ea2-a8d9-a5759e8d8243 tempest-VolumesListAdminTestJSON-1035312698 None] Lock "cinder-a3cb4d48-e5e4-42c0-8c4e-2d721a5359c6-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:21:52 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-97b9b2d0-5c72-4ea2-a8d9-a5759e8d8243 tempest-VolumesListAdminTestJSON-1035312698 None] Acquiring lock "cinder-quobyte-a3cb4d48-e5e4-42c0-8c4e-2d721a5359c6" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:21:52 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-97b9b2d0-5c72-4ea2-a8d9-a5759e8d8243 tempest-VolumesListAdminTestJSON-1035312698 None] Lock "cinder-quobyte-a3cb4d48-e5e4-42c0-8c4e-2d721a5359c6" acquired by "delete_volume" :: waited 0.035s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:21:52 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6245fd4-6c03-44f6-a453-319720389cb8]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:21:52 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-97b9b2d0-5c72-4ea2-a8d9-a5759e8d8243 tempest-VolumesListAdminTestJSON-1035312698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a3cb4d48-e5e4-42c0-8c4e-2d721a5359c6 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:21:52 devstack sudo[95785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ff0e4e45-9766-4030-a3b8-7961bb833d73 Jul 22 03:21:52 devstack sudo[95785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:21:52 devstack sudo[95789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a3cb4d48-e5e4-42c0-8c4e-2d721a5359c6 Jul 22 03:21:52 devstack sudo[95789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:21:53 devstack sudo[95785]: pam_unix(sudo:session): session closed for user root Jul 22 03:21:53 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-9bc3f2d0-aa97-44ca-a465-478685349192 tempest-VolumesListAdminTestJSON-1085233096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ff0e4e45-9766-4030-a3b8-7961bb833d73" returned: 0 in 1.078s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:21:53 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-9bc3f2d0-aa97-44ca-a465-478685349192 tempest-VolumesListAdminTestJSON-1085233096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ff0e4e45-9766-4030-a3b8-7961bb833d73 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:21:53 devstack sudo[95789]: pam_unix(sudo:session): session closed for user root Jul 22 03:21:53 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-97b9b2d0-5c72-4ea2-a8d9-a5759e8d8243 tempest-VolumesListAdminTestJSON-1035312698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a3cb4d48-e5e4-42c0-8c4e-2d721a5359c6" returned: 0 in 0.835s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:21:53 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-97b9b2d0-5c72-4ea2-a8d9-a5759e8d8243 tempest-VolumesListAdminTestJSON-1035312698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a3cb4d48-e5e4-42c0-8c4e-2d721a5359c6 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:21:53 devstack sudo[95809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ff0e4e45-9766-4030-a3b8-7961bb833d73 Jul 22 03:21:53 devstack sudo[95809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:21:53 devstack sudo[95811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a3cb4d48-e5e4-42c0-8c4e-2d721a5359c6 Jul 22 03:21:53 devstack sudo[95811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:21:53 devstack sudo[95811]: pam_unix(sudo:session): session closed for user root Jul 22 03:21:53 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-97b9b2d0-5c72-4ea2-a8d9-a5759e8d8243 tempest-VolumesListAdminTestJSON-1035312698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a3cb4d48-e5e4-42c0-8c4e-2d721a5359c6" returned: 0 in 0.441s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:21:53 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-97b9b2d0-5c72-4ea2-a8d9-a5759e8d8243 tempest-VolumesListAdminTestJSON-1035312698 None] Lock "cinder-quobyte-a3cb4d48-e5e4-42c0-8c4e-2d721a5359c6" released by "delete_volume" :: held 1.378s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:21:53 devstack sudo[95809]: pam_unix(sudo:session): session closed for user root Jul 22 03:21:53 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-9bc3f2d0-aa97-44ca-a465-478685349192 tempest-VolumesListAdminTestJSON-1085233096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ff0e4e45-9766-4030-a3b8-7961bb833d73" returned: 0 in 0.587s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:21:53 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-9bc3f2d0-aa97-44ca-a465-478685349192 tempest-VolumesListAdminTestJSON-1085233096 None] Lock "cinder-quobyte-ff0e4e45-9766-4030-a3b8-7961bb833d73" released by "delete_volume" :: held 1.773s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:21:53 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-97b9b2d0-5c72-4ea2-a8d9-a5759e8d8243 tempest-VolumesListAdminTestJSON-1035312698 None] Created reservations ['211758e8-3a43-4fab-9888-0a3e148d29a5', 'a676ba9a-9f7a-4aa2-9318-0dd0a37641f4', '8c4d0ea3-8587-40e2-930b-630e1ad2c5f6', 'fa308182-b4c7-4269-98ef-66aeee953d0b'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:21:54 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-97b9b2d0-5c72-4ea2-a8d9-a5759e8d8243 tempest-VolumesListAdminTestJSON-1035312698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:21:54 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-97b9b2d0-5c72-4ea2-a8d9-a5759e8d8243 tempest-VolumesListAdminTestJSON-1035312698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:21:54 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-97b9b2d0-5c72-4ea2-a8d9-a5759e8d8243 tempest-VolumesListAdminTestJSON-1035312698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:21:54 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-97b9b2d0-5c72-4ea2-a8d9-a5759e8d8243 tempest-VolumesListAdminTestJSON-1035312698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:21:54 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-97b9b2d0-5c72-4ea2-a8d9-a5759e8d8243 tempest-VolumesListAdminTestJSON-1035312698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:21:54 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-97b9b2d0-5c72-4ea2-a8d9-a5759e8d8243 tempest-VolumesListAdminTestJSON-1035312698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:21:54 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-9bc3f2d0-aa97-44ca-a465-478685349192 tempest-VolumesListAdminTestJSON-1085233096 None] Created reservations ['ba3b4d30-8082-4e97-8f4c-c38ab3184693', '9680eb4c-e0d7-4784-bdf2-33e1b6427271', '59bdc634-80e9-4e11-a855-4b41780fa8d2', 'eb05d0ae-defc-4ebe-bd45-9b85e7e8cbd3'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:21:54 devstack sudo[95817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:21:54 devstack sudo[95817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:21:54 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-9bc3f2d0-aa97-44ca-a465-478685349192 tempest-VolumesListAdminTestJSON-1085233096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:21:54 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-9bc3f2d0-aa97-44ca-a465-478685349192 tempest-VolumesListAdminTestJSON-1085233096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:21:54 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-9bc3f2d0-aa97-44ca-a465-478685349192 tempest-VolumesListAdminTestJSON-1085233096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:21:54 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-9bc3f2d0-aa97-44ca-a465-478685349192 tempest-VolumesListAdminTestJSON-1085233096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:21:54 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-9bc3f2d0-aa97-44ca-a465-478685349192 tempest-VolumesListAdminTestJSON-1085233096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:21:54 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-9bc3f2d0-aa97-44ca-a465-478685349192 tempest-VolumesListAdminTestJSON-1085233096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:21:54 devstack sudo[95819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:21:54 devstack sudo[95819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:21:54 devstack sudo[95817]: pam_unix(sudo:session): session closed for user root Jul 22 03:21:54 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-97b9b2d0-5c72-4ea2-a8d9-a5759e8d8243 tempest-VolumesListAdminTestJSON-1035312698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.454s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:21:54 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-97b9b2d0-5c72-4ea2-a8d9-a5759e8d8243 tempest-VolumesListAdminTestJSON-1035312698 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:21:54 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-97b9b2d0-5c72-4ea2-a8d9-a5759e8d8243 tempest-VolumesListAdminTestJSON-1035312698 None] Deleted volume successfully. Jul 22 03:21:54 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-97b9b2d0-5c72-4ea2-a8d9-a5759e8d8243 tempest-VolumesListAdminTestJSON-1035312698 None] Lock "cinder-a3cb4d48-e5e4-42c0-8c4e-2d721a5359c6-delete_volume" released by "delete_volume" :: held 2.300s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:21:54 devstack sudo[95819]: pam_unix(sudo:session): session closed for user root Jul 22 03:21:54 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-9bc3f2d0-aa97-44ca-a465-478685349192 tempest-VolumesListAdminTestJSON-1085233096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.379s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:21:54 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-9bc3f2d0-aa97-44ca-a465-478685349192 tempest-VolumesListAdminTestJSON-1085233096 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:21:54 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-9bc3f2d0-aa97-44ca-a465-478685349192 tempest-VolumesListAdminTestJSON-1085233096 None] Deleted volume successfully. Jul 22 03:21:54 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-9bc3f2d0-aa97-44ca-a465-478685349192 tempest-VolumesListAdminTestJSON-1085233096 None] Lock "cinder-ff0e4e45-9766-4030-a3b8-7961bb833d73-delete_volume" released by "delete_volume" :: held 2.726s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:21:54 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-97fb56c9-f450-4e86-a085-716563bb1a1b tempest-VolumesListAdminTestJSON-1035312698 None] Acquiring lock "cinder-97e1220d-93cf-4563-9c0e-d3406a15e6a7-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:21:54 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-97fb56c9-f450-4e86-a085-716563bb1a1b tempest-VolumesListAdminTestJSON-1035312698 None] Lock "cinder-97e1220d-93cf-4563-9c0e-d3406a15e6a7-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:21:55 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-97fb56c9-f450-4e86-a085-716563bb1a1b tempest-VolumesListAdminTestJSON-1035312698 None] Acquiring lock "cinder-quobyte-97e1220d-93cf-4563-9c0e-d3406a15e6a7" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:21:55 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-97fb56c9-f450-4e86-a085-716563bb1a1b tempest-VolumesListAdminTestJSON-1035312698 None] Lock "cinder-quobyte-97e1220d-93cf-4563-9c0e-d3406a15e6a7" acquired by "delete_volume" :: waited 0.030s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:21:55 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[50cb1cb1-e769-4106-8c7e-a5be577ed563]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:21:55 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-97fb56c9-f450-4e86-a085-716563bb1a1b tempest-VolumesListAdminTestJSON-1035312698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-97e1220d-93cf-4563-9c0e-d3406a15e6a7 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:21:55 devstack sudo[95823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-97e1220d-93cf-4563-9c0e-d3406a15e6a7 Jul 22 03:21:55 devstack sudo[95823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:21:55 devstack sudo[95823]: pam_unix(sudo:session): session closed for user root Jul 22 03:21:55 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-97fb56c9-f450-4e86-a085-716563bb1a1b tempest-VolumesListAdminTestJSON-1035312698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-97e1220d-93cf-4563-9c0e-d3406a15e6a7" returned: 0 in 0.476s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:21:55 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-97fb56c9-f450-4e86-a085-716563bb1a1b tempest-VolumesListAdminTestJSON-1035312698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-97e1220d-93cf-4563-9c0e-d3406a15e6a7 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:21:55 devstack sudo[95830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-97e1220d-93cf-4563-9c0e-d3406a15e6a7 Jul 22 03:21:55 devstack sudo[95830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:21:55 devstack sudo[95830]: pam_unix(sudo:session): session closed for user root Jul 22 03:21:55 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-97fb56c9-f450-4e86-a085-716563bb1a1b tempest-VolumesListAdminTestJSON-1035312698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-97e1220d-93cf-4563-9c0e-d3406a15e6a7" returned: 0 in 0.368s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:21:55 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-97fb56c9-f450-4e86-a085-716563bb1a1b tempest-VolumesListAdminTestJSON-1035312698 None] Lock "cinder-quobyte-97e1220d-93cf-4563-9c0e-d3406a15e6a7" released by "delete_volume" :: held 0.933s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:21:56 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-97fb56c9-f450-4e86-a085-716563bb1a1b tempest-VolumesListAdminTestJSON-1035312698 None] Created reservations ['d8334d00-802f-48e4-98f9-6a3f097a0747', '421e6cba-16b7-4c78-b178-692ba67dcdce', 'bc270e3f-1ee7-4b99-bfdc-d5a500f6565a', '7cef9695-d0e5-46c8-ab28-8fcc6b6d52a8'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:21:56 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-97fb56c9-f450-4e86-a085-716563bb1a1b tempest-VolumesListAdminTestJSON-1035312698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:21:56 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-97fb56c9-f450-4e86-a085-716563bb1a1b tempest-VolumesListAdminTestJSON-1035312698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:21:56 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-97fb56c9-f450-4e86-a085-716563bb1a1b tempest-VolumesListAdminTestJSON-1035312698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:21:56 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-97fb56c9-f450-4e86-a085-716563bb1a1b tempest-VolumesListAdminTestJSON-1035312698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:21:56 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-97fb56c9-f450-4e86-a085-716563bb1a1b tempest-VolumesListAdminTestJSON-1035312698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:21:56 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-97fb56c9-f450-4e86-a085-716563bb1a1b tempest-VolumesListAdminTestJSON-1035312698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:21:56 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a4fde5a-db63-43c6-8d99-738171314076 tempest-VolumesNegativeTest-49111763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:21:56 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-7a4fde5a-db63-43c6-8d99-738171314076 tempest-VolumesNegativeTest-49111763 None] Flow 'volume_create_manager' (82ca1420-7195-4d59-882d-67417c883fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:21:56 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-7a4fde5a-db63-43c6-8d99-738171314076 tempest-VolumesNegativeTest-49111763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b7c5e68-df0a-4ae9-8d70-c8588808ffd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:21:56 devstack sudo[95844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:21:56 devstack sudo[95844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:21:56 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-7a4fde5a-db63-43c6-8d99-738171314076 tempest-VolumesNegativeTest-49111763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b7c5e68-df0a-4ae9-8d70-c8588808ffd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:21:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1303749356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45092e68-8a74-41fb-9010-64de2d9e491b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4bb889daae0417c92eb24f2335c2be8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:21:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:21:56Z,use_quota=True,user_id='c604a97d9da6460499de8ec6dede6ad2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:21:56 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-7a4fde5a-db63-43c6-8d99-738171314076 tempest-VolumesNegativeTest-49111763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93b622ca-868c-480f-8965-32f1165bebe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:21:56 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-7a4fde5a-db63-43c6-8d99-738171314076 tempest-VolumesNegativeTest-49111763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93b622ca-868c-480f-8965-32f1165bebe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:21:56 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-7a4fde5a-db63-43c6-8d99-738171314076 tempest-VolumesNegativeTest-49111763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed2b4766-d21d-4ce4-801b-78d5694a9ec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:21:56 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-7a4fde5a-db63-43c6-8d99-738171314076 tempest-VolumesNegativeTest-49111763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed2b4766-d21d-4ce4-801b-78d5694a9ec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45092e68-8a74-41fb-9010-64de2d9e491b', 'volume_name': 'volume-45092e68-8a74-41fb-9010-64de2d9e491b', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:21:56 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-7a4fde5a-db63-43c6-8d99-738171314076 tempest-VolumesNegativeTest-49111763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9274416-b35f-4841-9382-4164a2e3cdcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:21:56 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-7a4fde5a-db63-43c6-8d99-738171314076 tempest-VolumesNegativeTest-49111763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9274416-b35f-4841-9382-4164a2e3cdcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:21:56 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-7a4fde5a-db63-43c6-8d99-738171314076 tempest-VolumesNegativeTest-49111763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c6f4009-48d8-447b-aec7-59aa3fd05e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:21:56 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-7a4fde5a-db63-43c6-8d99-738171314076 tempest-VolumesNegativeTest-49111763 None] Volume 45092e68-8a74-41fb-9010-64de2d9e491b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45092e68-8a74-41fb-9010-64de2d9e491b', 'volume_size': 1} Jul 22 03:21:56 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-7a4fde5a-db63-43c6-8d99-738171314076 tempest-VolumesNegativeTest-49111763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:21:56 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-7a4fde5a-db63-43c6-8d99-738171314076 tempest-VolumesNegativeTest-49111763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:21:56 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-7a4fde5a-db63-43c6-8d99-738171314076 tempest-VolumesNegativeTest-49111763 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:21:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1303749356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45092e68-8a74-41fb-9010-64de2d9e491b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4bb889daae0417c92eb24f2335c2be8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:21:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:21:56Z,use_quota=True,user_id='c604a97d9da6460499de8ec6dede6ad2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:21:56 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-7a4fde5a-db63-43c6-8d99-738171314076 tempest-VolumesNegativeTest-49111763 None] Creating volume 45092e68-8a74-41fb-9010-64de2d9e491b {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:21:56 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-7a4fde5a-db63-43c6-8d99-738171314076 tempest-VolumesNegativeTest-49111763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:21:56 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-7a4fde5a-db63-43c6-8d99-738171314076 tempest-VolumesNegativeTest-49111763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:21:56 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-7a4fde5a-db63-43c6-8d99-738171314076 tempest-VolumesNegativeTest-49111763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:21:56 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-7a4fde5a-db63-43c6-8d99-738171314076 tempest-VolumesNegativeTest-49111763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:21:56 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-7a4fde5a-db63-43c6-8d99-738171314076 tempest-VolumesNegativeTest-49111763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:21:56 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-7a4fde5a-db63-43c6-8d99-738171314076 tempest-VolumesNegativeTest-49111763 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:21:56 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-7a4fde5a-db63-43c6-8d99-738171314076 tempest-VolumesNegativeTest-49111763 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:21:56 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-7a4fde5a-db63-43c6-8d99-738171314076 tempest-VolumesNegativeTest-49111763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-45092e68-8a74-41fb-9010-64de2d9e491b 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:21:56 devstack sudo[95846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-45092e68-8a74-41fb-9010-64de2d9e491b 1073741824 Jul 22 03:21:56 devstack sudo[95846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:21:56 devstack sudo[95844]: pam_unix(sudo:session): session closed for user root Jul 22 03:21:56 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-97fb56c9-f450-4e86-a085-716563bb1a1b tempest-VolumesListAdminTestJSON-1035312698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.462s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:21:56 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-97fb56c9-f450-4e86-a085-716563bb1a1b tempest-VolumesListAdminTestJSON-1035312698 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:21:56 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-97fb56c9-f450-4e86-a085-716563bb1a1b tempest-VolumesListAdminTestJSON-1035312698 None] Deleted volume successfully. Jul 22 03:21:56 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-97fb56c9-f450-4e86-a085-716563bb1a1b tempest-VolumesListAdminTestJSON-1035312698 None] Lock "cinder-97e1220d-93cf-4563-9c0e-d3406a15e6a7-delete_volume" released by "delete_volume" :: held 1.795s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:21:57 devstack sudo[95846]: pam_unix(sudo:session): session closed for user root Jul 22 03:21:57 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-7a4fde5a-db63-43c6-8d99-738171314076 tempest-VolumesNegativeTest-49111763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-45092e68-8a74-41fb-9010-64de2d9e491b 1073741824" returned: 0 in 0.968s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:21:57 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-7a4fde5a-db63-43c6-8d99-738171314076 tempest-VolumesNegativeTest-49111763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-45092e68-8a74-41fb-9010-64de2d9e491b {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:21:57 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-d01289b3-3790-4ed8-9600-aadb51f686c3 tempest-VolumesListAdminTestJSON-1035312698 None] Acquiring lock "cinder-0c8a72de-bfb9-4b2a-b5a6-829e9499bebe-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:21:57 devstack sudo[95894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-45092e68-8a74-41fb-9010-64de2d9e491b Jul 22 03:21:57 devstack sudo[95894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:21:57 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-d01289b3-3790-4ed8-9600-aadb51f686c3 tempest-VolumesListAdminTestJSON-1035312698 None] Lock "cinder-0c8a72de-bfb9-4b2a-b5a6-829e9499bebe-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:21:57 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-d01289b3-3790-4ed8-9600-aadb51f686c3 tempest-VolumesListAdminTestJSON-1035312698 None] Acquiring lock "cinder-quobyte-0c8a72de-bfb9-4b2a-b5a6-829e9499bebe" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:21:57 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-d01289b3-3790-4ed8-9600-aadb51f686c3 tempest-VolumesListAdminTestJSON-1035312698 None] Lock "cinder-quobyte-0c8a72de-bfb9-4b2a-b5a6-829e9499bebe" acquired by "delete_volume" :: waited 0.030s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:21:57 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[e264311d-2aec-4611-9bad-4b175d35548c]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:21:57 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d01289b3-3790-4ed8-9600-aadb51f686c3 tempest-VolumesListAdminTestJSON-1035312698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0c8a72de-bfb9-4b2a-b5a6-829e9499bebe {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:21:57 devstack sudo[95896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0c8a72de-bfb9-4b2a-b5a6-829e9499bebe Jul 22 03:21:57 devstack sudo[95896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:21:57 devstack sudo[95894]: pam_unix(sudo:session): session closed for user root Jul 22 03:21:57 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-7a4fde5a-db63-43c6-8d99-738171314076 tempest-VolumesNegativeTest-49111763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-45092e68-8a74-41fb-9010-64de2d9e491b" returned: 0 in 0.407s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:21:57 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-7a4fde5a-db63-43c6-8d99-738171314076 tempest-VolumesNegativeTest-49111763 None] <== create_volume: return (1444ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:21:57 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-7a4fde5a-db63-43c6-8d99-738171314076 tempest-VolumesNegativeTest-49111763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.446s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:21:57 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-7a4fde5a-db63-43c6-8d99-738171314076 tempest-VolumesNegativeTest-49111763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c6f4009-48d8-447b-aec7-59aa3fd05e8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45092e68-8a74-41fb-9010-64de2d9e491b', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:21:57 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-7a4fde5a-db63-43c6-8d99-738171314076 tempest-VolumesNegativeTest-49111763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (396d7f81-1167-4380-b77b-a54866603907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:21:57 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-7a4fde5a-db63-43c6-8d99-738171314076 tempest-VolumesNegativeTest-49111763 None] Volume volume-45092e68-8a74-41fb-9010-64de2d9e491b (45092e68-8a74-41fb-9010-64de2d9e491b): created successfully Jul 22 03:21:57 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-7a4fde5a-db63-43c6-8d99-738171314076 tempest-VolumesNegativeTest-49111763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (396d7f81-1167-4380-b77b-a54866603907) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:21:57 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-7a4fde5a-db63-43c6-8d99-738171314076 tempest-VolumesNegativeTest-49111763 None] Flow 'volume_create_manager' (82ca1420-7195-4d59-882d-67417c883fa6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:21:57 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-7a4fde5a-db63-43c6-8d99-738171314076 tempest-VolumesNegativeTest-49111763 None] Created volume successfully. Jul 22 03:21:58 devstack sudo[95896]: pam_unix(sudo:session): session closed for user root Jul 22 03:21:58 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d01289b3-3790-4ed8-9600-aadb51f686c3 tempest-VolumesListAdminTestJSON-1035312698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0c8a72de-bfb9-4b2a-b5a6-829e9499bebe" returned: 0 in 0.451s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:21:58 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d01289b3-3790-4ed8-9600-aadb51f686c3 tempest-VolumesListAdminTestJSON-1035312698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0c8a72de-bfb9-4b2a-b5a6-829e9499bebe {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:21:58 devstack sudo[95903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0c8a72de-bfb9-4b2a-b5a6-829e9499bebe Jul 22 03:21:58 devstack sudo[95903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:21:58 devstack sudo[95903]: pam_unix(sudo:session): session closed for user root Jul 22 03:21:58 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d01289b3-3790-4ed8-9600-aadb51f686c3 tempest-VolumesListAdminTestJSON-1035312698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0c8a72de-bfb9-4b2a-b5a6-829e9499bebe" returned: 0 in 0.337s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:21:58 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-d01289b3-3790-4ed8-9600-aadb51f686c3 tempest-VolumesListAdminTestJSON-1035312698 None] Lock "cinder-quobyte-0c8a72de-bfb9-4b2a-b5a6-829e9499bebe" released by "delete_volume" :: held 0.875s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:21:58 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-d01289b3-3790-4ed8-9600-aadb51f686c3 tempest-VolumesListAdminTestJSON-1035312698 None] Created reservations ['3b9577db-b421-4c23-b7c6-2ae18f458219', '218f3988-b467-4aa8-9a76-be75ed179a97', '2fd9efe7-bf85-4a0b-a7fa-e5fb3cd92fca', '5b021c37-aee0-4762-974b-11568f973ed7'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:21:58 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-d01289b3-3790-4ed8-9600-aadb51f686c3 tempest-VolumesListAdminTestJSON-1035312698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:21:58 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-d01289b3-3790-4ed8-9600-aadb51f686c3 tempest-VolumesListAdminTestJSON-1035312698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:21:58 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-d01289b3-3790-4ed8-9600-aadb51f686c3 tempest-VolumesListAdminTestJSON-1035312698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:21:58 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-d01289b3-3790-4ed8-9600-aadb51f686c3 tempest-VolumesListAdminTestJSON-1035312698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:21:58 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-d01289b3-3790-4ed8-9600-aadb51f686c3 tempest-VolumesListAdminTestJSON-1035312698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:21:58 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d01289b3-3790-4ed8-9600-aadb51f686c3 tempest-VolumesListAdminTestJSON-1035312698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:21:58 devstack sudo[95932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:21:58 devstack sudo[95932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:21:58 devstack sudo[95932]: pam_unix(sudo:session): session closed for user root Jul 22 03:21:58 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d01289b3-3790-4ed8-9600-aadb51f686c3 tempest-VolumesListAdminTestJSON-1035312698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.393s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:21:58 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-d01289b3-3790-4ed8-9600-aadb51f686c3 tempest-VolumesListAdminTestJSON-1035312698 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:21:59 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-d01289b3-3790-4ed8-9600-aadb51f686c3 tempest-VolumesListAdminTestJSON-1035312698 None] Deleted volume successfully. Jul 22 03:21:59 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-d01289b3-3790-4ed8-9600-aadb51f686c3 tempest-VolumesListAdminTestJSON-1035312698 None] Lock "cinder-0c8a72de-bfb9-4b2a-b5a6-829e9499bebe-delete_volume" released by "delete_volume" :: held 1.624s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:22:07 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a9c12a2-45a6-4c7b-a65b-dc75a1ebb5b6 tempest-SnapshotMetadataTestJSON-1991458896 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:22:08 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-7a9c12a2-45a6-4c7b-a65b-dc75a1ebb5b6 tempest-SnapshotMetadataTestJSON-1991458896 None] Flow 'volume_create_manager' (ef8e8804-0a11-4ef1-85cc-7250fab7e1dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:22:08 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-7a9c12a2-45a6-4c7b-a65b-dc75a1ebb5b6 tempest-SnapshotMetadataTestJSON-1991458896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d32550b6-3eef-4863-aaa5-6de150a45bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:22:08 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-7a9c12a2-45a6-4c7b-a65b-dc75a1ebb5b6 tempest-SnapshotMetadataTestJSON-1991458896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d32550b6-3eef-4863-aaa5-6de150a45bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:22:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-335574088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fed95b30-cc23-422e-aa78-ca9566d09195,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0672963ac8c74023a0d9f8eef743fa35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:22:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:22:08Z,use_quota=True,user_id='b492c545aa7f43a3a865fc11ba83f127',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:22:08 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-7a9c12a2-45a6-4c7b-a65b-dc75a1ebb5b6 tempest-SnapshotMetadataTestJSON-1991458896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a5735fb-643b-4d82-a1e4-1d2818cc62f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:22:08 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-7a9c12a2-45a6-4c7b-a65b-dc75a1ebb5b6 tempest-SnapshotMetadataTestJSON-1991458896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a5735fb-643b-4d82-a1e4-1d2818cc62f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:22:08 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-7a9c12a2-45a6-4c7b-a65b-dc75a1ebb5b6 tempest-SnapshotMetadataTestJSON-1991458896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14db57ee-78e1-4108-b320-dbb2db5219db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:22:08 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-7a9c12a2-45a6-4c7b-a65b-dc75a1ebb5b6 tempest-SnapshotMetadataTestJSON-1991458896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14db57ee-78e1-4108-b320-dbb2db5219db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fed95b30-cc23-422e-aa78-ca9566d09195', 'volume_name': 'volume-fed95b30-cc23-422e-aa78-ca9566d09195', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:22:08 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-7a9c12a2-45a6-4c7b-a65b-dc75a1ebb5b6 tempest-SnapshotMetadataTestJSON-1991458896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a70edb9-f99f-4b4d-a0d6-714b893a961f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:22:08 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-7a9c12a2-45a6-4c7b-a65b-dc75a1ebb5b6 tempest-SnapshotMetadataTestJSON-1991458896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a70edb9-f99f-4b4d-a0d6-714b893a961f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:22:08 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-7a9c12a2-45a6-4c7b-a65b-dc75a1ebb5b6 tempest-SnapshotMetadataTestJSON-1991458896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e43f76e0-5fec-495e-9fd8-eb97d7183bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:22:08 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-7a9c12a2-45a6-4c7b-a65b-dc75a1ebb5b6 tempest-SnapshotMetadataTestJSON-1991458896 None] Volume fed95b30-cc23-422e-aa78-ca9566d09195: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fed95b30-cc23-422e-aa78-ca9566d09195', 'volume_size': 1} Jul 22 03:22:08 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-7a9c12a2-45a6-4c7b-a65b-dc75a1ebb5b6 tempest-SnapshotMetadataTestJSON-1991458896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:22:08 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-7a9c12a2-45a6-4c7b-a65b-dc75a1ebb5b6 tempest-SnapshotMetadataTestJSON-1991458896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:22:08 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-7a9c12a2-45a6-4c7b-a65b-dc75a1ebb5b6 tempest-SnapshotMetadataTestJSON-1991458896 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:22:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-335574088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fed95b30-cc23-422e-aa78-ca9566d09195,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0672963ac8c74023a0d9f8eef743fa35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:22:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:22:08Z,use_quota=True,user_id='b492c545aa7f43a3a865fc11ba83f127',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:22:08 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-7a9c12a2-45a6-4c7b-a65b-dc75a1ebb5b6 tempest-SnapshotMetadataTestJSON-1991458896 None] Creating volume fed95b30-cc23-422e-aa78-ca9566d09195 {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:22:08 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-7a9c12a2-45a6-4c7b-a65b-dc75a1ebb5b6 tempest-SnapshotMetadataTestJSON-1991458896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:22:08 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-7a9c12a2-45a6-4c7b-a65b-dc75a1ebb5b6 tempest-SnapshotMetadataTestJSON-1991458896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:22:08 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-7a9c12a2-45a6-4c7b-a65b-dc75a1ebb5b6 tempest-SnapshotMetadataTestJSON-1991458896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:22:08 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-7a9c12a2-45a6-4c7b-a65b-dc75a1ebb5b6 tempest-SnapshotMetadataTestJSON-1991458896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:22:08 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-7a9c12a2-45a6-4c7b-a65b-dc75a1ebb5b6 tempest-SnapshotMetadataTestJSON-1991458896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:22:08 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-7a9c12a2-45a6-4c7b-a65b-dc75a1ebb5b6 tempest-SnapshotMetadataTestJSON-1991458896 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:22:08 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-7a9c12a2-45a6-4c7b-a65b-dc75a1ebb5b6 tempest-SnapshotMetadataTestJSON-1991458896 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:22:08 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-7a9c12a2-45a6-4c7b-a65b-dc75a1ebb5b6 tempest-SnapshotMetadataTestJSON-1991458896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-fed95b30-cc23-422e-aa78-ca9566d09195 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:22:08 devstack sudo[96031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-fed95b30-cc23-422e-aa78-ca9566d09195 1073741824 Jul 22 03:22:08 devstack sudo[96031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:22:08 devstack sudo[96031]: pam_unix(sudo:session): session closed for user root Jul 22 03:22:08 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-7a9c12a2-45a6-4c7b-a65b-dc75a1ebb5b6 tempest-SnapshotMetadataTestJSON-1991458896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-fed95b30-cc23-422e-aa78-ca9566d09195 1073741824" returned: 0 in 0.721s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:22:08 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-7a9c12a2-45a6-4c7b-a65b-dc75a1ebb5b6 tempest-SnapshotMetadataTestJSON-1991458896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-fed95b30-cc23-422e-aa78-ca9566d09195 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:22:09 devstack sudo[96036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-fed95b30-cc23-422e-aa78-ca9566d09195 Jul 22 03:22:09 devstack sudo[96036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:22:09 devstack sudo[96036]: pam_unix(sudo:session): session closed for user root Jul 22 03:22:09 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-7a9c12a2-45a6-4c7b-a65b-dc75a1ebb5b6 tempest-SnapshotMetadataTestJSON-1991458896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-fed95b30-cc23-422e-aa78-ca9566d09195" returned: 0 in 0.420s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:22:09 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-7a9c12a2-45a6-4c7b-a65b-dc75a1ebb5b6 tempest-SnapshotMetadataTestJSON-1991458896 None] <== create_volume: return (1242ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:22:09 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-7a9c12a2-45a6-4c7b-a65b-dc75a1ebb5b6 tempest-SnapshotMetadataTestJSON-1991458896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.246s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:22:09 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-7a9c12a2-45a6-4c7b-a65b-dc75a1ebb5b6 tempest-SnapshotMetadataTestJSON-1991458896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e43f76e0-5fec-495e-9fd8-eb97d7183bee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fed95b30-cc23-422e-aa78-ca9566d09195', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:22:09 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-7a9c12a2-45a6-4c7b-a65b-dc75a1ebb5b6 tempest-SnapshotMetadataTestJSON-1991458896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19e09f21-306b-45c8-b0cc-517adbb31223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:22:09 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-7a9c12a2-45a6-4c7b-a65b-dc75a1ebb5b6 tempest-SnapshotMetadataTestJSON-1991458896 None] Volume volume-fed95b30-cc23-422e-aa78-ca9566d09195 (fed95b30-cc23-422e-aa78-ca9566d09195): created successfully Jul 22 03:22:09 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-7a9c12a2-45a6-4c7b-a65b-dc75a1ebb5b6 tempest-SnapshotMetadataTestJSON-1991458896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19e09f21-306b-45c8-b0cc-517adbb31223) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:22:09 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-7a9c12a2-45a6-4c7b-a65b-dc75a1ebb5b6 tempest-SnapshotMetadataTestJSON-1991458896 None] Flow 'volume_create_manager' (ef8e8804-0a11-4ef1-85cc-7250fab7e1dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:22:09 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-7a9c12a2-45a6-4c7b-a65b-dc75a1ebb5b6 tempest-SnapshotMetadataTestJSON-1991458896 None] Created volume successfully. Jul 22 03:22:10 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-f725b085-a75b-4acc-864b-dc6f0f100be2 tempest-SnapshotMetadataTestJSON-1991458896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:22:10 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-f725b085-a75b-4acc-864b-dc6f0f100be2 tempest-SnapshotMetadataTestJSON-1991458896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:22:10 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-f725b085-a75b-4acc-864b-dc6f0f100be2 tempest-SnapshotMetadataTestJSON-1991458896 None] Creating offline snapshot 0f0387fd-5894-47f3-80a7-043523d2997f of volume fed95b30-cc23-422e-aa78-ca9566d09195 {{(pid=87747) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 03:22:10 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4c30e20-f647-4303-b50d-f16fcdd74677]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:22:10 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f725b085-a75b-4acc-864b-dc6f0f100be2 tempest-SnapshotMetadataTestJSON-1991458896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-fed95b30-cc23-422e-aa78-ca9566d09195 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:22:10 devstack sudo[96060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-fed95b30-cc23-422e-aa78-ca9566d09195 Jul 22 03:22:10 devstack sudo[96060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:22:10 devstack sudo[96060]: pam_unix(sudo:session): session closed for user root Jul 22 03:22:10 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f725b085-a75b-4acc-864b-dc6f0f100be2 tempest-SnapshotMetadataTestJSON-1991458896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-fed95b30-cc23-422e-aa78-ca9566d09195" returned: 0 in 0.459s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:22:10 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f725b085-a75b-4acc-864b-dc6f0f100be2 tempest-SnapshotMetadataTestJSON-1991458896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-fed95b30-cc23-422e-aa78-ca9566d09195,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-fed95b30-cc23-422e-aa78-ca9566d09195.0f0387fd-5894-47f3-80a7-043523d2997f 1G {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:22:10 devstack sudo[96082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-fed95b30-cc23-422e-aa78-ca9566d09195,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-fed95b30-cc23-422e-aa78-ca9566d09195.0f0387fd-5894-47f3-80a7-043523d2997f 1G Jul 22 03:22:10 devstack sudo[96082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:22:11 devstack sudo[96082]: pam_unix(sudo:session): session closed for user root Jul 22 03:22:11 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f725b085-a75b-4acc-864b-dc6f0f100be2 tempest-SnapshotMetadataTestJSON-1991458896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-fed95b30-cc23-422e-aa78-ca9566d09195,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-fed95b30-cc23-422e-aa78-ca9566d09195.0f0387fd-5894-47f3-80a7-043523d2997f 1G" returned: 0 in 0.417s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:22:11 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f725b085-a75b-4acc-864b-dc6f0f100be2 tempest-SnapshotMetadataTestJSON-1991458896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fed95b30-cc23-422e-aa78-ca9566d09195 -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-fed95b30-cc23-422e-aa78-ca9566d09195.0f0387fd-5894-47f3-80a7-043523d2997f {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:22:11 devstack sudo[96088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fed95b30-cc23-422e-aa78-ca9566d09195 -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-fed95b30-cc23-422e-aa78-ca9566d09195.0f0387fd-5894-47f3-80a7-043523d2997f Jul 22 03:22:11 devstack sudo[96088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:22:11 devstack sudo[96088]: pam_unix(sudo:session): session closed for user root Jul 22 03:22:11 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f725b085-a75b-4acc-864b-dc6f0f100be2 tempest-SnapshotMetadataTestJSON-1991458896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fed95b30-cc23-422e-aa78-ca9566d09195 -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-fed95b30-cc23-422e-aa78-ca9566d09195.0f0387fd-5894-47f3-80a7-043523d2997f" returned: 0 in 0.300s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:22:11 devstack cinder-volume[87747]: WARNING cinder.volume.drivers.remotefs [None req-f725b085-a75b-4acc-864b-dc6f0f100be2 tempest-SnapshotMetadataTestJSON-1991458896 None] /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-fed95b30-cc23-422e-aa78-ca9566d09195.0f0387fd-5894-47f3-80a7-043523d2997f is being set with open permissions: ugo+rw Jul 22 03:22:11 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f725b085-a75b-4acc-864b-dc6f0f100be2 tempest-SnapshotMetadataTestJSON-1991458896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-fed95b30-cc23-422e-aa78-ca9566d09195.0f0387fd-5894-47f3-80a7-043523d2997f {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:22:11 devstack sudo[96093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-fed95b30-cc23-422e-aa78-ca9566d09195.0f0387fd-5894-47f3-80a7-043523d2997f Jul 22 03:22:11 devstack sudo[96093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:22:11 devstack sudo[96093]: pam_unix(sudo:session): session closed for user root Jul 22 03:22:11 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f725b085-a75b-4acc-864b-dc6f0f100be2 tempest-SnapshotMetadataTestJSON-1991458896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-fed95b30-cc23-422e-aa78-ca9566d09195.0f0387fd-5894-47f3-80a7-043523d2997f" returned: 0 in 0.258s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:22:11 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f725b085-a75b-4acc-864b-dc6f0f100be2 tempest-SnapshotMetadataTestJSON-1991458896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-fed95b30-cc23-422e-aa78-ca9566d09195.info {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:22:11 devstack sudo[96096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-fed95b30-cc23-422e-aa78-ca9566d09195.info Jul 22 03:22:11 devstack sudo[96096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:22:12 devstack sudo[96096]: pam_unix(sudo:session): session closed for user root Jul 22 03:22:12 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f725b085-a75b-4acc-864b-dc6f0f100be2 tempest-SnapshotMetadataTestJSON-1991458896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-fed95b30-cc23-422e-aa78-ca9566d09195.info" returned: 0 in 0.272s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:22:12 devstack cinder-volume[87747]: WARNING cinder.volume.drivers.remotefs [None req-f725b085-a75b-4acc-864b-dc6f0f100be2 tempest-SnapshotMetadataTestJSON-1991458896 None] /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-fed95b30-cc23-422e-aa78-ca9566d09195.info is being set with open permissions: ugo+rw Jul 22 03:22:12 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f725b085-a75b-4acc-864b-dc6f0f100be2 tempest-SnapshotMetadataTestJSON-1991458896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-fed95b30-cc23-422e-aa78-ca9566d09195.info {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:22:12 devstack sudo[96099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-fed95b30-cc23-422e-aa78-ca9566d09195.info Jul 22 03:22:12 devstack sudo[96099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:22:12 devstack sudo[96099]: pam_unix(sudo:session): session closed for user root Jul 22 03:22:12 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f725b085-a75b-4acc-864b-dc6f0f100be2 tempest-SnapshotMetadataTestJSON-1991458896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-fed95b30-cc23-422e-aa78-ca9566d09195.info" returned: 0 in 0.257s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:22:12 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-f725b085-a75b-4acc-864b-dc6f0f100be2 tempest-SnapshotMetadataTestJSON-1991458896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.059s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:22:12 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-f725b085-a75b-4acc-864b-dc6f0f100be2 tempest-SnapshotMetadataTestJSON-1991458896 None] Create snapshot completed successfully Jul 22 03:22:14 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-2ae4418b-1142-4692-bb31-a1a3a7263557 tempest-SnapshotMetadataTestJSON-1991458896 None] Acquiring lock "cinder-0f0387fd-5894-47f3-80a7-043523d2997f-delete_snapshot" by "delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:22:14 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-2ae4418b-1142-4692-bb31-a1a3a7263557 tempest-SnapshotMetadataTestJSON-1991458896 None] Lock "cinder-0f0387fd-5894-47f3-80a7-043523d2997f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:22:14 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-2ae4418b-1142-4692-bb31-a1a3a7263557 tempest-SnapshotMetadataTestJSON-1991458896 None] Acquiring lock "cinder-quobyte-fed95b30-cc23-422e-aa78-ca9566d09195" by "delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:22:14 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-2ae4418b-1142-4692-bb31-a1a3a7263557 tempest-SnapshotMetadataTestJSON-1991458896 None] Lock "cinder-quobyte-fed95b30-cc23-422e-aa78-ca9566d09195" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:22:14 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-2ae4418b-1142-4692-bb31-a1a3a7263557 tempest-SnapshotMetadataTestJSON-1991458896 None] Acquiring lock "cinder-quobyte-0f0387fd-5894-47f3-80a7-043523d2997f" by "_delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:22:14 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-2ae4418b-1142-4692-bb31-a1a3a7263557 tempest-SnapshotMetadataTestJSON-1991458896 None] Lock "cinder-quobyte-0f0387fd-5894-47f3-80a7-043523d2997f" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:22:14 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-2ae4418b-1142-4692-bb31-a1a3a7263557 tempest-SnapshotMetadataTestJSON-1991458896 None] Deleting offline snapshot 0f0387fd-5894-47f3-80a7-043523d2997f of volume fed95b30-cc23-422e-aa78-ca9566d09195 {{(pid=87747) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 03:22:14 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-2ae4418b-1142-4692-bb31-a1a3a7263557 tempest-SnapshotMetadataTestJSON-1991458896 None] snapshot_file for this snap is: volume-fed95b30-cc23-422e-aa78-ca9566d09195.0f0387fd-5894-47f3-80a7-043523d2997f {{(pid=87747) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 03:22:14 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[412562b9-67cf-442c-8db6-93cf8c337e5b]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:22:14 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2ae4418b-1142-4692-bb31-a1a3a7263557 tempest-SnapshotMetadataTestJSON-1991458896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-fed95b30-cc23-422e-aa78-ca9566d09195.0f0387fd-5894-47f3-80a7-043523d2997f {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:22:14 devstack sudo[96106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-fed95b30-cc23-422e-aa78-ca9566d09195.0f0387fd-5894-47f3-80a7-043523d2997f Jul 22 03:22:14 devstack sudo[96106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:22:14 devstack sudo[96106]: pam_unix(sudo:session): session closed for user root Jul 22 03:22:14 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2ae4418b-1142-4692-bb31-a1a3a7263557 tempest-SnapshotMetadataTestJSON-1991458896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-fed95b30-cc23-422e-aa78-ca9566d09195.0f0387fd-5894-47f3-80a7-043523d2997f" returned: 0 in 0.364s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:22:14 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-2ae4418b-1142-4692-bb31-a1a3a7263557 tempest-SnapshotMetadataTestJSON-1991458896 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fed95b30-cc23-422e-aa78-ca9566d09195(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87747) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 03:22:14 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[5630aff4-638f-46ed-bb6f-4d50b676f906]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:22:14 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2ae4418b-1142-4692-bb31-a1a3a7263557 tempest-SnapshotMetadataTestJSON-1991458896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-fed95b30-cc23-422e-aa78-ca9566d09195 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:22:14 devstack sudo[96112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-fed95b30-cc23-422e-aa78-ca9566d09195 Jul 22 03:22:14 devstack sudo[96112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:22:15 devstack sudo[96112]: pam_unix(sudo:session): session closed for user root Jul 22 03:22:15 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2ae4418b-1142-4692-bb31-a1a3a7263557 tempest-SnapshotMetadataTestJSON-1991458896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-fed95b30-cc23-422e-aa78-ca9566d09195" returned: 0 in 0.431s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:22:15 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2ae4418b-1142-4692-bb31-a1a3a7263557 tempest-SnapshotMetadataTestJSON-1991458896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-fed95b30-cc23-422e-aa78-ca9566d09195.0f0387fd-5894-47f3-80a7-043523d2997f {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:22:15 devstack sudo[96121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-fed95b30-cc23-422e-aa78-ca9566d09195.0f0387fd-5894-47f3-80a7-043523d2997f Jul 22 03:22:15 devstack sudo[96121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:22:15 devstack sudo[96121]: pam_unix(sudo:session): session closed for user root Jul 22 03:22:15 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2ae4418b-1142-4692-bb31-a1a3a7263557 tempest-SnapshotMetadataTestJSON-1991458896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-fed95b30-cc23-422e-aa78-ca9566d09195.0f0387fd-5894-47f3-80a7-043523d2997f" returned: 0 in 0.396s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:22:15 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2ae4418b-1142-4692-bb31-a1a3a7263557 tempest-SnapshotMetadataTestJSON-1991458896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-fed95b30-cc23-422e-aa78-ca9566d09195.0f0387fd-5894-47f3-80a7-043523d2997f {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:22:15 devstack sudo[96132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-fed95b30-cc23-422e-aa78-ca9566d09195.0f0387fd-5894-47f3-80a7-043523d2997f Jul 22 03:22:15 devstack sudo[96132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:22:15 devstack sudo[96132]: pam_unix(sudo:session): session closed for user root Jul 22 03:22:15 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2ae4418b-1142-4692-bb31-a1a3a7263557 tempest-SnapshotMetadataTestJSON-1991458896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-fed95b30-cc23-422e-aa78-ca9566d09195.0f0387fd-5894-47f3-80a7-043523d2997f" returned: 0 in 0.262s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:22:15 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-2ae4418b-1142-4692-bb31-a1a3a7263557 tempest-SnapshotMetadataTestJSON-1991458896 None] Lock "cinder-quobyte-0f0387fd-5894-47f3-80a7-043523d2997f" released by "_delete_snapshot" :: held 1.577s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:22:15 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-2ae4418b-1142-4692-bb31-a1a3a7263557 tempest-SnapshotMetadataTestJSON-1991458896 None] Lock "cinder-quobyte-fed95b30-cc23-422e-aa78-ca9566d09195" released by "delete_snapshot" :: held 1.605s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:22:15 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-2ae4418b-1142-4692-bb31-a1a3a7263557 tempest-SnapshotMetadataTestJSON-1991458896 None] Created reservations ['6db01845-4f79-4f3d-a076-59903188b622', '09e817ff-2e0e-4cd0-92cd-efe30e72a5e3', 'd5738598-275c-4a30-8b9f-cb129c9f913e', '0f6db278-8319-4695-9f91-01e29719e398'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:22:16 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-2ae4418b-1142-4692-bb31-a1a3a7263557 tempest-SnapshotMetadataTestJSON-1991458896 None] Delete snapshot completed successfully. Jul 22 03:22:16 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-2ae4418b-1142-4692-bb31-a1a3a7263557 tempest-SnapshotMetadataTestJSON-1991458896 None] Lock "cinder-0f0387fd-5894-47f3-80a7-043523d2997f-delete_snapshot" released by "delete_snapshot" :: held 1.765s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:22:16 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-a3928f5d-b5e3-46de-b100-6c663c6dd815 tempest-SnapshotMetadataTestJSON-1991458896 None] Acquiring lock "cinder-fed95b30-cc23-422e-aa78-ca9566d09195-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:22:16 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-a3928f5d-b5e3-46de-b100-6c663c6dd815 tempest-SnapshotMetadataTestJSON-1991458896 None] Lock "cinder-fed95b30-cc23-422e-aa78-ca9566d09195-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:22:16 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-a3928f5d-b5e3-46de-b100-6c663c6dd815 tempest-SnapshotMetadataTestJSON-1991458896 None] Acquiring lock "cinder-quobyte-fed95b30-cc23-422e-aa78-ca9566d09195" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:22:16 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-a3928f5d-b5e3-46de-b100-6c663c6dd815 tempest-SnapshotMetadataTestJSON-1991458896 None] Lock "cinder-quobyte-fed95b30-cc23-422e-aa78-ca9566d09195" acquired by "delete_volume" :: waited 0.020s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:22:16 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd0af63-ecd1-4d4f-883e-7ee9bcc95dbd]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:22:16 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-a3928f5d-b5e3-46de-b100-6c663c6dd815 tempest-SnapshotMetadataTestJSON-1991458896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-fed95b30-cc23-422e-aa78-ca9566d09195 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:22:16 devstack sudo[96141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-fed95b30-cc23-422e-aa78-ca9566d09195 Jul 22 03:22:16 devstack sudo[96141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:22:16 devstack sudo[96141]: pam_unix(sudo:session): session closed for user root Jul 22 03:22:16 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-a3928f5d-b5e3-46de-b100-6c663c6dd815 tempest-SnapshotMetadataTestJSON-1991458896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-fed95b30-cc23-422e-aa78-ca9566d09195" returned: 0 in 0.383s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:22:16 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-a3928f5d-b5e3-46de-b100-6c663c6dd815 tempest-SnapshotMetadataTestJSON-1991458896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-fed95b30-cc23-422e-aa78-ca9566d09195 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:22:17 devstack sudo[96146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-fed95b30-cc23-422e-aa78-ca9566d09195 Jul 22 03:22:17 devstack sudo[96146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:22:17 devstack sudo[96146]: pam_unix(sudo:session): session closed for user root Jul 22 03:22:17 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-a3928f5d-b5e3-46de-b100-6c663c6dd815 tempest-SnapshotMetadataTestJSON-1991458896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-fed95b30-cc23-422e-aa78-ca9566d09195" returned: 0 in 0.258s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:22:17 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-a3928f5d-b5e3-46de-b100-6c663c6dd815 tempest-SnapshotMetadataTestJSON-1991458896 None] Lock "cinder-quobyte-fed95b30-cc23-422e-aa78-ca9566d09195" released by "delete_volume" :: held 0.709s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:22:17 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-a3928f5d-b5e3-46de-b100-6c663c6dd815 tempest-SnapshotMetadataTestJSON-1991458896 None] Created reservations ['84c366c0-2316-4f5b-baac-0ddf06d948d0', 'de0044a0-af6a-49c1-ac02-a81bbb54186a', '651ff7f6-bf3d-4289-9a12-ce49c48c3b00', 'be36221a-1811-4e2f-8ac2-babbab3bac61'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:22:17 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-a3928f5d-b5e3-46de-b100-6c663c6dd815 tempest-SnapshotMetadataTestJSON-1991458896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:22:17 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-a3928f5d-b5e3-46de-b100-6c663c6dd815 tempest-SnapshotMetadataTestJSON-1991458896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:22:17 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-a3928f5d-b5e3-46de-b100-6c663c6dd815 tempest-SnapshotMetadataTestJSON-1991458896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:22:17 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-a3928f5d-b5e3-46de-b100-6c663c6dd815 tempest-SnapshotMetadataTestJSON-1991458896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:22:17 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-a3928f5d-b5e3-46de-b100-6c663c6dd815 tempest-SnapshotMetadataTestJSON-1991458896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:22:17 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-a3928f5d-b5e3-46de-b100-6c663c6dd815 tempest-SnapshotMetadataTestJSON-1991458896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:22:17 devstack sudo[96149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:22:17 devstack sudo[96149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:22:17 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-b81d9df6-3615-4e40-93a3-8d27422df34b tempest-VolumesNegativeTest-49111763 None] Acquiring lock "cinder-45092e68-8a74-41fb-9010-64de2d9e491b-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:22:17 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-b81d9df6-3615-4e40-93a3-8d27422df34b tempest-VolumesNegativeTest-49111763 None] Lock "cinder-45092e68-8a74-41fb-9010-64de2d9e491b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:22:17 devstack sudo[96149]: pam_unix(sudo:session): session closed for user root Jul 22 03:22:17 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-b81d9df6-3615-4e40-93a3-8d27422df34b tempest-VolumesNegativeTest-49111763 None] Acquiring lock "cinder-quobyte-45092e68-8a74-41fb-9010-64de2d9e491b" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:22:17 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-a3928f5d-b5e3-46de-b100-6c663c6dd815 tempest-SnapshotMetadataTestJSON-1991458896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.270s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:22:17 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-a3928f5d-b5e3-46de-b100-6c663c6dd815 tempest-SnapshotMetadataTestJSON-1991458896 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:22:17 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-a3928f5d-b5e3-46de-b100-6c663c6dd815 tempest-SnapshotMetadataTestJSON-1991458896 None] Deleted volume successfully. Jul 22 03:22:17 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-b81d9df6-3615-4e40-93a3-8d27422df34b tempest-VolumesNegativeTest-49111763 None] Lock "cinder-quobyte-45092e68-8a74-41fb-9010-64de2d9e491b" acquired by "delete_volume" :: waited 0.020s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:22:17 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e8c1df-daa8-4eca-a970-55df0aea9ea3]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:22:17 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b81d9df6-3615-4e40-93a3-8d27422df34b tempest-VolumesNegativeTest-49111763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-45092e68-8a74-41fb-9010-64de2d9e491b {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:22:17 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-a3928f5d-b5e3-46de-b100-6c663c6dd815 tempest-SnapshotMetadataTestJSON-1991458896 None] Lock "cinder-fed95b30-cc23-422e-aa78-ca9566d09195-delete_volume" released by "delete_volume" :: held 1.220s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:22:17 devstack sudo[96152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-45092e68-8a74-41fb-9010-64de2d9e491b Jul 22 03:22:17 devstack sudo[96152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:22:18 devstack sudo[96152]: pam_unix(sudo:session): session closed for user root Jul 22 03:22:18 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b81d9df6-3615-4e40-93a3-8d27422df34b tempest-VolumesNegativeTest-49111763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-45092e68-8a74-41fb-9010-64de2d9e491b" returned: 0 in 0.401s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:22:18 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b81d9df6-3615-4e40-93a3-8d27422df34b tempest-VolumesNegativeTest-49111763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-45092e68-8a74-41fb-9010-64de2d9e491b {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:22:18 devstack sudo[96157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-45092e68-8a74-41fb-9010-64de2d9e491b Jul 22 03:22:18 devstack sudo[96157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:22:18 devstack sudo[96157]: pam_unix(sudo:session): session closed for user root Jul 22 03:22:18 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b81d9df6-3615-4e40-93a3-8d27422df34b tempest-VolumesNegativeTest-49111763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-45092e68-8a74-41fb-9010-64de2d9e491b" returned: 0 in 0.329s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:22:18 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-b81d9df6-3615-4e40-93a3-8d27422df34b tempest-VolumesNegativeTest-49111763 None] Lock "cinder-quobyte-45092e68-8a74-41fb-9010-64de2d9e491b" released by "delete_volume" :: held 0.775s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:22:18 devstack cinder-volume[87747]: DEBUG dbcounter [-] [87747] Writing DB stats cinder:SELECT=73,cinder:UPDATE=72,cinder:DELETE=7,cinder:INSERT=17 {{(pid=87747) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 03:22:18 devstack cinder-volume[87747]: DEBUG dbcounter [-] [87747] Writing DB stats cinder:UPDATE=90,cinder:SELECT=71,cinder:INSERT=19,cinder:DELETE=7 {{(pid=87747) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 03:22:18 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-b81d9df6-3615-4e40-93a3-8d27422df34b tempest-VolumesNegativeTest-49111763 None] Created reservations ['a9a481b4-2144-4a11-877f-10aa482f53c6', '08b07807-6fd8-41a9-b9f9-4e1cc4a10c7c', '5a9bf466-d4ce-4d8b-a53b-76588589c7be', '1f5d4b79-cf9f-40a8-a2ea-d45a9e9c8e78'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:22:18 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b81d9df6-3615-4e40-93a3-8d27422df34b tempest-VolumesNegativeTest-49111763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:22:18 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b81d9df6-3615-4e40-93a3-8d27422df34b tempest-VolumesNegativeTest-49111763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:22:18 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-b81d9df6-3615-4e40-93a3-8d27422df34b tempest-VolumesNegativeTest-49111763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:22:18 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-b81d9df6-3615-4e40-93a3-8d27422df34b tempest-VolumesNegativeTest-49111763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:22:18 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b81d9df6-3615-4e40-93a3-8d27422df34b tempest-VolumesNegativeTest-49111763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:22:18 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b81d9df6-3615-4e40-93a3-8d27422df34b tempest-VolumesNegativeTest-49111763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:22:18 devstack sudo[96164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:22:18 devstack sudo[96164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:22:18 devstack sudo[96164]: pam_unix(sudo:session): session closed for user root Jul 22 03:22:18 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b81d9df6-3615-4e40-93a3-8d27422df34b tempest-VolumesNegativeTest-49111763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.322s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:22:18 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-b81d9df6-3615-4e40-93a3-8d27422df34b tempest-VolumesNegativeTest-49111763 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:22:18 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-b81d9df6-3615-4e40-93a3-8d27422df34b tempest-VolumesNegativeTest-49111763 None] Deleted volume successfully. Jul 22 03:22:18 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-b81d9df6-3615-4e40-93a3-8d27422df34b tempest-VolumesNegativeTest-49111763 None] Lock "cinder-45092e68-8a74-41fb-9010-64de2d9e491b-delete_volume" released by "delete_volume" :: held 1.397s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:22:21 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-7410c57b-7f64-403e-a3fb-cc9c0169da3f tempest-VolumesCloneNegativeTest-1346460266 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:22:21 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-7410c57b-7f64-403e-a3fb-cc9c0169da3f tempest-VolumesCloneNegativeTest-1346460266 None] Flow 'volume_create_manager' (66629eaf-e64c-42bd-b1af-b3e8fbb766b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:22:21 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-7410c57b-7f64-403e-a3fb-cc9c0169da3f tempest-VolumesCloneNegativeTest-1346460266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (820c4ae8-ac12-4b26-b506-56713548f2f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:22:21 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-7410c57b-7f64-403e-a3fb-cc9c0169da3f tempest-VolumesCloneNegativeTest-1346460266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (820c4ae8-ac12-4b26-b506-56713548f2f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:22:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-977749945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06d52bad-cf5e-4f8f-a269-46cb3094fa65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aecc59ca616e47cf8d4ccc2707bb0c98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:22:22Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:22:22Z,use_quota=True,user_id='da5e8a5463ac458bbe8d149d54b86e1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:22:21 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-7410c57b-7f64-403e-a3fb-cc9c0169da3f tempest-VolumesCloneNegativeTest-1346460266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3489d0f-bb96-4e7e-8309-9f44ab97003b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:22:21 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-7410c57b-7f64-403e-a3fb-cc9c0169da3f tempest-VolumesCloneNegativeTest-1346460266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3489d0f-bb96-4e7e-8309-9f44ab97003b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:22:21 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-7410c57b-7f64-403e-a3fb-cc9c0169da3f tempest-VolumesCloneNegativeTest-1346460266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c2d6cf4-055b-4267-8b80-6a2687899893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:22:21 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-7410c57b-7f64-403e-a3fb-cc9c0169da3f tempest-VolumesCloneNegativeTest-1346460266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c2d6cf4-055b-4267-8b80-6a2687899893) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06d52bad-cf5e-4f8f-a269-46cb3094fa65', 'volume_name': 'volume-06d52bad-cf5e-4f8f-a269-46cb3094fa65', 'volume_size': 2}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:22:21 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-7410c57b-7f64-403e-a3fb-cc9c0169da3f tempest-VolumesCloneNegativeTest-1346460266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7006561-1ff1-48d2-a6c1-7f88d85538a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:22:21 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-7410c57b-7f64-403e-a3fb-cc9c0169da3f tempest-VolumesCloneNegativeTest-1346460266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7006561-1ff1-48d2-a6c1-7f88d85538a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:22:21 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-7410c57b-7f64-403e-a3fb-cc9c0169da3f tempest-VolumesCloneNegativeTest-1346460266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (577995ef-13dc-4e62-8f26-b7f54a79f135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:22:21 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-7410c57b-7f64-403e-a3fb-cc9c0169da3f tempest-VolumesCloneNegativeTest-1346460266 None] Volume 06d52bad-cf5e-4f8f-a269-46cb3094fa65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06d52bad-cf5e-4f8f-a269-46cb3094fa65', 'volume_size': 2} Jul 22 03:22:21 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-7410c57b-7f64-403e-a3fb-cc9c0169da3f tempest-VolumesCloneNegativeTest-1346460266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:22:21 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-7410c57b-7f64-403e-a3fb-cc9c0169da3f tempest-VolumesCloneNegativeTest-1346460266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:22:21 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-7410c57b-7f64-403e-a3fb-cc9c0169da3f tempest-VolumesCloneNegativeTest-1346460266 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:22:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-977749945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06d52bad-cf5e-4f8f-a269-46cb3094fa65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aecc59ca616e47cf8d4ccc2707bb0c98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:22:22Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:22:22Z,use_quota=True,user_id='da5e8a5463ac458bbe8d149d54b86e1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:22:21 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-7410c57b-7f64-403e-a3fb-cc9c0169da3f tempest-VolumesCloneNegativeTest-1346460266 None] Creating volume 06d52bad-cf5e-4f8f-a269-46cb3094fa65 {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:22:21 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-7410c57b-7f64-403e-a3fb-cc9c0169da3f tempest-VolumesCloneNegativeTest-1346460266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:22:21 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-7410c57b-7f64-403e-a3fb-cc9c0169da3f tempest-VolumesCloneNegativeTest-1346460266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:22:21 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-7410c57b-7f64-403e-a3fb-cc9c0169da3f tempest-VolumesCloneNegativeTest-1346460266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:22:21 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-7410c57b-7f64-403e-a3fb-cc9c0169da3f tempest-VolumesCloneNegativeTest-1346460266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:22:21 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-7410c57b-7f64-403e-a3fb-cc9c0169da3f tempest-VolumesCloneNegativeTest-1346460266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:22:21 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-7410c57b-7f64-403e-a3fb-cc9c0169da3f tempest-VolumesCloneNegativeTest-1346460266 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:22:21 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-7410c57b-7f64-403e-a3fb-cc9c0169da3f tempest-VolumesCloneNegativeTest-1346460266 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:22:21 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-7410c57b-7f64-403e-a3fb-cc9c0169da3f tempest-VolumesCloneNegativeTest-1346460266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-06d52bad-cf5e-4f8f-a269-46cb3094fa65 2147483648 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:22:21 devstack sudo[96191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-06d52bad-cf5e-4f8f-a269-46cb3094fa65 2147483648 Jul 22 03:22:21 devstack sudo[96191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:22:22 devstack cinder-volume[87747]: INFO cinder.volume.manager [req-ff41dae7-b4f1-4428-a2a6-3556fbd5acb3 req-e5b85b1a-7d43-457d-8cbb-095e88178b47 tempest-TestShelveInstance-1884963064 None] Terminate volume connection completed successfully. Jul 22 03:22:22 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [req-ff41dae7-b4f1-4428-a2a6-3556fbd5acb3 req-e5b85b1a-7d43-457d-8cbb-095e88178b47 tempest-TestShelveInstance-1884963064 None] Deleting attachment b5ca2a74-d142-4881-887c-438a872058a4. {{(pid=87747) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 22 03:22:22 devstack cinder-volume[87747]: DEBUG cinder.coordination [req-ff41dae7-b4f1-4428-a2a6-3556fbd5acb3 req-906d3257-e4db-4080-83e0-3c8ec56eeb24 tempest-TestShelveInstance-1884963064 None] Acquiring lock "cinder-76f8ddaa-d64c-4017-b69f-ca776a2c2e07-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:22:22 devstack cinder-volume[87747]: DEBUG oslo_service.periodic_task [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87747) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 03:22:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:22:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:22:22 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:22:22 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:22:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:22:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:22:22 devstack cinder-volume[87747]: DEBUG cinder.coordination [req-ff41dae7-b4f1-4428-a2a6-3556fbd5acb3 req-906d3257-e4db-4080-83e0-3c8ec56eeb24 tempest-TestShelveInstance-1884963064 None] Lock "cinder-76f8ddaa-d64c-4017-b69f-ca776a2c2e07-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:22:22 devstack sudo[96200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:22:22 devstack sudo[96200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:22:22 devstack cinder-volume[87747]: DEBUG cinder.coordination [req-ff41dae7-b4f1-4428-a2a6-3556fbd5acb3 req-906d3257-e4db-4080-83e0-3c8ec56eeb24 tempest-TestShelveInstance-1884963064 None] Acquiring lock "cinder-quobyte-76f8ddaa-d64c-4017-b69f-ca776a2c2e07" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:22:22 devstack cinder-volume[87747]: DEBUG cinder.coordination [req-ff41dae7-b4f1-4428-a2a6-3556fbd5acb3 req-906d3257-e4db-4080-83e0-3c8ec56eeb24 tempest-TestShelveInstance-1884963064 None] Lock "cinder-quobyte-76f8ddaa-d64c-4017-b69f-ca776a2c2e07" acquired by "delete_volume" :: waited 0.033s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:22:22 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe48ea3a-3a42-4824-bb70-72357f37bc45]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:22:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [req-ff41dae7-b4f1-4428-a2a6-3556fbd5acb3 req-906d3257-e4db-4080-83e0-3c8ec56eeb24 tempest-TestShelveInstance-1884963064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-76f8ddaa-d64c-4017-b69f-ca776a2c2e07 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:22:22 devstack sudo[96191]: pam_unix(sudo:session): session closed for user root Jul 22 03:22:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-7410c57b-7f64-403e-a3fb-cc9c0169da3f tempest-VolumesCloneNegativeTest-1346460266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-06d52bad-cf5e-4f8f-a269-46cb3094fa65 2147483648" returned: 0 in 0.831s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:22:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-7410c57b-7f64-403e-a3fb-cc9c0169da3f tempest-VolumesCloneNegativeTest-1346460266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-06d52bad-cf5e-4f8f-a269-46cb3094fa65 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:22:22 devstack sudo[96203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-06d52bad-cf5e-4f8f-a269-46cb3094fa65 Jul 22 03:22:22 devstack sudo[96203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:22:22 devstack sudo[96202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-76f8ddaa-d64c-4017-b69f-ca776a2c2e07 Jul 22 03:22:22 devstack sudo[96202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:22:22 devstack sudo[96200]: pam_unix(sudo:session): session closed for user root Jul 22 03:22:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.484s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:22:22 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:22:22 devstack cinder-volume[87747]: DEBUG oslo_service.periodic_task [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Running periodic task VolumeManager._thread_info {{(pid=87747) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 03:22:22 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] thread count: 28 {{(pid=87747) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 22 03:22:22 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] thread info: [<_MainThread(MainThread, started 132775275860096)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87747) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 22 03:22:23 devstack sudo[96202]: pam_unix(sudo:session): session closed for user root Jul 22 03:22:23 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [req-ff41dae7-b4f1-4428-a2a6-3556fbd5acb3 req-906d3257-e4db-4080-83e0-3c8ec56eeb24 tempest-TestShelveInstance-1884963064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-76f8ddaa-d64c-4017-b69f-ca776a2c2e07" returned: 0 in 0.682s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:22:23 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [req-ff41dae7-b4f1-4428-a2a6-3556fbd5acb3 req-906d3257-e4db-4080-83e0-3c8ec56eeb24 tempest-TestShelveInstance-1884963064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-76f8ddaa-d64c-4017-b69f-ca776a2c2e07 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:22:23 devstack sudo[96203]: pam_unix(sudo:session): session closed for user root Jul 22 03:22:23 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-7410c57b-7f64-403e-a3fb-cc9c0169da3f tempest-VolumesCloneNegativeTest-1346460266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-06d52bad-cf5e-4f8f-a269-46cb3094fa65" returned: 0 in 0.589s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:22:23 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-7410c57b-7f64-403e-a3fb-cc9c0169da3f tempest-VolumesCloneNegativeTest-1346460266 None] <== create_volume: return (1508ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:22:23 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-7410c57b-7f64-403e-a3fb-cc9c0169da3f tempest-VolumesCloneNegativeTest-1346460266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.512s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:22:23 devstack sudo[96216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-76f8ddaa-d64c-4017-b69f-ca776a2c2e07 Jul 22 03:22:23 devstack sudo[96216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:22:23 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-7410c57b-7f64-403e-a3fb-cc9c0169da3f tempest-VolumesCloneNegativeTest-1346460266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (577995ef-13dc-4e62-8f26-b7f54a79f135) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06d52bad-cf5e-4f8f-a269-46cb3094fa65', 'volume_size': 2}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:22:23 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-7410c57b-7f64-403e-a3fb-cc9c0169da3f tempest-VolumesCloneNegativeTest-1346460266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a858607f-a52f-4cbe-99ec-9e12d29cb1d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:22:23 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-7410c57b-7f64-403e-a3fb-cc9c0169da3f tempest-VolumesCloneNegativeTest-1346460266 None] Volume volume-06d52bad-cf5e-4f8f-a269-46cb3094fa65 (06d52bad-cf5e-4f8f-a269-46cb3094fa65): created successfully Jul 22 03:22:23 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-7410c57b-7f64-403e-a3fb-cc9c0169da3f tempest-VolumesCloneNegativeTest-1346460266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a858607f-a52f-4cbe-99ec-9e12d29cb1d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:22:23 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-7410c57b-7f64-403e-a3fb-cc9c0169da3f tempest-VolumesCloneNegativeTest-1346460266 None] Flow 'volume_create_manager' (66629eaf-e64c-42bd-b1af-b3e8fbb766b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:22:23 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-7410c57b-7f64-403e-a3fb-cc9c0169da3f tempest-VolumesCloneNegativeTest-1346460266 None] Created volume successfully. Jul 22 03:22:23 devstack sudo[96216]: pam_unix(sudo:session): session closed for user root Jul 22 03:22:23 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [req-ff41dae7-b4f1-4428-a2a6-3556fbd5acb3 req-906d3257-e4db-4080-83e0-3c8ec56eeb24 tempest-TestShelveInstance-1884963064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-76f8ddaa-d64c-4017-b69f-ca776a2c2e07" returned: 0 in 0.388s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:22:23 devstack cinder-volume[87747]: DEBUG cinder.coordination [req-ff41dae7-b4f1-4428-a2a6-3556fbd5acb3 req-906d3257-e4db-4080-83e0-3c8ec56eeb24 tempest-TestShelveInstance-1884963064 None] Lock "cinder-quobyte-76f8ddaa-d64c-4017-b69f-ca776a2c2e07" released by "delete_volume" :: held 1.134s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:22:23 devstack cinder-volume[87747]: DEBUG cinder.quota [req-ff41dae7-b4f1-4428-a2a6-3556fbd5acb3 req-906d3257-e4db-4080-83e0-3c8ec56eeb24 tempest-TestShelveInstance-1884963064 None] Created reservations ['7e631bd6-b665-4276-92d5-2826c83fafb0', '5731ec1c-0c97-4c3e-ad7f-a12f3c5c0f0d', '620adf0a-1086-4916-aa19-b715741a83ee', '36893b9a-9a93-4a10-bd11-f4528c237207'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:22:23 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [req-ff41dae7-b4f1-4428-a2a6-3556fbd5acb3 req-906d3257-e4db-4080-83e0-3c8ec56eeb24 tempest-TestShelveInstance-1884963064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:22:23 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [req-ff41dae7-b4f1-4428-a2a6-3556fbd5acb3 req-906d3257-e4db-4080-83e0-3c8ec56eeb24 tempest-TestShelveInstance-1884963064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:22:23 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [req-ff41dae7-b4f1-4428-a2a6-3556fbd5acb3 req-906d3257-e4db-4080-83e0-3c8ec56eeb24 tempest-TestShelveInstance-1884963064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:22:23 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [req-ff41dae7-b4f1-4428-a2a6-3556fbd5acb3 req-906d3257-e4db-4080-83e0-3c8ec56eeb24 tempest-TestShelveInstance-1884963064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:22:23 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [req-ff41dae7-b4f1-4428-a2a6-3556fbd5acb3 req-906d3257-e4db-4080-83e0-3c8ec56eeb24 tempest-TestShelveInstance-1884963064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:22:23 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [req-ff41dae7-b4f1-4428-a2a6-3556fbd5acb3 req-906d3257-e4db-4080-83e0-3c8ec56eeb24 tempest-TestShelveInstance-1884963064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:22:23 devstack sudo[96236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:22:23 devstack sudo[96236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:22:24 devstack sudo[96236]: pam_unix(sudo:session): session closed for user root Jul 22 03:22:24 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [req-ff41dae7-b4f1-4428-a2a6-3556fbd5acb3 req-906d3257-e4db-4080-83e0-3c8ec56eeb24 tempest-TestShelveInstance-1884963064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.406s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:22:24 devstack cinder-volume[87747]: DEBUG cinder.manager [req-ff41dae7-b4f1-4428-a2a6-3556fbd5acb3 req-906d3257-e4db-4080-83e0-3c8ec56eeb24 tempest-TestShelveInstance-1884963064 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:22:24 devstack cinder-volume[87747]: INFO cinder.volume.manager [req-ff41dae7-b4f1-4428-a2a6-3556fbd5acb3 req-906d3257-e4db-4080-83e0-3c8ec56eeb24 tempest-TestShelveInstance-1884963064 None] Deleted volume successfully. Jul 22 03:22:24 devstack cinder-volume[87747]: DEBUG cinder.coordination [req-ff41dae7-b4f1-4428-a2a6-3556fbd5acb3 req-906d3257-e4db-4080-83e0-3c8ec56eeb24 tempest-TestShelveInstance-1884963064 None] Lock "cinder-76f8ddaa-d64c-4017-b69f-ca776a2c2e07-delete_volume" released by "delete_volume" :: held 1.926s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:22:24 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-1e44251e-246e-44f7-97b8-64dbe4b6495b tempest-VolumesCloneNegativeTest-1346460266 None] Acquiring lock "cinder-06d52bad-cf5e-4f8f-a269-46cb3094fa65-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:22:24 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-1e44251e-246e-44f7-97b8-64dbe4b6495b tempest-VolumesCloneNegativeTest-1346460266 None] Lock "cinder-06d52bad-cf5e-4f8f-a269-46cb3094fa65-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:22:24 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-1e44251e-246e-44f7-97b8-64dbe4b6495b tempest-VolumesCloneNegativeTest-1346460266 None] Acquiring lock "cinder-quobyte-06d52bad-cf5e-4f8f-a269-46cb3094fa65" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:22:24 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-1e44251e-246e-44f7-97b8-64dbe4b6495b tempest-VolumesCloneNegativeTest-1346460266 None] Lock "cinder-quobyte-06d52bad-cf5e-4f8f-a269-46cb3094fa65" acquired by "delete_volume" :: waited 0.019s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:22:24 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[a36b5f21-699a-47a7-afad-d4e671c6c245]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:22:24 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-1e44251e-246e-44f7-97b8-64dbe4b6495b tempest-VolumesCloneNegativeTest-1346460266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-06d52bad-cf5e-4f8f-a269-46cb3094fa65 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:22:24 devstack sudo[96240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-06d52bad-cf5e-4f8f-a269-46cb3094fa65 Jul 22 03:22:24 devstack sudo[96240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:22:25 devstack sudo[96240]: pam_unix(sudo:session): session closed for user root Jul 22 03:22:25 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-1e44251e-246e-44f7-97b8-64dbe4b6495b tempest-VolumesCloneNegativeTest-1346460266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-06d52bad-cf5e-4f8f-a269-46cb3094fa65" returned: 0 in 0.456s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:22:25 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-1e44251e-246e-44f7-97b8-64dbe4b6495b tempest-VolumesCloneNegativeTest-1346460266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-06d52bad-cf5e-4f8f-a269-46cb3094fa65 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:22:25 devstack sudo[96247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-06d52bad-cf5e-4f8f-a269-46cb3094fa65 Jul 22 03:22:25 devstack sudo[96247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:22:25 devstack sudo[96247]: pam_unix(sudo:session): session closed for user root Jul 22 03:22:25 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-1e44251e-246e-44f7-97b8-64dbe4b6495b tempest-VolumesCloneNegativeTest-1346460266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-06d52bad-cf5e-4f8f-a269-46cb3094fa65" returned: 0 in 0.307s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:22:25 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-1e44251e-246e-44f7-97b8-64dbe4b6495b tempest-VolumesCloneNegativeTest-1346460266 None] Lock "cinder-quobyte-06d52bad-cf5e-4f8f-a269-46cb3094fa65" released by "delete_volume" :: held 0.822s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:22:25 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-1e44251e-246e-44f7-97b8-64dbe4b6495b tempest-VolumesCloneNegativeTest-1346460266 None] Created reservations ['ccb737e4-1f4f-4a89-8aa8-4910ef0d8ff7', 'e12b454c-8574-4e63-8a1c-ed1af0cfe9a7', 'ac16665b-1fb9-44df-a90f-991b1ce09a8c', '49921957-3526-4732-be67-9691fcfba7ae'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:22:25 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-1e44251e-246e-44f7-97b8-64dbe4b6495b tempest-VolumesCloneNegativeTest-1346460266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:22:25 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-1e44251e-246e-44f7-97b8-64dbe4b6495b tempest-VolumesCloneNegativeTest-1346460266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:22:25 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-1e44251e-246e-44f7-97b8-64dbe4b6495b tempest-VolumesCloneNegativeTest-1346460266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:22:25 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-1e44251e-246e-44f7-97b8-64dbe4b6495b tempest-VolumesCloneNegativeTest-1346460266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:22:25 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-1e44251e-246e-44f7-97b8-64dbe4b6495b tempest-VolumesCloneNegativeTest-1346460266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:22:25 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-1e44251e-246e-44f7-97b8-64dbe4b6495b tempest-VolumesCloneNegativeTest-1346460266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:22:25 devstack sudo[96251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:22:25 devstack sudo[96251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:22:25 devstack sudo[96251]: pam_unix(sudo:session): session closed for user root Jul 22 03:22:25 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-1e44251e-246e-44f7-97b8-64dbe4b6495b tempest-VolumesCloneNegativeTest-1346460266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.415s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:22:25 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-1e44251e-246e-44f7-97b8-64dbe4b6495b tempest-VolumesCloneNegativeTest-1346460266 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:22:26 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-1e44251e-246e-44f7-97b8-64dbe4b6495b tempest-VolumesCloneNegativeTest-1346460266 None] Deleted volume successfully. Jul 22 03:22:26 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-1e44251e-246e-44f7-97b8-64dbe4b6495b tempest-VolumesCloneNegativeTest-1346460266 None] Lock "cinder-06d52bad-cf5e-4f8f-a269-46cb3094fa65-delete_volume" released by "delete_volume" :: held 1.555s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:22:32 devstack cinder-volume[87747]: INFO cinder.volume.manager [req-187aa272-1a9d-42aa-ac55-4209d2a0bd6a req-d830ca92-b7c8-4ac4-8e1c-7ebfdf5af927 tempest-AttachVolumeNegativeTest-443471683 None] Terminate volume connection completed successfully. Jul 22 03:22:32 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [req-187aa272-1a9d-42aa-ac55-4209d2a0bd6a req-d830ca92-b7c8-4ac4-8e1c-7ebfdf5af927 tempest-AttachVolumeNegativeTest-443471683 None] Deleting attachment a0a16c6f-439e-43e6-bc85-0b511b9cdf97. {{(pid=87747) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 22 03:22:42 devstack cinder-volume[87747]: DEBUG dbcounter [-] [87747] Writing DB stats cinder:SELECT=17,cinder:INSERT=8,cinder:UPDATE=23,cinder:DELETE=3 {{(pid=87747) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 03:22:42 devstack cinder-volume[87747]: DEBUG dbcounter [-] [87747] Writing DB stats cinder:UPDATE=30,cinder:SELECT=17,cinder:DELETE=1,cinder:INSERT=5 {{(pid=87747) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 03:22:46 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a313384-4209-4abf-bbb6-32d7c609286d tempest-VolumesSnapshotTestJSON-1822647413 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:22:46 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2a313384-4209-4abf-bbb6-32d7c609286d tempest-VolumesSnapshotTestJSON-1822647413 None] Flow 'volume_create_manager' (0235073a-df36-4377-b0e1-b3c0e08899e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:22:46 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2a313384-4209-4abf-bbb6-32d7c609286d tempest-VolumesSnapshotTestJSON-1822647413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78fde93e-f3ce-49d0-9162-ccfbae3a8aa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:22:46 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2a313384-4209-4abf-bbb6-32d7c609286d tempest-VolumesSnapshotTestJSON-1822647413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78fde93e-f3ce-49d0-9162-ccfbae3a8aa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:22:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-191464666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c84c07e7-b5c3-4aa6-be93-c6f8efc45942,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6166f63d820041daa3dbed33b7b5865e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:22:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:22:46Z,use_quota=True,user_id='d926305a7e4740cd89dcfbca5546f47f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:22:46 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2a313384-4209-4abf-bbb6-32d7c609286d tempest-VolumesSnapshotTestJSON-1822647413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4796ca42-543c-461b-a886-7eeff098eec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:22:46 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2a313384-4209-4abf-bbb6-32d7c609286d tempest-VolumesSnapshotTestJSON-1822647413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4796ca42-543c-461b-a886-7eeff098eec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:22:46 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2a313384-4209-4abf-bbb6-32d7c609286d tempest-VolumesSnapshotTestJSON-1822647413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ac419e8-884e-439c-aee2-c30267c885c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:22:46 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2a313384-4209-4abf-bbb6-32d7c609286d tempest-VolumesSnapshotTestJSON-1822647413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ac419e8-884e-439c-aee2-c30267c885c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c84c07e7-b5c3-4aa6-be93-c6f8efc45942', 'volume_name': 'volume-c84c07e7-b5c3-4aa6-be93-c6f8efc45942', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:22:46 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2a313384-4209-4abf-bbb6-32d7c609286d tempest-VolumesSnapshotTestJSON-1822647413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (248349ed-8ed0-47d7-b9c8-063006eb62eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:22:46 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2a313384-4209-4abf-bbb6-32d7c609286d tempest-VolumesSnapshotTestJSON-1822647413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (248349ed-8ed0-47d7-b9c8-063006eb62eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:22:46 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2a313384-4209-4abf-bbb6-32d7c609286d tempest-VolumesSnapshotTestJSON-1822647413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b396d54-531e-4b11-af30-777cea8d44de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:22:46 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-2a313384-4209-4abf-bbb6-32d7c609286d tempest-VolumesSnapshotTestJSON-1822647413 None] Volume c84c07e7-b5c3-4aa6-be93-c6f8efc45942: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c84c07e7-b5c3-4aa6-be93-c6f8efc45942', 'volume_size': 1} Jul 22 03:22:46 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-2a313384-4209-4abf-bbb6-32d7c609286d tempest-VolumesSnapshotTestJSON-1822647413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:22:46 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-2a313384-4209-4abf-bbb6-32d7c609286d tempest-VolumesSnapshotTestJSON-1822647413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:22:46 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-2a313384-4209-4abf-bbb6-32d7c609286d tempest-VolumesSnapshotTestJSON-1822647413 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:22:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-191464666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c84c07e7-b5c3-4aa6-be93-c6f8efc45942,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6166f63d820041daa3dbed33b7b5865e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:22:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:22:46Z,use_quota=True,user_id='d926305a7e4740cd89dcfbca5546f47f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:22:46 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-2a313384-4209-4abf-bbb6-32d7c609286d tempest-VolumesSnapshotTestJSON-1822647413 None] Creating volume c84c07e7-b5c3-4aa6-be93-c6f8efc45942 {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:22:46 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-2a313384-4209-4abf-bbb6-32d7c609286d tempest-VolumesSnapshotTestJSON-1822647413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:22:46 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-2a313384-4209-4abf-bbb6-32d7c609286d tempest-VolumesSnapshotTestJSON-1822647413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:22:46 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-2a313384-4209-4abf-bbb6-32d7c609286d tempest-VolumesSnapshotTestJSON-1822647413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:22:46 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-2a313384-4209-4abf-bbb6-32d7c609286d tempest-VolumesSnapshotTestJSON-1822647413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:22:46 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-2a313384-4209-4abf-bbb6-32d7c609286d tempest-VolumesSnapshotTestJSON-1822647413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:22:46 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-2a313384-4209-4abf-bbb6-32d7c609286d tempest-VolumesSnapshotTestJSON-1822647413 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:22:46 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-2a313384-4209-4abf-bbb6-32d7c609286d tempest-VolumesSnapshotTestJSON-1822647413 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:22:46 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2a313384-4209-4abf-bbb6-32d7c609286d tempest-VolumesSnapshotTestJSON-1822647413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c84c07e7-b5c3-4aa6-be93-c6f8efc45942 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:22:46 devstack sudo[96332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c84c07e7-b5c3-4aa6-be93-c6f8efc45942 1073741824 Jul 22 03:22:46 devstack sudo[96332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:22:47 devstack sudo[96332]: pam_unix(sudo:session): session closed for user root Jul 22 03:22:47 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2a313384-4209-4abf-bbb6-32d7c609286d tempest-VolumesSnapshotTestJSON-1822647413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c84c07e7-b5c3-4aa6-be93-c6f8efc45942 1073741824" returned: 0 in 0.552s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:22:47 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2a313384-4209-4abf-bbb6-32d7c609286d tempest-VolumesSnapshotTestJSON-1822647413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c84c07e7-b5c3-4aa6-be93-c6f8efc45942 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:22:47 devstack sudo[96338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c84c07e7-b5c3-4aa6-be93-c6f8efc45942 Jul 22 03:22:47 devstack sudo[96338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:22:47 devstack sudo[96338]: pam_unix(sudo:session): session closed for user root Jul 22 03:22:47 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2a313384-4209-4abf-bbb6-32d7c609286d tempest-VolumesSnapshotTestJSON-1822647413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c84c07e7-b5c3-4aa6-be93-c6f8efc45942" returned: 0 in 0.343s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:22:47 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-2a313384-4209-4abf-bbb6-32d7c609286d tempest-VolumesSnapshotTestJSON-1822647413 None] <== create_volume: return (953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:22:47 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-2a313384-4209-4abf-bbb6-32d7c609286d tempest-VolumesSnapshotTestJSON-1822647413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.959s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:22:47 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2a313384-4209-4abf-bbb6-32d7c609286d tempest-VolumesSnapshotTestJSON-1822647413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b396d54-531e-4b11-af30-777cea8d44de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c84c07e7-b5c3-4aa6-be93-c6f8efc45942', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:22:47 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2a313384-4209-4abf-bbb6-32d7c609286d tempest-VolumesSnapshotTestJSON-1822647413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62927675-608b-4cfe-be53-d32631000478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:22:47 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-2a313384-4209-4abf-bbb6-32d7c609286d tempest-VolumesSnapshotTestJSON-1822647413 None] Volume volume-c84c07e7-b5c3-4aa6-be93-c6f8efc45942 (c84c07e7-b5c3-4aa6-be93-c6f8efc45942): created successfully Jul 22 03:22:47 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2a313384-4209-4abf-bbb6-32d7c609286d tempest-VolumesSnapshotTestJSON-1822647413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62927675-608b-4cfe-be53-d32631000478) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:22:47 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2a313384-4209-4abf-bbb6-32d7c609286d tempest-VolumesSnapshotTestJSON-1822647413 None] Flow 'volume_create_manager' (0235073a-df36-4377-b0e1-b3c0e08899e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:22:47 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-2a313384-4209-4abf-bbb6-32d7c609286d tempest-VolumesSnapshotTestJSON-1822647413 None] Created volume successfully. Jul 22 03:22:48 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-ae6e5c18-d2b7-4bbd-b9c6-e4311970f858 tempest-VolumesSnapshotTestJSON-1822647413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:22:48 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-ae6e5c18-d2b7-4bbd-b9c6-e4311970f858 tempest-VolumesSnapshotTestJSON-1822647413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:22:48 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-ae6e5c18-d2b7-4bbd-b9c6-e4311970f858 tempest-VolumesSnapshotTestJSON-1822647413 None] Creating offline snapshot 1d67f81d-b01f-4cdb-8903-71f66c1f638c of volume c84c07e7-b5c3-4aa6-be93-c6f8efc45942 {{(pid=87747) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 03:22:48 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecb6d9fe-f3a3-4313-b351-1c030c1720d9]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:22:48 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ae6e5c18-d2b7-4bbd-b9c6-e4311970f858 tempest-VolumesSnapshotTestJSON-1822647413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c84c07e7-b5c3-4aa6-be93-c6f8efc45942 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:22:49 devstack sudo[96341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c84c07e7-b5c3-4aa6-be93-c6f8efc45942 Jul 22 03:22:49 devstack sudo[96341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:22:49 devstack sudo[96341]: pam_unix(sudo:session): session closed for user root Jul 22 03:22:49 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ae6e5c18-d2b7-4bbd-b9c6-e4311970f858 tempest-VolumesSnapshotTestJSON-1822647413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c84c07e7-b5c3-4aa6-be93-c6f8efc45942" returned: 0 in 0.619s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:22:49 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ae6e5c18-d2b7-4bbd-b9c6-e4311970f858 tempest-VolumesSnapshotTestJSON-1822647413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c84c07e7-b5c3-4aa6-be93-c6f8efc45942,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c84c07e7-b5c3-4aa6-be93-c6f8efc45942.1d67f81d-b01f-4cdb-8903-71f66c1f638c 1G {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:22:49 devstack sudo[96346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c84c07e7-b5c3-4aa6-be93-c6f8efc45942,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c84c07e7-b5c3-4aa6-be93-c6f8efc45942.1d67f81d-b01f-4cdb-8903-71f66c1f638c 1G Jul 22 03:22:49 devstack sudo[96346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:22:50 devstack sudo[96346]: pam_unix(sudo:session): session closed for user root Jul 22 03:22:50 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ae6e5c18-d2b7-4bbd-b9c6-e4311970f858 tempest-VolumesSnapshotTestJSON-1822647413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c84c07e7-b5c3-4aa6-be93-c6f8efc45942,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c84c07e7-b5c3-4aa6-be93-c6f8efc45942.1d67f81d-b01f-4cdb-8903-71f66c1f638c 1G" returned: 0 in 0.670s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:22:50 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ae6e5c18-d2b7-4bbd-b9c6-e4311970f858 tempest-VolumesSnapshotTestJSON-1822647413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c84c07e7-b5c3-4aa6-be93-c6f8efc45942 -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c84c07e7-b5c3-4aa6-be93-c6f8efc45942.1d67f81d-b01f-4cdb-8903-71f66c1f638c {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:22:50 devstack sudo[96352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c84c07e7-b5c3-4aa6-be93-c6f8efc45942 -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c84c07e7-b5c3-4aa6-be93-c6f8efc45942.1d67f81d-b01f-4cdb-8903-71f66c1f638c Jul 22 03:22:50 devstack sudo[96352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:22:50 devstack sudo[96352]: pam_unix(sudo:session): session closed for user root Jul 22 03:22:50 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ae6e5c18-d2b7-4bbd-b9c6-e4311970f858 tempest-VolumesSnapshotTestJSON-1822647413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c84c07e7-b5c3-4aa6-be93-c6f8efc45942 -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c84c07e7-b5c3-4aa6-be93-c6f8efc45942.1d67f81d-b01f-4cdb-8903-71f66c1f638c" returned: 0 in 0.395s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:22:50 devstack cinder-volume[87747]: WARNING cinder.volume.drivers.remotefs [None req-ae6e5c18-d2b7-4bbd-b9c6-e4311970f858 tempest-VolumesSnapshotTestJSON-1822647413 None] /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c84c07e7-b5c3-4aa6-be93-c6f8efc45942.1d67f81d-b01f-4cdb-8903-71f66c1f638c is being set with open permissions: ugo+rw Jul 22 03:22:50 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ae6e5c18-d2b7-4bbd-b9c6-e4311970f858 tempest-VolumesSnapshotTestJSON-1822647413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c84c07e7-b5c3-4aa6-be93-c6f8efc45942.1d67f81d-b01f-4cdb-8903-71f66c1f638c {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:22:50 devstack sudo[96358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c84c07e7-b5c3-4aa6-be93-c6f8efc45942.1d67f81d-b01f-4cdb-8903-71f66c1f638c Jul 22 03:22:50 devstack sudo[96358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:22:50 devstack sudo[96358]: pam_unix(sudo:session): session closed for user root Jul 22 03:22:50 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ae6e5c18-d2b7-4bbd-b9c6-e4311970f858 tempest-VolumesSnapshotTestJSON-1822647413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c84c07e7-b5c3-4aa6-be93-c6f8efc45942.1d67f81d-b01f-4cdb-8903-71f66c1f638c" returned: 0 in 0.419s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:22:51 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ae6e5c18-d2b7-4bbd-b9c6-e4311970f858 tempest-VolumesSnapshotTestJSON-1822647413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c84c07e7-b5c3-4aa6-be93-c6f8efc45942.info {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:22:51 devstack sudo[96361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c84c07e7-b5c3-4aa6-be93-c6f8efc45942.info Jul 22 03:22:51 devstack sudo[96361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:22:51 devstack sudo[96361]: pam_unix(sudo:session): session closed for user root Jul 22 03:22:51 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ae6e5c18-d2b7-4bbd-b9c6-e4311970f858 tempest-VolumesSnapshotTestJSON-1822647413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c84c07e7-b5c3-4aa6-be93-c6f8efc45942.info" returned: 0 in 0.338s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:22:51 devstack cinder-volume[87747]: WARNING cinder.volume.drivers.remotefs [None req-ae6e5c18-d2b7-4bbd-b9c6-e4311970f858 tempest-VolumesSnapshotTestJSON-1822647413 None] /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c84c07e7-b5c3-4aa6-be93-c6f8efc45942.info is being set with open permissions: ugo+rw Jul 22 03:22:51 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ae6e5c18-d2b7-4bbd-b9c6-e4311970f858 tempest-VolumesSnapshotTestJSON-1822647413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c84c07e7-b5c3-4aa6-be93-c6f8efc45942.info {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:22:51 devstack sudo[96364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c84c07e7-b5c3-4aa6-be93-c6f8efc45942.info Jul 22 03:22:51 devstack sudo[96364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:22:51 devstack sudo[96364]: pam_unix(sudo:session): session closed for user root Jul 22 03:22:51 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ae6e5c18-d2b7-4bbd-b9c6-e4311970f858 tempest-VolumesSnapshotTestJSON-1822647413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c84c07e7-b5c3-4aa6-be93-c6f8efc45942.info" returned: 0 in 0.345s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:22:51 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-ae6e5c18-d2b7-4bbd-b9c6-e4311970f858 tempest-VolumesSnapshotTestJSON-1822647413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.939s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:22:51 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-ae6e5c18-d2b7-4bbd-b9c6-e4311970f858 tempest-VolumesSnapshotTestJSON-1822647413 None] Create snapshot completed successfully Jul 22 03:22:52 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-2f7e7200-4365-4213-96ff-6bb171f1b356 tempest-VolumesSnapshotTestJSON-1822647413 None] Acquiring lock "cinder-1d67f81d-b01f-4cdb-8903-71f66c1f638c-delete_snapshot" by "delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:22:52 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-2f7e7200-4365-4213-96ff-6bb171f1b356 tempest-VolumesSnapshotTestJSON-1822647413 None] Lock "cinder-1d67f81d-b01f-4cdb-8903-71f66c1f638c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:22:52 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-2f7e7200-4365-4213-96ff-6bb171f1b356 tempest-VolumesSnapshotTestJSON-1822647413 None] Acquiring lock "cinder-quobyte-c84c07e7-b5c3-4aa6-be93-c6f8efc45942" by "delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:22:52 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-2f7e7200-4365-4213-96ff-6bb171f1b356 tempest-VolumesSnapshotTestJSON-1822647413 None] Lock "cinder-quobyte-c84c07e7-b5c3-4aa6-be93-c6f8efc45942" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:22:52 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-2f7e7200-4365-4213-96ff-6bb171f1b356 tempest-VolumesSnapshotTestJSON-1822647413 None] Acquiring lock "cinder-quobyte-1d67f81d-b01f-4cdb-8903-71f66c1f638c" by "_delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:22:52 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-2f7e7200-4365-4213-96ff-6bb171f1b356 tempest-VolumesSnapshotTestJSON-1822647413 None] Lock "cinder-quobyte-1d67f81d-b01f-4cdb-8903-71f66c1f638c" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:22:52 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-2f7e7200-4365-4213-96ff-6bb171f1b356 tempest-VolumesSnapshotTestJSON-1822647413 None] Deleting offline snapshot 1d67f81d-b01f-4cdb-8903-71f66c1f638c of volume c84c07e7-b5c3-4aa6-be93-c6f8efc45942 {{(pid=87747) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 03:22:52 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-2f7e7200-4365-4213-96ff-6bb171f1b356 tempest-VolumesSnapshotTestJSON-1822647413 None] snapshot_file for this snap is: volume-c84c07e7-b5c3-4aa6-be93-c6f8efc45942.1d67f81d-b01f-4cdb-8903-71f66c1f638c {{(pid=87747) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 03:22:52 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b338e4-96e7-4d15-b7de-1db1bab4c366]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:22:52 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2f7e7200-4365-4213-96ff-6bb171f1b356 tempest-VolumesSnapshotTestJSON-1822647413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c84c07e7-b5c3-4aa6-be93-c6f8efc45942.1d67f81d-b01f-4cdb-8903-71f66c1f638c {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:22:52 devstack sudo[96370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c84c07e7-b5c3-4aa6-be93-c6f8efc45942.1d67f81d-b01f-4cdb-8903-71f66c1f638c Jul 22 03:22:52 devstack sudo[96370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:22:52 devstack sudo[96370]: pam_unix(sudo:session): session closed for user root Jul 22 03:22:52 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2f7e7200-4365-4213-96ff-6bb171f1b356 tempest-VolumesSnapshotTestJSON-1822647413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c84c07e7-b5c3-4aa6-be93-c6f8efc45942.1d67f81d-b01f-4cdb-8903-71f66c1f638c" returned: 0 in 0.429s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:22:52 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-2f7e7200-4365-4213-96ff-6bb171f1b356 tempest-VolumesSnapshotTestJSON-1822647413 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c84c07e7-b5c3-4aa6-be93-c6f8efc45942(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87747) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 03:22:52 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[071edb7d-f7db-41b6-8e1c-fb17de305a7f]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:22:52 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2f7e7200-4365-4213-96ff-6bb171f1b356 tempest-VolumesSnapshotTestJSON-1822647413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c84c07e7-b5c3-4aa6-be93-c6f8efc45942 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:22:52 devstack sudo[96376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c84c07e7-b5c3-4aa6-be93-c6f8efc45942 Jul 22 03:22:52 devstack sudo[96376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:22:53 devstack sudo[96376]: pam_unix(sudo:session): session closed for user root Jul 22 03:22:53 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2f7e7200-4365-4213-96ff-6bb171f1b356 tempest-VolumesSnapshotTestJSON-1822647413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c84c07e7-b5c3-4aa6-be93-c6f8efc45942" returned: 0 in 0.560s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:22:53 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2f7e7200-4365-4213-96ff-6bb171f1b356 tempest-VolumesSnapshotTestJSON-1822647413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c84c07e7-b5c3-4aa6-be93-c6f8efc45942.1d67f81d-b01f-4cdb-8903-71f66c1f638c {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:22:53 devstack sudo[96382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c84c07e7-b5c3-4aa6-be93-c6f8efc45942.1d67f81d-b01f-4cdb-8903-71f66c1f638c Jul 22 03:22:53 devstack sudo[96382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:22:53 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca620232-57ec-473d-8acf-95d675a025ae tempest-VolumeImageDependencyTests-828371924 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:22:53 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-ca620232-57ec-473d-8acf-95d675a025ae tempest-VolumeImageDependencyTests-828371924 None] Flow 'volume_create_manager' (26187386-2be0-4e76-a155-705b243cf04b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:22:53 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-ca620232-57ec-473d-8acf-95d675a025ae tempest-VolumeImageDependencyTests-828371924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (636549bb-6a44-4e14-b89d-964c8d5ec2f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:22:53 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-ca620232-57ec-473d-8acf-95d675a025ae tempest-VolumeImageDependencyTests-828371924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (636549bb-6a44-4e14-b89d-964c8d5ec2f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:22:53Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbc8d38b-63b0-4d86-8ffd-77b6ea74502f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad914ffab3c44abaac47bf427532462f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:22:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:22:53Z,use_quota=True,user_id='d2b63464233f4e59be3df28f4c029b3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:22:53 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-ca620232-57ec-473d-8acf-95d675a025ae tempest-VolumeImageDependencyTests-828371924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f378a4bb-08ea-49e0-9bae-d8ba8bf719b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:22:53 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-ca620232-57ec-473d-8acf-95d675a025ae tempest-VolumeImageDependencyTests-828371924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f378a4bb-08ea-49e0-9bae-d8ba8bf719b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:22:53 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-ca620232-57ec-473d-8acf-95d675a025ae tempest-VolumeImageDependencyTests-828371924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (685b5617-bcd7-46c3-a5b8-6a955787a3d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:22:53 devstack cinder-volume[87747]: DEBUG cinder.image.glance [None req-ca620232-57ec-473d-8acf-95d675a025ae tempest-VolumeImageDependencyTests-828371924 None] Creating Keystone auth plugin from conf {{(pid=87747) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 22 03:22:53 devstack sudo[96382]: pam_unix(sudo:session): session closed for user root Jul 22 03:22:53 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2f7e7200-4365-4213-96ff-6bb171f1b356 tempest-VolumesSnapshotTestJSON-1822647413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c84c07e7-b5c3-4aa6-be93-c6f8efc45942.1d67f81d-b01f-4cdb-8903-71f66c1f638c" returned: 0 in 0.556s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:22:53 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2f7e7200-4365-4213-96ff-6bb171f1b356 tempest-VolumesSnapshotTestJSON-1822647413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c84c07e7-b5c3-4aa6-be93-c6f8efc45942.1d67f81d-b01f-4cdb-8903-71f66c1f638c {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:22:54 devstack sudo[96388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c84c07e7-b5c3-4aa6-be93-c6f8efc45942.1d67f81d-b01f-4cdb-8903-71f66c1f638c Jul 22 03:22:54 devstack sudo[96388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:22:54 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-ca620232-57ec-473d-8acf-95d675a025ae tempest-VolumeImageDependencyTests-828371924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (685b5617-bcd7-46c3-a5b8-6a955787a3d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'dbc8d38b-63b0-4d86-8ffd-77b6ea74502f', 'volume_name': 'volume-dbc8d38b-63b0-4d86-8ffd-77b6ea74502f', 'volume_size': 1, 'image_id': '130086e1-798c-440b-828a-e04853122616', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/130086e1-798c-440b-828a-e04853122616', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '49ad19ad2ff6d0d89ec6a07c5ea68fc9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ad914ffab3c44abaac47bf427532462f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b5b630d70c7bd441863efe577d7ff992532cdb9c2288306d120428877b58c727a5d35600bd6a15ee77a3950662f95212ea4259adb0b287784943b1e8ccd5ace6', 'id': '130086e1-798c-440b-828a-e04853122616', 'created_at': datetime.datetime(2026, 7, 22, 1, 22, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 22, 1, 22, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/130086e1-798c-440b-828a-e04853122616/file', 'properties': {}}, 'image_service': }' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:22:54 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-ca620232-57ec-473d-8acf-95d675a025ae tempest-VolumeImageDependencyTests-828371924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0ec7bf1-de18-401b-bca1-096c31473343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:22:54 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-ca620232-57ec-473d-8acf-95d675a025ae tempest-VolumeImageDependencyTests-828371924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0ec7bf1-de18-401b-bca1-096c31473343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:22:54 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-ca620232-57ec-473d-8acf-95d675a025ae tempest-VolumeImageDependencyTests-828371924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0b3a162-41f4-482c-a2c6-9ad8979d1ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:22:54 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-ca620232-57ec-473d-8acf-95d675a025ae tempest-VolumeImageDependencyTests-828371924 None] Volume dbc8d38b-63b0-4d86-8ffd-77b6ea74502f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-dbc8d38b-63b0-4d86-8ffd-77b6ea74502f', 'volume_size': 1, 'image_id': '130086e1-798c-440b-828a-e04853122616', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/130086e1-798c-440b-828a-e04853122616', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '49ad19ad2ff6d0d89ec6a07c5ea68fc9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ad914ffab3c44abaac47bf427532462f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b5b630d70c7bd441863efe577d7ff992532cdb9c2288306d120428877b58c727a5d35600bd6a15ee77a3950662f95212ea4259adb0b287784943b1e8ccd5ace6', 'id': '130086e1-798c-440b-828a-e04853122616', 'created_at': datetime.datetime(2026, 7, 22, 1, 22, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 22, 1, 22, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/130086e1-798c-440b-828a-e04853122616/file', 'properties': {}}, 'image_service': } Jul 22 03:22:54 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca620232-57ec-473d-8acf-95d675a025ae tempest-VolumeImageDependencyTests-828371924 None] Trying to clone dbc8d38b-63b0-4d86-8ffd-77b6ea74502f from image 130086e1-798c-440b-828a-e04853122616 at location (None, [{'url': 'file:///opt/stack/data/glance/images/130086e1-798c-440b-828a-e04853122616', 'metadata': {}}]). {{(pid=87747) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 22 03:22:54 devstack cinder-volume[87747]: DEBUG cinder.image.image_utils [None req-ca620232-57ec-473d-8acf-95d675a025ae tempest-VolumeImageDependencyTests-828371924 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_130086e1-798c-440b-828a-e04853122616_iu3q18g7devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87747) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 22 03:22:54 devstack cinder-volume[87747]: INFO cinder.image.image_utils [None req-ca620232-57ec-473d-8acf-95d675a025ae tempest-VolumeImageDependencyTests-828371924 None] Image download 0.00 MB at 0.00 MB/s Jul 22 03:22:54 devstack sudo[96388]: pam_unix(sudo:session): session closed for user root Jul 22 03:22:54 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2f7e7200-4365-4213-96ff-6bb171f1b356 tempest-VolumesSnapshotTestJSON-1822647413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c84c07e7-b5c3-4aa6-be93-c6f8efc45942.1d67f81d-b01f-4cdb-8903-71f66c1f638c" returned: 0 in 0.348s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:22:54 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b87023e-5577-4744-921a-ded02fe5e1af]: (4, 'raw') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:22:54 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ca620232-57ec-473d-8acf-95d675a025ae tempest-VolumeImageDependencyTests-828371924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_130086e1-798c-440b-828a-e04853122616_iu3q18g7devstack@QuobyteHD {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:22:54 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-2f7e7200-4365-4213-96ff-6bb171f1b356 tempest-VolumesSnapshotTestJSON-1822647413 None] Lock "cinder-quobyte-1d67f81d-b01f-4cdb-8903-71f66c1f638c" released by "_delete_snapshot" :: held 2.086s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:22:54 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-2f7e7200-4365-4213-96ff-6bb171f1b356 tempest-VolumesSnapshotTestJSON-1822647413 None] Lock "cinder-quobyte-c84c07e7-b5c3-4aa6-be93-c6f8efc45942" released by "delete_snapshot" :: held 2.117s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:22:54 devstack sudo[96399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_130086e1-798c-440b-828a-e04853122616_iu3q18g7devstack@QuobyteHD Jul 22 03:22:54 devstack sudo[96399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:22:54 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-2f7e7200-4365-4213-96ff-6bb171f1b356 tempest-VolumesSnapshotTestJSON-1822647413 None] Created reservations ['a25e24ba-0cbc-4a13-82f3-2a4a2b5189c7', '457ae410-91cd-471d-8952-c0489e9e8a0e', 'f61aef4e-cd36-4ef1-811c-370f2442ad56', 'd4ea1647-b410-4363-8b9a-284a68a4beb5'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:22:54 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-2f7e7200-4365-4213-96ff-6bb171f1b356 tempest-VolumesSnapshotTestJSON-1822647413 None] Delete snapshot completed successfully. Jul 22 03:22:54 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-2f7e7200-4365-4213-96ff-6bb171f1b356 tempest-VolumesSnapshotTestJSON-1822647413 None] Lock "cinder-1d67f81d-b01f-4cdb-8903-71f66c1f638c-delete_snapshot" released by "delete_snapshot" :: held 2.494s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:22:54 devstack sudo[96399]: pam_unix(sudo:session): session closed for user root Jul 22 03:22:54 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ca620232-57ec-473d-8acf-95d675a025ae tempest-VolumeImageDependencyTests-828371924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_130086e1-798c-440b-828a-e04853122616_iu3q18g7devstack@QuobyteHD" returned: 0 in 0.574s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:22:54 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ca620232-57ec-473d-8acf-95d675a025ae tempest-VolumeImageDependencyTests-828371924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_130086e1-798c-440b-828a-e04853122616_iu3q18g7devstack@QuobyteHD {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:22:55 devstack sudo[96409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_130086e1-798c-440b-828a-e04853122616_iu3q18g7devstack@QuobyteHD Jul 22 03:22:55 devstack sudo[96409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:22:55 devstack sudo[96409]: pam_unix(sudo:session): session closed for user root Jul 22 03:22:55 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ca620232-57ec-473d-8acf-95d675a025ae tempest-VolumeImageDependencyTests-828371924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_130086e1-798c-440b-828a-e04853122616_iu3q18g7devstack@QuobyteHD" returned: 1 in 0.357s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:22:55 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ca620232-57ec-473d-8acf-95d675a025ae tempest-VolumeImageDependencyTests-828371924 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_130086e1-798c-440b-828a-e04853122616_iu3q18g7devstack@QuobyteHD' failed. Not Retrying. {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 22 03:22:55 devstack cinder-volume[87747]: DEBUG cinder.image.image_utils [None req-ca620232-57ec-473d-8acf-95d675a025ae tempest-VolumeImageDependencyTests-828371924 None] Temporary image 130086e1-798c-440b-828a-e04853122616 is fetched for user d2b63464233f4e59be3df28f4c029b3e. {{(pid=87747) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 22 03:22:55 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fb754aa-4c6b-4b38-9e60-a92ae52704dd]: (4, 'raw') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:22:55 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ca620232-57ec-473d-8acf-95d675a025ae tempest-VolumeImageDependencyTests-828371924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_130086e1-798c-440b-828a-e04853122616_iu3q18g7devstack@QuobyteHD {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:22:55 devstack sudo[96414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_130086e1-798c-440b-828a-e04853122616_iu3q18g7devstack@QuobyteHD Jul 22 03:22:55 devstack sudo[96414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:22:55 devstack sudo[96414]: pam_unix(sudo:session): session closed for user root Jul 22 03:22:55 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ca620232-57ec-473d-8acf-95d675a025ae tempest-VolumeImageDependencyTests-828371924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_130086e1-798c-440b-828a-e04853122616_iu3q18g7devstack@QuobyteHD" returned: 0 in 0.431s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:22:55 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ca620232-57ec-473d-8acf-95d675a025ae tempest-VolumeImageDependencyTests-828371924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_130086e1-798c-440b-828a-e04853122616_iu3q18g7devstack@QuobyteHD {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:22:55 devstack sudo[96418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_130086e1-798c-440b-828a-e04853122616_iu3q18g7devstack@QuobyteHD Jul 22 03:22:55 devstack sudo[96418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:22:56 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcb4992d-6b9b-48ff-b01a-4e1521a2468a tempest-VolumesSnapshotTestJSON-1822647413 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:22:56 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-dcb4992d-6b9b-48ff-b01a-4e1521a2468a tempest-VolumesSnapshotTestJSON-1822647413 None] Flow 'volume_create_manager' (807a7fb4-8f25-4255-b1f1-9c5835dc5d85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:22:56 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-dcb4992d-6b9b-48ff-b01a-4e1521a2468a tempest-VolumesSnapshotTestJSON-1822647413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30357ba0-716b-4f82-b9c7-2c16cfe24902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:22:56 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-dcb4992d-6b9b-48ff-b01a-4e1521a2468a tempest-VolumesSnapshotTestJSON-1822647413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30357ba0-716b-4f82-b9c7-2c16cfe24902) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:22:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-6160485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f096da6-6b62-46a1-9dd5-206f57e9114e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6166f63d820041daa3dbed33b7b5865e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:22:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:22:56Z,use_quota=True,user_id='d926305a7e4740cd89dcfbca5546f47f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:22:56 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-dcb4992d-6b9b-48ff-b01a-4e1521a2468a tempest-VolumesSnapshotTestJSON-1822647413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51b22837-9d25-4095-8e48-abe9e7a05cac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:22:56 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-dcb4992d-6b9b-48ff-b01a-4e1521a2468a tempest-VolumesSnapshotTestJSON-1822647413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51b22837-9d25-4095-8e48-abe9e7a05cac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:22:56 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-dcb4992d-6b9b-48ff-b01a-4e1521a2468a tempest-VolumesSnapshotTestJSON-1822647413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1946ebd5-d110-4506-8090-ba68678d474c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:22:56 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-dcb4992d-6b9b-48ff-b01a-4e1521a2468a tempest-VolumesSnapshotTestJSON-1822647413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1946ebd5-d110-4506-8090-ba68678d474c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f096da6-6b62-46a1-9dd5-206f57e9114e', 'volume_name': 'volume-4f096da6-6b62-46a1-9dd5-206f57e9114e', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:22:56 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-dcb4992d-6b9b-48ff-b01a-4e1521a2468a tempest-VolumesSnapshotTestJSON-1822647413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ae3a829-5d97-4295-bb59-3c4f5c11755b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:22:56 devstack sudo[96418]: pam_unix(sudo:session): session closed for user root Jul 22 03:22:56 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-dcb4992d-6b9b-48ff-b01a-4e1521a2468a tempest-VolumesSnapshotTestJSON-1822647413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ae3a829-5d97-4295-bb59-3c4f5c11755b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:22:56 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-dcb4992d-6b9b-48ff-b01a-4e1521a2468a tempest-VolumesSnapshotTestJSON-1822647413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0aa7180-96c1-4e9e-9c65-80e3879b4cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:22:56 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-dcb4992d-6b9b-48ff-b01a-4e1521a2468a tempest-VolumesSnapshotTestJSON-1822647413 None] Volume 4f096da6-6b62-46a1-9dd5-206f57e9114e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f096da6-6b62-46a1-9dd5-206f57e9114e', 'volume_size': 1} Jul 22 03:22:56 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-dcb4992d-6b9b-48ff-b01a-4e1521a2468a tempest-VolumesSnapshotTestJSON-1822647413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:22:56 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-dcb4992d-6b9b-48ff-b01a-4e1521a2468a tempest-VolumesSnapshotTestJSON-1822647413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:22:56 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-dcb4992d-6b9b-48ff-b01a-4e1521a2468a tempest-VolumesSnapshotTestJSON-1822647413 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:22:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-6160485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f096da6-6b62-46a1-9dd5-206f57e9114e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6166f63d820041daa3dbed33b7b5865e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:22:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:22:56Z,use_quota=True,user_id='d926305a7e4740cd89dcfbca5546f47f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:22:56 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-dcb4992d-6b9b-48ff-b01a-4e1521a2468a tempest-VolumesSnapshotTestJSON-1822647413 None] Creating volume 4f096da6-6b62-46a1-9dd5-206f57e9114e {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:22:56 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-dcb4992d-6b9b-48ff-b01a-4e1521a2468a tempest-VolumesSnapshotTestJSON-1822647413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:22:56 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-dcb4992d-6b9b-48ff-b01a-4e1521a2468a tempest-VolumesSnapshotTestJSON-1822647413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:22:56 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-dcb4992d-6b9b-48ff-b01a-4e1521a2468a tempest-VolumesSnapshotTestJSON-1822647413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:22:56 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-dcb4992d-6b9b-48ff-b01a-4e1521a2468a tempest-VolumesSnapshotTestJSON-1822647413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:22:56 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-dcb4992d-6b9b-48ff-b01a-4e1521a2468a tempest-VolumesSnapshotTestJSON-1822647413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:22:56 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-dcb4992d-6b9b-48ff-b01a-4e1521a2468a tempest-VolumesSnapshotTestJSON-1822647413 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:22:56 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-dcb4992d-6b9b-48ff-b01a-4e1521a2468a tempest-VolumesSnapshotTestJSON-1822647413 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:22:56 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-dcb4992d-6b9b-48ff-b01a-4e1521a2468a tempest-VolumesSnapshotTestJSON-1822647413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4f096da6-6b62-46a1-9dd5-206f57e9114e 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:22:56 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ca620232-57ec-473d-8acf-95d675a025ae tempest-VolumeImageDependencyTests-828371924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_130086e1-798c-440b-828a-e04853122616_iu3q18g7devstack@QuobyteHD" returned: 1 in 0.587s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:22:56 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ca620232-57ec-473d-8acf-95d675a025ae tempest-VolumeImageDependencyTests-828371924 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_130086e1-798c-440b-828a-e04853122616_iu3q18g7devstack@QuobyteHD' failed. Not Retrying. {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 22 03:22:56 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-ca620232-57ec-473d-8acf-95d675a025ae tempest-VolumeImageDependencyTests-828371924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:22:56 devstack sudo[96425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4f096da6-6b62-46a1-9dd5-206f57e9114e 1073741824 Jul 22 03:22:56 devstack sudo[96425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:22:56 devstack sudo[96425]: pam_unix(sudo:session): session closed for user root Jul 22 03:22:56 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-dcb4992d-6b9b-48ff-b01a-4e1521a2468a tempest-VolumesSnapshotTestJSON-1822647413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4f096da6-6b62-46a1-9dd5-206f57e9114e 1073741824" returned: 0 in 0.571s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:22:57 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-dcb4992d-6b9b-48ff-b01a-4e1521a2468a tempest-VolumesSnapshotTestJSON-1822647413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4f096da6-6b62-46a1-9dd5-206f57e9114e {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:22:57 devstack sudo[96443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4f096da6-6b62-46a1-9dd5-206f57e9114e Jul 22 03:22:57 devstack sudo[96443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:22:57 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9c4da74-0c5b-4d69-845d-3a1f217fbc67 tempest-TestInstancesWithCinderVolumes-1475916076 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:22:57 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-d9c4da74-0c5b-4d69-845d-3a1f217fbc67 tempest-TestInstancesWithCinderVolumes-1475916076 None] Flow 'volume_create_manager' (43b4e8eb-326d-4da2-8c3a-9f4254b5a6a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:22:57 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-d9c4da74-0c5b-4d69-845d-3a1f217fbc67 tempest-TestInstancesWithCinderVolumes-1475916076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dd8307a-7163-491b-b318-4ce12c394f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:22:57 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-d9c4da74-0c5b-4d69-845d-3a1f217fbc67 tempest-TestInstancesWithCinderVolumes-1475916076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dd8307a-7163-491b-b318-4ce12c394f34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:22:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-726956546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45e0a249-97f8-4eef-8f91-d1c9a742fbb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='419f02238ed0422085fef0c6f4fbb409',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:22:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:22:57Z,use_quota=True,user_id='2274af5c76d6400383d38c16933e1c74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1781df21-851c-47ac-8690-44d43076ddbf),volume_type_id=1781df21-851c-47ac-8690-44d43076ddbf)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:22:57 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-d9c4da74-0c5b-4d69-845d-3a1f217fbc67 tempest-TestInstancesWithCinderVolumes-1475916076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (654f4273-6e06-4bb1-8838-76b128c44d49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:22:57 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-d9c4da74-0c5b-4d69-845d-3a1f217fbc67 tempest-TestInstancesWithCinderVolumes-1475916076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (654f4273-6e06-4bb1-8838-76b128c44d49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:22:57 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-d9c4da74-0c5b-4d69-845d-3a1f217fbc67 tempest-TestInstancesWithCinderVolumes-1475916076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53ae0d02-3782-42d0-909e-aff230c49ef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:22:57 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-d9c4da74-0c5b-4d69-845d-3a1f217fbc67 tempest-TestInstancesWithCinderVolumes-1475916076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53ae0d02-3782-42d0-909e-aff230c49ef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45e0a249-97f8-4eef-8f91-d1c9a742fbb0', 'volume_name': 'volume-45e0a249-97f8-4eef-8f91-d1c9a742fbb0', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:22:57 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-d9c4da74-0c5b-4d69-845d-3a1f217fbc67 tempest-TestInstancesWithCinderVolumes-1475916076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (578ed206-f52b-4ecb-b634-2d61703344c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:22:57 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-d9c4da74-0c5b-4d69-845d-3a1f217fbc67 tempest-TestInstancesWithCinderVolumes-1475916076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (578ed206-f52b-4ecb-b634-2d61703344c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:22:57 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-d9c4da74-0c5b-4d69-845d-3a1f217fbc67 tempest-TestInstancesWithCinderVolumes-1475916076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6920aa8-2bfe-4d8c-b4a0-82e6c6c8a6d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:22:57 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-d9c4da74-0c5b-4d69-845d-3a1f217fbc67 tempest-TestInstancesWithCinderVolumes-1475916076 None] Volume 45e0a249-97f8-4eef-8f91-d1c9a742fbb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45e0a249-97f8-4eef-8f91-d1c9a742fbb0', 'volume_size': 1} Jul 22 03:22:57 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-d9c4da74-0c5b-4d69-845d-3a1f217fbc67 tempest-TestInstancesWithCinderVolumes-1475916076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:22:57 devstack sudo[96443]: pam_unix(sudo:session): session closed for user root Jul 22 03:22:57 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-dcb4992d-6b9b-48ff-b01a-4e1521a2468a tempest-VolumesSnapshotTestJSON-1822647413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4f096da6-6b62-46a1-9dd5-206f57e9114e" returned: 0 in 0.587s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:22:57 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-dcb4992d-6b9b-48ff-b01a-4e1521a2468a tempest-VolumesSnapshotTestJSON-1822647413 None] <== create_volume: return (1289ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:22:57 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-dcb4992d-6b9b-48ff-b01a-4e1521a2468a tempest-VolumesSnapshotTestJSON-1822647413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.292s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:22:57 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-ca620232-57ec-473d-8acf-95d675a025ae tempest-VolumeImageDependencyTests-828371924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.276s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:22:57 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-ca620232-57ec-473d-8acf-95d675a025ae tempest-VolumeImageDependencyTests-828371924 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:22:53Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbc8d38b-63b0-4d86-8ffd-77b6ea74502f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad914ffab3c44abaac47bf427532462f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:22:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:22:53Z,use_quota=True,user_id='d2b63464233f4e59be3df28f4c029b3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:22:57 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-ca620232-57ec-473d-8acf-95d675a025ae tempest-VolumeImageDependencyTests-828371924 None] Creating volume dbc8d38b-63b0-4d86-8ffd-77b6ea74502f {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:22:57 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-ca620232-57ec-473d-8acf-95d675a025ae tempest-VolumeImageDependencyTests-828371924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:22:57 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-ca620232-57ec-473d-8acf-95d675a025ae tempest-VolumeImageDependencyTests-828371924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:22:57 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-ca620232-57ec-473d-8acf-95d675a025ae tempest-VolumeImageDependencyTests-828371924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:22:57 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-ca620232-57ec-473d-8acf-95d675a025ae tempest-VolumeImageDependencyTests-828371924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:22:57 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-ca620232-57ec-473d-8acf-95d675a025ae tempest-VolumeImageDependencyTests-828371924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:22:57 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-ca620232-57ec-473d-8acf-95d675a025ae tempest-VolumeImageDependencyTests-828371924 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:22:57 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-ca620232-57ec-473d-8acf-95d675a025ae tempest-VolumeImageDependencyTests-828371924 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:22:57 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ca620232-57ec-473d-8acf-95d675a025ae tempest-VolumeImageDependencyTests-828371924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-dbc8d38b-63b0-4d86-8ffd-77b6ea74502f 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:22:57 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-dcb4992d-6b9b-48ff-b01a-4e1521a2468a tempest-VolumesSnapshotTestJSON-1822647413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0aa7180-96c1-4e9e-9c65-80e3879b4cec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f096da6-6b62-46a1-9dd5-206f57e9114e', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:22:57 devstack sudo[96487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-dbc8d38b-63b0-4d86-8ffd-77b6ea74502f 1073741824 Jul 22 03:22:57 devstack sudo[96487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:22:57 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-dcb4992d-6b9b-48ff-b01a-4e1521a2468a tempest-VolumesSnapshotTestJSON-1822647413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab067ab1-d069-4da6-9d47-5cba82cb0022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:22:57 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-dcb4992d-6b9b-48ff-b01a-4e1521a2468a tempest-VolumesSnapshotTestJSON-1822647413 None] Volume volume-4f096da6-6b62-46a1-9dd5-206f57e9114e (4f096da6-6b62-46a1-9dd5-206f57e9114e): created successfully Jul 22 03:22:57 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-dcb4992d-6b9b-48ff-b01a-4e1521a2468a tempest-VolumesSnapshotTestJSON-1822647413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab067ab1-d069-4da6-9d47-5cba82cb0022) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:22:57 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-dcb4992d-6b9b-48ff-b01a-4e1521a2468a tempest-VolumesSnapshotTestJSON-1822647413 None] Flow 'volume_create_manager' (807a7fb4-8f25-4255-b1f1-9c5835dc5d85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:22:57 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f86c053-e125-4c75-a5c3-fa03f115d6ec tempest-TestInstancesWithCinderVolumes-1475916076 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:22:58 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-4f86c053-e125-4c75-a5c3-fa03f115d6ec tempest-TestInstancesWithCinderVolumes-1475916076 None] Flow 'volume_create_manager' (fe2f593d-675b-471e-a4ab-9891ef69b6dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:22:58 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-4f86c053-e125-4c75-a5c3-fa03f115d6ec tempest-TestInstancesWithCinderVolumes-1475916076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7014504d-8228-4533-8df7-5680f249a62a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:22:58 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-dcb4992d-6b9b-48ff-b01a-4e1521a2468a tempest-VolumesSnapshotTestJSON-1822647413 None] Created volume successfully. Jul 22 03:22:58 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-4f86c053-e125-4c75-a5c3-fa03f115d6ec tempest-TestInstancesWithCinderVolumes-1475916076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7014504d-8228-4533-8df7-5680f249a62a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:22:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-599418195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=872a1498-bc9f-4ac5-9f4d-ae3a1cb3cb0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='419f02238ed0422085fef0c6f4fbb409',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:22:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:22:58Z,use_quota=True,user_id='2274af5c76d6400383d38c16933e1c74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eb12baf-436d-4eae-8790-1f541991fbab),volume_type_id=5eb12baf-436d-4eae-8790-1f541991fbab)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:22:58 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-4f86c053-e125-4c75-a5c3-fa03f115d6ec tempest-TestInstancesWithCinderVolumes-1475916076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aff44c6c-5f7c-4a86-a4b2-ac2306607057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:22:58 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-4f86c053-e125-4c75-a5c3-fa03f115d6ec tempest-TestInstancesWithCinderVolumes-1475916076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aff44c6c-5f7c-4a86-a4b2-ac2306607057) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:22:58 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-4f86c053-e125-4c75-a5c3-fa03f115d6ec tempest-TestInstancesWithCinderVolumes-1475916076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c01fcc36-250a-4eb3-bda9-04e15ef52e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:22:58 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-4f86c053-e125-4c75-a5c3-fa03f115d6ec tempest-TestInstancesWithCinderVolumes-1475916076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c01fcc36-250a-4eb3-bda9-04e15ef52e6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '872a1498-bc9f-4ac5-9f4d-ae3a1cb3cb0f', 'volume_name': 'volume-872a1498-bc9f-4ac5-9f4d-ae3a1cb3cb0f', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:22:58 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-4f86c053-e125-4c75-a5c3-fa03f115d6ec tempest-TestInstancesWithCinderVolumes-1475916076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55c805c0-f86c-472a-9d47-359e7951d70a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:22:58 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-4f86c053-e125-4c75-a5c3-fa03f115d6ec tempest-TestInstancesWithCinderVolumes-1475916076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55c805c0-f86c-472a-9d47-359e7951d70a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:22:58 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-4f86c053-e125-4c75-a5c3-fa03f115d6ec tempest-TestInstancesWithCinderVolumes-1475916076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37e45294-5ae5-410b-a975-5a317dddeb72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:22:58 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-4f86c053-e125-4c75-a5c3-fa03f115d6ec tempest-TestInstancesWithCinderVolumes-1475916076 None] Volume 872a1498-bc9f-4ac5-9f4d-ae3a1cb3cb0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-872a1498-bc9f-4ac5-9f4d-ae3a1cb3cb0f', 'volume_size': 1} Jul 22 03:22:58 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-4f86c053-e125-4c75-a5c3-fa03f115d6ec tempest-TestInstancesWithCinderVolumes-1475916076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:22:58 devstack sudo[96487]: pam_unix(sudo:session): session closed for user root Jul 22 03:22:58 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ca620232-57ec-473d-8acf-95d675a025ae tempest-VolumeImageDependencyTests-828371924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-dbc8d38b-63b0-4d86-8ffd-77b6ea74502f 1073741824" returned: 0 in 1.008s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:22:58 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-f0666f88-96aa-4ef1-bc21-0038066b11a7 tempest-VolumesSnapshotTestJSON-1822647413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:22:58 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ca620232-57ec-473d-8acf-95d675a025ae tempest-VolumeImageDependencyTests-828371924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-dbc8d38b-63b0-4d86-8ffd-77b6ea74502f {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:22:58 devstack sudo[96509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-dbc8d38b-63b0-4d86-8ffd-77b6ea74502f Jul 22 03:22:58 devstack sudo[96509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:22:59 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b7c8669-4a88-46ae-b767-4f7e0f2f450d tempest-TestInstancesWithCinderVolumes-1475916076 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:22:59 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2b7c8669-4a88-46ae-b767-4f7e0f2f450d tempest-TestInstancesWithCinderVolumes-1475916076 None] Flow 'volume_create_manager' (633d3c20-c395-44c6-8569-686007a2c918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:22:59 devstack sudo[96509]: pam_unix(sudo:session): session closed for user root Jul 22 03:22:59 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2b7c8669-4a88-46ae-b767-4f7e0f2f450d tempest-TestInstancesWithCinderVolumes-1475916076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (972994af-b272-4f22-8d46-bd35781f5297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:22:59 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ca620232-57ec-473d-8acf-95d675a025ae tempest-VolumeImageDependencyTests-828371924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-dbc8d38b-63b0-4d86-8ffd-77b6ea74502f" returned: 0 in 0.633s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:22:59 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-ca620232-57ec-473d-8acf-95d675a025ae tempest-VolumeImageDependencyTests-828371924 None] <== create_volume: return (1717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:22:59 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-ca620232-57ec-473d-8acf-95d675a025ae tempest-VolumeImageDependencyTests-828371924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.724s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:22:59 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-d9c4da74-0c5b-4d69-845d-3a1f217fbc67 tempest-TestInstancesWithCinderVolumes-1475916076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.131s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:22:59 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-d9c4da74-0c5b-4d69-845d-3a1f217fbc67 tempest-TestInstancesWithCinderVolumes-1475916076 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:22:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-726956546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45e0a249-97f8-4eef-8f91-d1c9a742fbb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='419f02238ed0422085fef0c6f4fbb409',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:22:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:22:57Z,use_quota=True,user_id='2274af5c76d6400383d38c16933e1c74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1781df21-851c-47ac-8690-44d43076ddbf),volume_type_id=1781df21-851c-47ac-8690-44d43076ddbf)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:22:59 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-d9c4da74-0c5b-4d69-845d-3a1f217fbc67 tempest-TestInstancesWithCinderVolumes-1475916076 None] Creating volume 45e0a249-97f8-4eef-8f91-d1c9a742fbb0 {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:22:59 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-d9c4da74-0c5b-4d69-845d-3a1f217fbc67 tempest-TestInstancesWithCinderVolumes-1475916076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:22:59 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-d9c4da74-0c5b-4d69-845d-3a1f217fbc67 tempest-TestInstancesWithCinderVolumes-1475916076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:22:59 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-d9c4da74-0c5b-4d69-845d-3a1f217fbc67 tempest-TestInstancesWithCinderVolumes-1475916076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:22:59 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-d9c4da74-0c5b-4d69-845d-3a1f217fbc67 tempest-TestInstancesWithCinderVolumes-1475916076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:22:59 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-d9c4da74-0c5b-4d69-845d-3a1f217fbc67 tempest-TestInstancesWithCinderVolumes-1475916076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:22:59 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-d9c4da74-0c5b-4d69-845d-3a1f217fbc67 tempest-TestInstancesWithCinderVolumes-1475916076 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:22:59 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-d9c4da74-0c5b-4d69-845d-3a1f217fbc67 tempest-TestInstancesWithCinderVolumes-1475916076 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:22:59 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d9c4da74-0c5b-4d69-845d-3a1f217fbc67 tempest-TestInstancesWithCinderVolumes-1475916076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-45e0a249-97f8-4eef-8f91-d1c9a742fbb0 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:22:59 devstack sudo[96514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-45e0a249-97f8-4eef-8f91-d1c9a742fbb0 1073741824 Jul 22 03:22:59 devstack sudo[96514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:22:59 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2b7c8669-4a88-46ae-b767-4f7e0f2f450d tempest-TestInstancesWithCinderVolumes-1475916076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (972994af-b272-4f22-8d46-bd35781f5297) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:22:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-486023640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b636260-1ddf-4058-b489-e696d283b079,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='419f02238ed0422085fef0c6f4fbb409',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:22:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:22:59Z,use_quota=True,user_id='2274af5c76d6400383d38c16933e1c74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7a53271-6412-4fdc-8180-872677c23df5),volume_type_id=b7a53271-6412-4fdc-8180-872677c23df5)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:22:59 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2b7c8669-4a88-46ae-b767-4f7e0f2f450d tempest-TestInstancesWithCinderVolumes-1475916076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7a2b25e-e9c1-4e15-aa6b-17f121beb9b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:22:59 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2b7c8669-4a88-46ae-b767-4f7e0f2f450d tempest-TestInstancesWithCinderVolumes-1475916076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7a2b25e-e9c1-4e15-aa6b-17f121beb9b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:22:59 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2b7c8669-4a88-46ae-b767-4f7e0f2f450d tempest-TestInstancesWithCinderVolumes-1475916076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9379df1-18bc-48dc-ba0b-1ba7f94649c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:22:59 devstack cinder-volume[87747]: DEBUG cinder.image.glance [None req-2b7c8669-4a88-46ae-b767-4f7e0f2f450d tempest-TestInstancesWithCinderVolumes-1475916076 None] Creating Keystone auth plugin from conf {{(pid=87747) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 22 03:22:59 devstack cinder-volume[87747]: DEBUG cinder.volume.volume_utils [None req-ca620232-57ec-473d-8acf-95d675a025ae tempest-VolumeImageDependencyTests-828371924 None] Attempting download of 130086e1-798c-440b-828a-e04853122616 ((None, [{'url': 'file:///opt/stack/data/glance/images/130086e1-798c-440b-828a-e04853122616', 'metadata': {}}])) to volume dbc8d38b-63b0-4d86-8ffd-77b6ea74502f. {{(pid=87747) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 22 03:22:59 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[de7a51bc-ab8e-433f-b98d-f62d65c66580]: (4, 'raw') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:22:59 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ca620232-57ec-473d-8acf-95d675a025ae tempest-VolumeImageDependencyTests-828371924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_130086e1-798c-440b-828a-e04853122616_qg3dja33 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:23:00 devstack sudo[96516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_130086e1-798c-440b-828a-e04853122616_qg3dja33 Jul 22 03:23:00 devstack sudo[96516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:23:00 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2b7c8669-4a88-46ae-b767-4f7e0f2f450d tempest-TestInstancesWithCinderVolumes-1475916076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9379df1-18bc-48dc-ba0b-1ba7f94649c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8b636260-1ddf-4058-b489-e696d283b079', 'volume_name': 'volume-8b636260-1ddf-4058-b489-e696d283b079', 'volume_size': 1, 'image_id': '9405b366-b9bd-4cc1-9dea-ba94c2fb6eab', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9405b366-b9bd-4cc1-9dea-ba94c2fb6eab', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1480235736', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '419f02238ed0422085fef0c6f4fbb409', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9405b366-b9bd-4cc1-9dea-ba94c2fb6eab', 'created_at': datetime.datetime(2026, 7, 22, 1, 22, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 22, 1, 22, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9405b366-b9bd-4cc1-9dea-ba94c2fb6eab/file', 'properties': {}}, 'image_service': }' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:23:00 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2b7c8669-4a88-46ae-b767-4f7e0f2f450d tempest-TestInstancesWithCinderVolumes-1475916076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a5ddfe9-0645-446f-9053-6dd956a1faee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:23:00 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2b7c8669-4a88-46ae-b767-4f7e0f2f450d tempest-TestInstancesWithCinderVolumes-1475916076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a5ddfe9-0645-446f-9053-6dd956a1faee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:23:00 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2b7c8669-4a88-46ae-b767-4f7e0f2f450d tempest-TestInstancesWithCinderVolumes-1475916076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd6930d6-7791-42df-9b42-c7004e372a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:23:00 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-2b7c8669-4a88-46ae-b767-4f7e0f2f450d tempest-TestInstancesWithCinderVolumes-1475916076 None] Volume 8b636260-1ddf-4058-b489-e696d283b079: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8b636260-1ddf-4058-b489-e696d283b079', 'volume_size': 1, 'image_id': '9405b366-b9bd-4cc1-9dea-ba94c2fb6eab', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9405b366-b9bd-4cc1-9dea-ba94c2fb6eab', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1480235736', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '419f02238ed0422085fef0c6f4fbb409', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9405b366-b9bd-4cc1-9dea-ba94c2fb6eab', 'created_at': datetime.datetime(2026, 7, 22, 1, 22, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 22, 1, 22, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9405b366-b9bd-4cc1-9dea-ba94c2fb6eab/file', 'properties': {}}, 'image_service': } Jul 22 03:23:00 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b7c8669-4a88-46ae-b767-4f7e0f2f450d tempest-TestInstancesWithCinderVolumes-1475916076 None] Trying to clone 8b636260-1ddf-4058-b489-e696d283b079 from image 9405b366-b9bd-4cc1-9dea-ba94c2fb6eab at location (None, [{'url': 'file:///opt/stack/data/glance/images/9405b366-b9bd-4cc1-9dea-ba94c2fb6eab', 'metadata': {}}]). {{(pid=87747) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 22 03:23:00 devstack sudo[96516]: pam_unix(sudo:session): session closed for user root Jul 22 03:23:00 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ca620232-57ec-473d-8acf-95d675a025ae tempest-VolumeImageDependencyTests-828371924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_130086e1-798c-440b-828a-e04853122616_qg3dja33" returned: 0 in 0.457s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:23:00 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ca620232-57ec-473d-8acf-95d675a025ae tempest-VolumeImageDependencyTests-828371924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_130086e1-798c-440b-828a-e04853122616_qg3dja33 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:23:00 devstack sudo[96514]: pam_unix(sudo:session): session closed for user root Jul 22 03:23:00 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d9c4da74-0c5b-4d69-845d-3a1f217fbc67 tempest-TestInstancesWithCinderVolumes-1475916076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-45e0a249-97f8-4eef-8f91-d1c9a742fbb0 1073741824" returned: 0 in 0.978s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:23:00 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d9c4da74-0c5b-4d69-845d-3a1f217fbc67 tempest-TestInstancesWithCinderVolumes-1475916076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-45e0a249-97f8-4eef-8f91-d1c9a742fbb0 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:23:00 devstack sudo[96525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_130086e1-798c-440b-828a-e04853122616_qg3dja33 Jul 22 03:23:00 devstack sudo[96525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:23:00 devstack sudo[96526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-45e0a249-97f8-4eef-8f91-d1c9a742fbb0 Jul 22 03:23:00 devstack sudo[96526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:23:00 devstack sudo[96526]: pam_unix(sudo:session): session closed for user root Jul 22 03:23:00 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d9c4da74-0c5b-4d69-845d-3a1f217fbc67 tempest-TestInstancesWithCinderVolumes-1475916076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-45e0a249-97f8-4eef-8f91-d1c9a742fbb0" returned: 0 in 0.295s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:23:00 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-d9c4da74-0c5b-4d69-845d-3a1f217fbc67 tempest-TestInstancesWithCinderVolumes-1475916076 None] <== create_volume: return (1339ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:23:00 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-d9c4da74-0c5b-4d69-845d-3a1f217fbc67 tempest-TestInstancesWithCinderVolumes-1475916076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.346s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:23:00 devstack sudo[96525]: pam_unix(sudo:session): session closed for user root Jul 22 03:23:00 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-4f86c053-e125-4c75-a5c3-fa03f115d6ec tempest-TestInstancesWithCinderVolumes-1475916076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.448s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:23:00 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-4f86c053-e125-4c75-a5c3-fa03f115d6ec tempest-TestInstancesWithCinderVolumes-1475916076 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:22:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-599418195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=872a1498-bc9f-4ac5-9f4d-ae3a1cb3cb0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='419f02238ed0422085fef0c6f4fbb409',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:22:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:22:58Z,use_quota=True,user_id='2274af5c76d6400383d38c16933e1c74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eb12baf-436d-4eae-8790-1f541991fbab),volume_type_id=5eb12baf-436d-4eae-8790-1f541991fbab)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:23:00 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-4f86c053-e125-4c75-a5c3-fa03f115d6ec tempest-TestInstancesWithCinderVolumes-1475916076 None] Creating volume 872a1498-bc9f-4ac5-9f4d-ae3a1cb3cb0f {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:23:00 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-4f86c053-e125-4c75-a5c3-fa03f115d6ec tempest-TestInstancesWithCinderVolumes-1475916076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:23:00 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-4f86c053-e125-4c75-a5c3-fa03f115d6ec tempest-TestInstancesWithCinderVolumes-1475916076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:23:00 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-4f86c053-e125-4c75-a5c3-fa03f115d6ec tempest-TestInstancesWithCinderVolumes-1475916076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:23:00 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-4f86c053-e125-4c75-a5c3-fa03f115d6ec tempest-TestInstancesWithCinderVolumes-1475916076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:23:00 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-4f86c053-e125-4c75-a5c3-fa03f115d6ec tempest-TestInstancesWithCinderVolumes-1475916076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:23:00 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-4f86c053-e125-4c75-a5c3-fa03f115d6ec tempest-TestInstancesWithCinderVolumes-1475916076 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:23:00 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-4f86c053-e125-4c75-a5c3-fa03f115d6ec tempest-TestInstancesWithCinderVolumes-1475916076 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:23:00 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-4f86c053-e125-4c75-a5c3-fa03f115d6ec tempest-TestInstancesWithCinderVolumes-1475916076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-872a1498-bc9f-4ac5-9f4d-ae3a1cb3cb0f 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:23:00 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ca620232-57ec-473d-8acf-95d675a025ae tempest-VolumeImageDependencyTests-828371924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_130086e1-798c-440b-828a-e04853122616_qg3dja33" returned: 1 in 0.454s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:23:00 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ca620232-57ec-473d-8acf-95d675a025ae tempest-VolumeImageDependencyTests-828371924 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_130086e1-798c-440b-828a-e04853122616_qg3dja33' failed. Not Retrying. {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 22 03:23:00 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[07e2b600-91a7-4fbd-ac71-952c1288a50f]: (4, 'raw') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:23:00 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ca620232-57ec-473d-8acf-95d675a025ae tempest-VolumeImageDependencyTests-828371924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_130086e1-798c-440b-828a-e04853122616_iu3q18g7devstack@QuobyteHD {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:23:00 devstack sudo[96532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-872a1498-bc9f-4ac5-9f4d-ae3a1cb3cb0f 1073741824 Jul 22 03:23:00 devstack sudo[96532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:23:00 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-d9c4da74-0c5b-4d69-845d-3a1f217fbc67 tempest-TestInstancesWithCinderVolumes-1475916076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6920aa8-2bfe-4d8c-b4a0-82e6c6c8a6d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45e0a249-97f8-4eef-8f91-d1c9a742fbb0', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:23:00 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-d9c4da74-0c5b-4d69-845d-3a1f217fbc67 tempest-TestInstancesWithCinderVolumes-1475916076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33b464dc-effa-4558-b736-7371d1683394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:23:00 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-d9c4da74-0c5b-4d69-845d-3a1f217fbc67 tempest-TestInstancesWithCinderVolumes-1475916076 None] Volume volume-45e0a249-97f8-4eef-8f91-d1c9a742fbb0 (45e0a249-97f8-4eef-8f91-d1c9a742fbb0): created successfully Jul 22 03:23:00 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-d9c4da74-0c5b-4d69-845d-3a1f217fbc67 tempest-TestInstancesWithCinderVolumes-1475916076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33b464dc-effa-4558-b736-7371d1683394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:23:00 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-d9c4da74-0c5b-4d69-845d-3a1f217fbc67 tempest-TestInstancesWithCinderVolumes-1475916076 None] Flow 'volume_create_manager' (43b4e8eb-326d-4da2-8c3a-9f4254b5a6a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:23:00 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-d9c4da74-0c5b-4d69-845d-3a1f217fbc67 tempest-TestInstancesWithCinderVolumes-1475916076 None] Created volume successfully. Jul 22 03:23:01 devstack sudo[96533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_130086e1-798c-440b-828a-e04853122616_iu3q18g7devstack@QuobyteHD Jul 22 03:23:01 devstack sudo[96533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:23:01 devstack sudo[96533]: pam_unix(sudo:session): session closed for user root Jul 22 03:23:01 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ca620232-57ec-473d-8acf-95d675a025ae tempest-VolumeImageDependencyTests-828371924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_130086e1-798c-440b-828a-e04853122616_iu3q18g7devstack@QuobyteHD" returned: 0 in 0.509s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:23:01 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ca620232-57ec-473d-8acf-95d675a025ae tempest-VolumeImageDependencyTests-828371924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_130086e1-798c-440b-828a-e04853122616_iu3q18g7devstack@QuobyteHD {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:23:01 devstack sudo[96532]: pam_unix(sudo:session): session closed for user root Jul 22 03:23:01 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-4f86c053-e125-4c75-a5c3-fa03f115d6ec tempest-TestInstancesWithCinderVolumes-1475916076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-872a1498-bc9f-4ac5-9f4d-ae3a1cb3cb0f 1073741824" returned: 0 in 0.703s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:23:01 devstack sudo[96542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_130086e1-798c-440b-828a-e04853122616_iu3q18g7devstack@QuobyteHD Jul 22 03:23:01 devstack sudo[96542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:23:01 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-4f86c053-e125-4c75-a5c3-fa03f115d6ec tempest-TestInstancesWithCinderVolumes-1475916076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-872a1498-bc9f-4ac5-9f4d-ae3a1cb3cb0f {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:23:01 devstack sudo[96544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-872a1498-bc9f-4ac5-9f4d-ae3a1cb3cb0f Jul 22 03:23:01 devstack sudo[96544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:23:01 devstack sudo[96542]: pam_unix(sudo:session): session closed for user root Jul 22 03:23:01 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ca620232-57ec-473d-8acf-95d675a025ae tempest-VolumeImageDependencyTests-828371924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_130086e1-798c-440b-828a-e04853122616_iu3q18g7devstack@QuobyteHD" returned: 1 in 0.463s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:23:01 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ca620232-57ec-473d-8acf-95d675a025ae tempest-VolumeImageDependencyTests-828371924 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_130086e1-798c-440b-828a-e04853122616_iu3q18g7devstack@QuobyteHD' failed. Not Retrying. {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 22 03:23:01 devstack cinder-volume[87747]: DEBUG cinder.image.image_utils [None req-ca620232-57ec-473d-8acf-95d675a025ae tempest-VolumeImageDependencyTests-828371924 None] 130086e1-798c-440b-828a-e04853122616 was raw, converting to qcow2 {{(pid=87747) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 22 03:23:01 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ca620232-57ec-473d-8acf-95d675a025ae tempest-VolumeImageDependencyTests-828371924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_130086e1-798c-440b-828a-e04853122616_iu3q18g7devstack@QuobyteHD /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-dbc8d38b-63b0-4d86-8ffd-77b6ea74502f {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:23:01 devstack sudo[96549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_130086e1-798c-440b-828a-e04853122616_iu3q18g7devstack@QuobyteHD /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-dbc8d38b-63b0-4d86-8ffd-77b6ea74502f Jul 22 03:23:01 devstack sudo[96549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:23:01 devstack sudo[96544]: pam_unix(sudo:session): session closed for user root Jul 22 03:23:01 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-4f86c053-e125-4c75-a5c3-fa03f115d6ec tempest-TestInstancesWithCinderVolumes-1475916076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-872a1498-bc9f-4ac5-9f4d-ae3a1cb3cb0f" returned: 0 in 0.458s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:23:01 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-4f86c053-e125-4c75-a5c3-fa03f115d6ec tempest-TestInstancesWithCinderVolumes-1475916076 None] <== create_volume: return (1220ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:23:01 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-4f86c053-e125-4c75-a5c3-fa03f115d6ec tempest-TestInstancesWithCinderVolumes-1475916076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.224s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:23:01 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-f0666f88-96aa-4ef1-bc21-0038066b11a7 tempest-VolumesSnapshotTestJSON-1822647413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.249s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:23:01 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-f0666f88-96aa-4ef1-bc21-0038066b11a7 tempest-VolumesSnapshotTestJSON-1822647413 None] Creating offline snapshot 68e77cad-1fc6-4221-9c16-273242a43cec of volume 4f096da6-6b62-46a1-9dd5-206f57e9114e {{(pid=87747) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 03:23:01 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-4f86c053-e125-4c75-a5c3-fa03f115d6ec tempest-TestInstancesWithCinderVolumes-1475916076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37e45294-5ae5-410b-a975-5a317dddeb72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-872a1498-bc9f-4ac5-9f4d-ae3a1cb3cb0f', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:23:01 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-4f86c053-e125-4c75-a5c3-fa03f115d6ec tempest-TestInstancesWithCinderVolumes-1475916076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf75af08-5d6f-4819-9023-df8ecfdcc471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:23:02 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-4f86c053-e125-4c75-a5c3-fa03f115d6ec tempest-TestInstancesWithCinderVolumes-1475916076 None] Volume volume-872a1498-bc9f-4ac5-9f4d-ae3a1cb3cb0f (872a1498-bc9f-4ac5-9f4d-ae3a1cb3cb0f): created successfully Jul 22 03:23:02 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-4f86c053-e125-4c75-a5c3-fa03f115d6ec tempest-TestInstancesWithCinderVolumes-1475916076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf75af08-5d6f-4819-9023-df8ecfdcc471) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:23:02 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-4f86c053-e125-4c75-a5c3-fa03f115d6ec tempest-TestInstancesWithCinderVolumes-1475916076 None] Flow 'volume_create_manager' (fe2f593d-675b-471e-a4ab-9891ef69b6dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:23:02 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed439544-b8d7-4325-a5c7-a20f465aafb7]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:23:02 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f0666f88-96aa-4ef1-bc21-0038066b11a7 tempest-VolumesSnapshotTestJSON-1822647413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4f096da6-6b62-46a1-9dd5-206f57e9114e {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:23:02 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-4f86c053-e125-4c75-a5c3-fa03f115d6ec tempest-TestInstancesWithCinderVolumes-1475916076 None] Created volume successfully. Jul 22 03:23:02 devstack sudo[96553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4f096da6-6b62-46a1-9dd5-206f57e9114e Jul 22 03:23:02 devstack sudo[96553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:23:02 devstack sudo[96549]: pam_unix(sudo:session): session closed for user root Jul 22 03:23:02 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ca620232-57ec-473d-8acf-95d675a025ae tempest-VolumeImageDependencyTests-828371924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_130086e1-798c-440b-828a-e04853122616_iu3q18g7devstack@QuobyteHD /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-dbc8d38b-63b0-4d86-8ffd-77b6ea74502f" returned: 0 in 0.786s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:23:02 devstack cinder-volume[87747]: DEBUG cinder.image.image_utils [None req-ca620232-57ec-473d-8acf-95d675a025ae tempest-VolumeImageDependencyTests-828371924 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_130086e1-798c-440b-828a-e04853122616_iu3q18g7devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-dbc8d38b-63b0-4d86-8ffd-77b6ea74502f {{(pid=87747) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 22 03:23:02 devstack cinder-volume[87747]: INFO cinder.image.image_utils [None req-ca620232-57ec-473d-8acf-95d675a025ae tempest-VolumeImageDependencyTests-828371924 None] Converted 0.00 MB image at 0.00 MB/s Jul 22 03:23:02 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ca620232-57ec-473d-8acf-95d675a025ae tempest-VolumeImageDependencyTests-828371924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-dbc8d38b-63b0-4d86-8ffd-77b6ea74502f 1G {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:23:02 devstack sudo[96553]: pam_unix(sudo:session): session closed for user root Jul 22 03:23:02 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f0666f88-96aa-4ef1-bc21-0038066b11a7 tempest-VolumesSnapshotTestJSON-1822647413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4f096da6-6b62-46a1-9dd5-206f57e9114e" returned: 0 in 0.514s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:23:02 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f0666f88-96aa-4ef1-bc21-0038066b11a7 tempest-VolumesSnapshotTestJSON-1822647413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4f096da6-6b62-46a1-9dd5-206f57e9114e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4f096da6-6b62-46a1-9dd5-206f57e9114e.68e77cad-1fc6-4221-9c16-273242a43cec 1G {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:23:02 devstack sudo[96561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-dbc8d38b-63b0-4d86-8ffd-77b6ea74502f 1G Jul 22 03:23:02 devstack sudo[96561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:23:02 devstack sudo[96562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4f096da6-6b62-46a1-9dd5-206f57e9114e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4f096da6-6b62-46a1-9dd5-206f57e9114e.68e77cad-1fc6-4221-9c16-273242a43cec 1G Jul 22 03:23:02 devstack sudo[96562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:23:03 devstack sudo[96561]: pam_unix(sudo:session): session closed for user root Jul 22 03:23:03 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ca620232-57ec-473d-8acf-95d675a025ae tempest-VolumeImageDependencyTests-828371924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-dbc8d38b-63b0-4d86-8ffd-77b6ea74502f 1G" returned: 0 in 0.506s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:23:03 devstack cinder-volume[87747]: DEBUG cinder.volume.volume_utils [None req-ca620232-57ec-473d-8acf-95d675a025ae tempest-VolumeImageDependencyTests-828371924 None] Downloaded image 130086e1-798c-440b-828a-e04853122616 ((None, [{'url': 'file:///opt/stack/data/glance/images/130086e1-798c-440b-828a-e04853122616', 'metadata': {}}])) to volume dbc8d38b-63b0-4d86-8ffd-77b6ea74502f successfully. {{(pid=87747) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 22 03:23:03 devstack cinder-volume[87747]: DEBUG cinder.image.image_utils [None req-ca620232-57ec-473d-8acf-95d675a025ae tempest-VolumeImageDependencyTests-828371924 None] Temporary image 130086e1-798c-440b-828a-e04853122616 for user d2b63464233f4e59be3df28f4c029b3e is deleted. {{(pid=87747) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 22 03:23:03 devstack cinder-volume[87747]: DEBUG cinder.volume.volume_utils [None req-ca620232-57ec-473d-8acf-95d675a025ae tempest-VolumeImageDependencyTests-828371924 None] Marking volume dbc8d38b-63b0-4d86-8ffd-77b6ea74502f as bootable. {{(pid=87747) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 22 03:23:03 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca620232-57ec-473d-8acf-95d675a025ae tempest-VolumeImageDependencyTests-828371924 None] Copying metadata from image 130086e1-798c-440b-828a-e04853122616 to dbc8d38b-63b0-4d86-8ffd-77b6ea74502f. {{(pid=87747) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 22 03:23:03 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca620232-57ec-473d-8acf-95d675a025ae tempest-VolumeImageDependencyTests-828371924 None] Creating volume glance metadata for volume dbc8d38b-63b0-4d86-8ffd-77b6ea74502f backed by image 130086e1-798c-440b-828a-e04853122616 with: {'image_id': '130086e1-798c-440b-828a-e04853122616', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '49ad19ad2ff6d0d89ec6a07c5ea68fc9', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87747) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 22 03:23:03 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-ca620232-57ec-473d-8acf-95d675a025ae tempest-VolumeImageDependencyTests-828371924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0b3a162-41f4-482c-a2c6-9ad8979d1ea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbc8d38b-63b0-4d86-8ffd-77b6ea74502f', 'volume_size': 1, 'image_id': '130086e1-798c-440b-828a-e04853122616', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/130086e1-798c-440b-828a-e04853122616', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '49ad19ad2ff6d0d89ec6a07c5ea68fc9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ad914ffab3c44abaac47bf427532462f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b5b630d70c7bd441863efe577d7ff992532cdb9c2288306d120428877b58c727a5d35600bd6a15ee77a3950662f95212ea4259adb0b287784943b1e8ccd5ace6', 'id': '130086e1-798c-440b-828a-e04853122616', 'created_at': datetime.datetime(2026, 7, 22, 1, 22, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 22, 1, 22, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/130086e1-798c-440b-828a-e04853122616/file', 'properties': {}}, 'image_service': }' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:23:03 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-ca620232-57ec-473d-8acf-95d675a025ae tempest-VolumeImageDependencyTests-828371924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80100216-1d5d-48bd-a35c-7456143b9d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:23:03 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-ca620232-57ec-473d-8acf-95d675a025ae tempest-VolumeImageDependencyTests-828371924 None] Volume volume-dbc8d38b-63b0-4d86-8ffd-77b6ea74502f (dbc8d38b-63b0-4d86-8ffd-77b6ea74502f): created successfully Jul 22 03:23:03 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-ca620232-57ec-473d-8acf-95d675a025ae tempest-VolumeImageDependencyTests-828371924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80100216-1d5d-48bd-a35c-7456143b9d5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:23:03 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-ca620232-57ec-473d-8acf-95d675a025ae tempest-VolumeImageDependencyTests-828371924 None] Flow 'volume_create_manager' (26187386-2be0-4e76-a155-705b243cf04b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:23:03 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-ca620232-57ec-473d-8acf-95d675a025ae tempest-VolumeImageDependencyTests-828371924 None] Created volume successfully. Jul 22 03:23:03 devstack sudo[96562]: pam_unix(sudo:session): session closed for user root Jul 22 03:23:03 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f0666f88-96aa-4ef1-bc21-0038066b11a7 tempest-VolumesSnapshotTestJSON-1822647413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4f096da6-6b62-46a1-9dd5-206f57e9114e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4f096da6-6b62-46a1-9dd5-206f57e9114e.68e77cad-1fc6-4221-9c16-273242a43cec 1G" returned: 0 in 0.746s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:23:03 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f0666f88-96aa-4ef1-bc21-0038066b11a7 tempest-VolumesSnapshotTestJSON-1822647413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f096da6-6b62-46a1-9dd5-206f57e9114e -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4f096da6-6b62-46a1-9dd5-206f57e9114e.68e77cad-1fc6-4221-9c16-273242a43cec {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:23:03 devstack sudo[96575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f096da6-6b62-46a1-9dd5-206f57e9114e -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4f096da6-6b62-46a1-9dd5-206f57e9114e.68e77cad-1fc6-4221-9c16-273242a43cec Jul 22 03:23:03 devstack sudo[96575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:23:03 devstack sudo[96575]: pam_unix(sudo:session): session closed for user root Jul 22 03:23:03 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f0666f88-96aa-4ef1-bc21-0038066b11a7 tempest-VolumesSnapshotTestJSON-1822647413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f096da6-6b62-46a1-9dd5-206f57e9114e -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4f096da6-6b62-46a1-9dd5-206f57e9114e.68e77cad-1fc6-4221-9c16-273242a43cec" returned: 0 in 0.469s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:23:03 devstack cinder-volume[87747]: WARNING cinder.volume.drivers.remotefs [None req-f0666f88-96aa-4ef1-bc21-0038066b11a7 tempest-VolumesSnapshotTestJSON-1822647413 None] /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4f096da6-6b62-46a1-9dd5-206f57e9114e.68e77cad-1fc6-4221-9c16-273242a43cec is being set with open permissions: ugo+rw Jul 22 03:23:03 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f0666f88-96aa-4ef1-bc21-0038066b11a7 tempest-VolumesSnapshotTestJSON-1822647413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4f096da6-6b62-46a1-9dd5-206f57e9114e.68e77cad-1fc6-4221-9c16-273242a43cec {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:23:03 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-cca3ad81-8dd7-4a25-a8e6-49373ae69f94 tempest-VolumeImageDependencyTests-828371924 None] Acquiring lock "cinder-dbc8d38b-63b0-4d86-8ffd-77b6ea74502f-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:23:03 devstack sudo[96580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4f096da6-6b62-46a1-9dd5-206f57e9114e.68e77cad-1fc6-4221-9c16-273242a43cec Jul 22 03:23:03 devstack sudo[96580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:23:03 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-cca3ad81-8dd7-4a25-a8e6-49373ae69f94 tempest-VolumeImageDependencyTests-828371924 None] Lock "cinder-dbc8d38b-63b0-4d86-8ffd-77b6ea74502f-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:23:03 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-cca3ad81-8dd7-4a25-a8e6-49373ae69f94 tempest-VolumeImageDependencyTests-828371924 None] Acquiring lock "cinder-quobyte-dbc8d38b-63b0-4d86-8ffd-77b6ea74502f" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:23:03 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-cca3ad81-8dd7-4a25-a8e6-49373ae69f94 tempest-VolumeImageDependencyTests-828371924 None] Lock "cinder-quobyte-dbc8d38b-63b0-4d86-8ffd-77b6ea74502f" acquired by "delete_volume" :: waited 0.042s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:23:04 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ca118a1-4f1b-4b1b-b13d-631d87197cb1]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:23:04 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-cca3ad81-8dd7-4a25-a8e6-49373ae69f94 tempest-VolumeImageDependencyTests-828371924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-dbc8d38b-63b0-4d86-8ffd-77b6ea74502f {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:23:04 devstack sudo[96582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-dbc8d38b-63b0-4d86-8ffd-77b6ea74502f Jul 22 03:23:04 devstack sudo[96582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:23:04 devstack sudo[96580]: pam_unix(sudo:session): session closed for user root Jul 22 03:23:04 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f0666f88-96aa-4ef1-bc21-0038066b11a7 tempest-VolumesSnapshotTestJSON-1822647413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4f096da6-6b62-46a1-9dd5-206f57e9114e.68e77cad-1fc6-4221-9c16-273242a43cec" returned: 0 in 0.466s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:23:04 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f0666f88-96aa-4ef1-bc21-0038066b11a7 tempest-VolumesSnapshotTestJSON-1822647413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4f096da6-6b62-46a1-9dd5-206f57e9114e.info {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:23:04 devstack sudo[96585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4f096da6-6b62-46a1-9dd5-206f57e9114e.info Jul 22 03:23:04 devstack sudo[96585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:23:04 devstack sudo[96582]: pam_unix(sudo:session): session closed for user root Jul 22 03:23:04 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-cca3ad81-8dd7-4a25-a8e6-49373ae69f94 tempest-VolumeImageDependencyTests-828371924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-dbc8d38b-63b0-4d86-8ffd-77b6ea74502f" returned: 0 in 0.481s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:23:04 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-cca3ad81-8dd7-4a25-a8e6-49373ae69f94 tempest-VolumeImageDependencyTests-828371924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-dbc8d38b-63b0-4d86-8ffd-77b6ea74502f {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:23:04 devstack sudo[96590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-dbc8d38b-63b0-4d86-8ffd-77b6ea74502f Jul 22 03:23:04 devstack sudo[96590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:23:04 devstack sudo[96585]: pam_unix(sudo:session): session closed for user root Jul 22 03:23:04 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f0666f88-96aa-4ef1-bc21-0038066b11a7 tempest-VolumesSnapshotTestJSON-1822647413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4f096da6-6b62-46a1-9dd5-206f57e9114e.info" returned: 0 in 0.288s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:23:04 devstack cinder-volume[87747]: WARNING cinder.volume.drivers.remotefs [None req-f0666f88-96aa-4ef1-bc21-0038066b11a7 tempest-VolumesSnapshotTestJSON-1822647413 None] /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4f096da6-6b62-46a1-9dd5-206f57e9114e.info is being set with open permissions: ugo+rw Jul 22 03:23:04 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f0666f88-96aa-4ef1-bc21-0038066b11a7 tempest-VolumesSnapshotTestJSON-1822647413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4f096da6-6b62-46a1-9dd5-206f57e9114e.info {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:23:04 devstack sudo[96593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4f096da6-6b62-46a1-9dd5-206f57e9114e.info Jul 22 03:23:04 devstack sudo[96593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:23:04 devstack sudo[96590]: pam_unix(sudo:session): session closed for user root Jul 22 03:23:04 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-cca3ad81-8dd7-4a25-a8e6-49373ae69f94 tempest-VolumeImageDependencyTests-828371924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-dbc8d38b-63b0-4d86-8ffd-77b6ea74502f" returned: 0 in 0.327s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:23:04 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-cca3ad81-8dd7-4a25-a8e6-49373ae69f94 tempest-VolumeImageDependencyTests-828371924 None] Lock "cinder-quobyte-dbc8d38b-63b0-4d86-8ffd-77b6ea74502f" released by "delete_volume" :: held 0.858s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:23:04 devstack sudo[96593]: pam_unix(sudo:session): session closed for user root Jul 22 03:23:04 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f0666f88-96aa-4ef1-bc21-0038066b11a7 tempest-VolumesSnapshotTestJSON-1822647413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4f096da6-6b62-46a1-9dd5-206f57e9114e.info" returned: 0 in 0.282s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:23:04 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-f0666f88-96aa-4ef1-bc21-0038066b11a7 tempest-VolumesSnapshotTestJSON-1822647413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.920s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:23:04 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-f0666f88-96aa-4ef1-bc21-0038066b11a7 tempest-VolumesSnapshotTestJSON-1822647413 None] Create snapshot completed successfully Jul 22 03:23:04 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-cca3ad81-8dd7-4a25-a8e6-49373ae69f94 tempest-VolumeImageDependencyTests-828371924 None] Created reservations ['a3d812a8-db49-4f7d-b5a1-34bd8d3d1e94', 'c2a9e7f5-9d3c-45d3-9241-6726b83629fa', 'd4ced505-94f8-4327-8b73-d14ead3458b7', '9e60ef74-6545-41c8-88ab-a7ff2ab28f29'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:23:05 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-cca3ad81-8dd7-4a25-a8e6-49373ae69f94 tempest-VolumeImageDependencyTests-828371924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:23:05 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-cca3ad81-8dd7-4a25-a8e6-49373ae69f94 tempest-VolumeImageDependencyTests-828371924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:23:05 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-cca3ad81-8dd7-4a25-a8e6-49373ae69f94 tempest-VolumeImageDependencyTests-828371924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:23:05 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-cca3ad81-8dd7-4a25-a8e6-49373ae69f94 tempest-VolumeImageDependencyTests-828371924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:23:05 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-cca3ad81-8dd7-4a25-a8e6-49373ae69f94 tempest-VolumeImageDependencyTests-828371924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:23:05 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-cca3ad81-8dd7-4a25-a8e6-49373ae69f94 tempest-VolumeImageDependencyTests-828371924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:23:05 devstack sudo[96597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:23:05 devstack sudo[96597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:23:05 devstack sudo[96597]: pam_unix(sudo:session): session closed for user root Jul 22 03:23:05 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-cca3ad81-8dd7-4a25-a8e6-49373ae69f94 tempest-VolumeImageDependencyTests-828371924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.361s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:23:05 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-cca3ad81-8dd7-4a25-a8e6-49373ae69f94 tempest-VolumeImageDependencyTests-828371924 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:23:05 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-cca3ad81-8dd7-4a25-a8e6-49373ae69f94 tempest-VolumeImageDependencyTests-828371924 None] Deleted volume successfully. Jul 22 03:23:05 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-cca3ad81-8dd7-4a25-a8e6-49373ae69f94 tempest-VolumeImageDependencyTests-828371924 None] Lock "cinder-dbc8d38b-63b0-4d86-8ffd-77b6ea74502f-delete_volume" released by "delete_volume" :: held 1.607s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:23:05 devstack cinder-volume[87747]: DEBUG cinder.image.image_utils [None req-2b7c8669-4a88-46ae-b767-4f7e0f2f450d tempest-TestInstancesWithCinderVolumes-1475916076 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9405b366-b9bd-4cc1-9dea-ba94c2fb6eab_pc2_auxzdevstack@QuobyteHD, size 20.69 MB, duration 5.44 sec {{(pid=87747) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 22 03:23:05 devstack cinder-volume[87747]: INFO cinder.image.image_utils [None req-2b7c8669-4a88-46ae-b767-4f7e0f2f450d tempest-TestInstancesWithCinderVolumes-1475916076 None] Image download 20.69 MB at 3.80 MB/s Jul 22 03:23:05 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[73f2af90-1362-412f-82aa-d23d4a526710]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:23:05 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2b7c8669-4a88-46ae-b767-4f7e0f2f450d tempest-TestInstancesWithCinderVolumes-1475916076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9405b366-b9bd-4cc1-9dea-ba94c2fb6eab_pc2_auxzdevstack@QuobyteHD {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:23:05 devstack sudo[96600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9405b366-b9bd-4cc1-9dea-ba94c2fb6eab_pc2_auxzdevstack@QuobyteHD Jul 22 03:23:05 devstack sudo[96600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:23:05 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bad7833-8260-415c-94f3-0f52d8cd5413 tempest-VolumesSnapshotTestJSON-1822647413 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:23:06 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2bad7833-8260-415c-94f3-0f52d8cd5413 tempest-VolumesSnapshotTestJSON-1822647413 None] Flow 'volume_create_manager' (b9688527-fa7b-4f7a-980c-6c47b2b55104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:23:06 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2bad7833-8260-415c-94f3-0f52d8cd5413 tempest-VolumesSnapshotTestJSON-1822647413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c2412b8-e352-43f6-b83c-e34485cd25f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:23:06 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2bad7833-8260-415c-94f3-0f52d8cd5413 tempest-VolumesSnapshotTestJSON-1822647413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c2412b8-e352-43f6-b83c-e34485cd25f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:23:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1493558381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40d830a8-3fe2-4d05-92ce-95614658976d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6166f63d820041daa3dbed33b7b5865e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:23:06Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=68e77cad-1fc6-4221-9c16-273242a43cec,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:23:06Z,use_quota=True,user_id='d926305a7e4740cd89dcfbca5546f47f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:23:06 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2bad7833-8260-415c-94f3-0f52d8cd5413 tempest-VolumesSnapshotTestJSON-1822647413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30056c01-bf04-4125-8845-bc192c8085e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:23:06 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2bad7833-8260-415c-94f3-0f52d8cd5413 tempest-VolumesSnapshotTestJSON-1822647413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30056c01-bf04-4125-8845-bc192c8085e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:23:06 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2bad7833-8260-415c-94f3-0f52d8cd5413 tempest-VolumesSnapshotTestJSON-1822647413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e154f90c-3003-4ed4-b1d6-63138dcb3215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:23:06 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2bad7833-8260-415c-94f3-0f52d8cd5413 tempest-VolumesSnapshotTestJSON-1822647413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e154f90c-3003-4ed4-b1d6-63138dcb3215) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '40d830a8-3fe2-4d05-92ce-95614658976d', 'volume_name': 'volume-40d830a8-3fe2-4d05-92ce-95614658976d', 'volume_size': 2, 'snapshot_id': '68e77cad-1fc6-4221-9c16-273242a43cec'}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:23:06 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2bad7833-8260-415c-94f3-0f52d8cd5413 tempest-VolumesSnapshotTestJSON-1822647413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b307546-ff0d-4bca-afda-0de6f4fa041e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:23:06 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2bad7833-8260-415c-94f3-0f52d8cd5413 tempest-VolumesSnapshotTestJSON-1822647413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b307546-ff0d-4bca-afda-0de6f4fa041e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:23:06 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2bad7833-8260-415c-94f3-0f52d8cd5413 tempest-VolumesSnapshotTestJSON-1822647413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6619b2a5-da82-4a8c-8a0f-865d9380bcfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:23:06 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-2bad7833-8260-415c-94f3-0f52d8cd5413 tempest-VolumesSnapshotTestJSON-1822647413 None] Volume 40d830a8-3fe2-4d05-92ce-95614658976d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-40d830a8-3fe2-4d05-92ce-95614658976d', 'volume_size': 2, 'snapshot_id': '68e77cad-1fc6-4221-9c16-273242a43cec'} Jul 22 03:23:06 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-2bad7833-8260-415c-94f3-0f52d8cd5413 tempest-VolumesSnapshotTestJSON-1822647413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:23:06 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-2bad7833-8260-415c-94f3-0f52d8cd5413 tempest-VolumesSnapshotTestJSON-1822647413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:23:06 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-2bad7833-8260-415c-94f3-0f52d8cd5413 tempest-VolumesSnapshotTestJSON-1822647413 None] Acquiring lock "cinder-quobyte-68e77cad-1fc6-4221-9c16-273242a43cec-40d830a8-3fe2-4d05-92ce-95614658976d" by "_create_volume_from_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:23:06 devstack sudo[96600]: pam_unix(sudo:session): session closed for user root Jul 22 03:23:06 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2b7c8669-4a88-46ae-b767-4f7e0f2f450d tempest-TestInstancesWithCinderVolumes-1475916076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9405b366-b9bd-4cc1-9dea-ba94c2fb6eab_pc2_auxzdevstack@QuobyteHD" returned: 0 in 0.404s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:23:06 devstack cinder-volume[87747]: DEBUG cinder.image.image_utils [None req-2b7c8669-4a88-46ae-b767-4f7e0f2f450d tempest-TestInstancesWithCinderVolumes-1475916076 None] Temporary image 9405b366-b9bd-4cc1-9dea-ba94c2fb6eab is fetched for user 2274af5c76d6400383d38c16933e1c74. {{(pid=87747) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 22 03:23:06 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-2bad7833-8260-415c-94f3-0f52d8cd5413 tempest-VolumesSnapshotTestJSON-1822647413 None] Lock "cinder-quobyte-68e77cad-1fc6-4221-9c16-273242a43cec-40d830a8-3fe2-4d05-92ce-95614658976d" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:23:06 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-2bad7833-8260-415c-94f3-0f52d8cd5413 tempest-VolumesSnapshotTestJSON-1822647413 None] Creating volume 40d830a8-3fe2-4d05-92ce-95614658976d from snapshot 68e77cad-1fc6-4221-9c16-273242a43cec {{(pid=87747) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 22 03:23:06 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-2bad7833-8260-415c-94f3-0f52d8cd5413 tempest-VolumesSnapshotTestJSON-1822647413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:23:06 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-2bad7833-8260-415c-94f3-0f52d8cd5413 tempest-VolumesSnapshotTestJSON-1822647413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:23:06 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-2bad7833-8260-415c-94f3-0f52d8cd5413 tempest-VolumesSnapshotTestJSON-1822647413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:23:06 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-2bad7833-8260-415c-94f3-0f52d8cd5413 tempest-VolumesSnapshotTestJSON-1822647413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:23:06 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-2bad7833-8260-415c-94f3-0f52d8cd5413 tempest-VolumesSnapshotTestJSON-1822647413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:23:06 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-2bad7833-8260-415c-94f3-0f52d8cd5413 tempest-VolumesSnapshotTestJSON-1822647413 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:23:06 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-2bad7833-8260-415c-94f3-0f52d8cd5413 tempest-VolumesSnapshotTestJSON-1822647413 None] Acquiring lock "cinder-quobyte-40d830a8-3fe2-4d05-92ce-95614658976d" by "_copy_volume_from_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:23:06 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-2bad7833-8260-415c-94f3-0f52d8cd5413 tempest-VolumesSnapshotTestJSON-1822647413 None] Lock "cinder-quobyte-40d830a8-3fe2-4d05-92ce-95614658976d" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:23:06 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-2bad7833-8260-415c-94f3-0f52d8cd5413 tempest-VolumesSnapshotTestJSON-1822647413 None] snapshot: 68e77cad-1fc6-4221-9c16-273242a43cec, volume: 40d830a8-3fe2-4d05-92ce-95614658976d, {{(pid=87747) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 22 03:23:06 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-2bad7833-8260-415c-94f3-0f52d8cd5413 tempest-VolumesSnapshotTestJSON-1822647413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:23:06 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-2bad7833-8260-415c-94f3-0f52d8cd5413 tempest-VolumesSnapshotTestJSON-1822647413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:23:06 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-2bad7833-8260-415c-94f3-0f52d8cd5413 tempest-VolumesSnapshotTestJSON-1822647413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:23:06 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-2bad7833-8260-415c-94f3-0f52d8cd5413 tempest-VolumesSnapshotTestJSON-1822647413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:23:06 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-2bad7833-8260-415c-94f3-0f52d8cd5413 tempest-VolumesSnapshotTestJSON-1822647413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:23:06 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e0a7b1a-1618-4bc8-be0c-09405e924c03]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:23:06 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2bad7833-8260-415c-94f3-0f52d8cd5413 tempest-VolumesSnapshotTestJSON-1822647413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4f096da6-6b62-46a1-9dd5-206f57e9114e.68e77cad-1fc6-4221-9c16-273242a43cec {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:23:06 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eac9c11-47ea-45b0-bbb1-57ce576d1b83]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:23:06 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2b7c8669-4a88-46ae-b767-4f7e0f2f450d tempest-TestInstancesWithCinderVolumes-1475916076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9405b366-b9bd-4cc1-9dea-ba94c2fb6eab_pc2_auxzdevstack@QuobyteHD {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:23:06 devstack sudo[96605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4f096da6-6b62-46a1-9dd5-206f57e9114e.68e77cad-1fc6-4221-9c16-273242a43cec Jul 22 03:23:06 devstack sudo[96605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:23:06 devstack sudo[96606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9405b366-b9bd-4cc1-9dea-ba94c2fb6eab_pc2_auxzdevstack@QuobyteHD Jul 22 03:23:06 devstack sudo[96606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:23:06 devstack sudo[96606]: pam_unix(sudo:session): session closed for user root Jul 22 03:23:06 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2b7c8669-4a88-46ae-b767-4f7e0f2f450d tempest-TestInstancesWithCinderVolumes-1475916076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9405b366-b9bd-4cc1-9dea-ba94c2fb6eab_pc2_auxzdevstack@QuobyteHD" returned: 0 in 0.426s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:23:06 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-2b7c8669-4a88-46ae-b767-4f7e0f2f450d tempest-TestInstancesWithCinderVolumes-1475916076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:23:06 devstack sudo[96605]: pam_unix(sudo:session): session closed for user root Jul 22 03:23:06 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2bad7833-8260-415c-94f3-0f52d8cd5413 tempest-VolumesSnapshotTestJSON-1822647413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4f096da6-6b62-46a1-9dd5-206f57e9114e.68e77cad-1fc6-4221-9c16-273242a43cec" returned: 0 in 0.578s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:23:06 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-2bad7833-8260-415c-94f3-0f52d8cd5413 tempest-VolumesSnapshotTestJSON-1822647413 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4f096da6-6b62-46a1-9dd5-206f57e9114e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87747) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 03:23:06 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-2bad7833-8260-415c-94f3-0f52d8cd5413 tempest-VolumesSnapshotTestJSON-1822647413 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4f096da6-6b62-46a1-9dd5-206f57e9114e {{(pid=87747) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 22 03:23:06 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-2bad7833-8260-415c-94f3-0f52d8cd5413 tempest-VolumesSnapshotTestJSON-1822647413 None] Creating direct copy from snapshot {{(pid=87747) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 22 03:23:06 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa0effb1-39d1-45d5-a430-c4c0082f7f5b]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:23:06 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2bad7833-8260-415c-94f3-0f52d8cd5413 tempest-VolumesSnapshotTestJSON-1822647413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4f096da6-6b62-46a1-9dd5-206f57e9114e {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:23:06 devstack sudo[96616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4f096da6-6b62-46a1-9dd5-206f57e9114e Jul 22 03:23:06 devstack sudo[96616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:23:07 devstack sudo[96616]: pam_unix(sudo:session): session closed for user root Jul 22 03:23:07 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2bad7833-8260-415c-94f3-0f52d8cd5413 tempest-VolumesSnapshotTestJSON-1822647413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4f096da6-6b62-46a1-9dd5-206f57e9114e" returned: 0 in 0.449s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:23:07 devstack cinder-volume[87747]: DEBUG cinder.utils [None req-2bad7833-8260-415c-94f3-0f52d8cd5413 tempest-VolumesSnapshotTestJSON-1822647413 None] Path /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-40d830a8-3fe2-4d05-92ce-95614658976d not found in is_blk_device check {{(pid=87747) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 22 03:23:07 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2bad7833-8260-415c-94f3-0f52d8cd5413 tempest-VolumesSnapshotTestJSON-1822647413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4f096da6-6b62-46a1-9dd5-206f57e9114e /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-40d830a8-3fe2-4d05-92ce-95614658976d {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:23:07 devstack sudo[96621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4f096da6-6b62-46a1-9dd5-206f57e9114e /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-40d830a8-3fe2-4d05-92ce-95614658976d Jul 22 03:23:07 devstack sudo[96621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:23:12 devstack sudo[96621]: pam_unix(sudo:session): session closed for user root Jul 22 03:23:12 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2bad7833-8260-415c-94f3-0f52d8cd5413 tempest-VolumesSnapshotTestJSON-1822647413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4f096da6-6b62-46a1-9dd5-206f57e9114e /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-40d830a8-3fe2-4d05-92ce-95614658976d" returned: 0 in 5.353s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:23:12 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb22b09-1ab0-4016-8fce-90c404067fe0]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:23:12 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2bad7833-8260-415c-94f3-0f52d8cd5413 tempest-VolumesSnapshotTestJSON-1822647413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4f096da6-6b62-46a1-9dd5-206f57e9114e {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:23:12 devstack sudo[96635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4f096da6-6b62-46a1-9dd5-206f57e9114e Jul 22 03:23:12 devstack sudo[96635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:23:13 devstack sudo[96635]: pam_unix(sudo:session): session closed for user root Jul 22 03:23:13 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2bad7833-8260-415c-94f3-0f52d8cd5413 tempest-VolumesSnapshotTestJSON-1822647413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4f096da6-6b62-46a1-9dd5-206f57e9114e" returned: 0 in 0.628s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:23:13 devstack cinder-volume[87747]: DEBUG cinder.image.image_utils [None req-2bad7833-8260-415c-94f3-0f52d8cd5413 tempest-VolumesSnapshotTestJSON-1822647413 None] Image conversion details: src /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4f096da6-6b62-46a1-9dd5-206f57e9114e, size 1024.00 MB, duration 5.35 sec, destination /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-40d830a8-3fe2-4d05-92ce-95614658976d {{(pid=87747) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 22 03:23:13 devstack cinder-volume[87747]: INFO cinder.image.image_utils [None req-2bad7833-8260-415c-94f3-0f52d8cd5413 tempest-VolumesSnapshotTestJSON-1822647413 None] Converted 1024.00 MB image at 191.26 MB/s Jul 22 03:23:13 devstack cinder-volume[87747]: WARNING cinder.volume.drivers.remotefs [None req-2bad7833-8260-415c-94f3-0f52d8cd5413 tempest-VolumesSnapshotTestJSON-1822647413 None] /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-40d830a8-3fe2-4d05-92ce-95614658976d is being set with open permissions: ugo+rw Jul 22 03:23:13 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2bad7833-8260-415c-94f3-0f52d8cd5413 tempest-VolumesSnapshotTestJSON-1822647413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-40d830a8-3fe2-4d05-92ce-95614658976d {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:23:13 devstack sudo[96663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-40d830a8-3fe2-4d05-92ce-95614658976d Jul 22 03:23:13 devstack sudo[96663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:23:13 devstack sudo[96663]: pam_unix(sudo:session): session closed for user root Jul 22 03:23:13 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2bad7833-8260-415c-94f3-0f52d8cd5413 tempest-VolumesSnapshotTestJSON-1822647413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-40d830a8-3fe2-4d05-92ce-95614658976d" returned: 0 in 0.271s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:23:13 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-2bad7833-8260-415c-94f3-0f52d8cd5413 tempest-VolumesSnapshotTestJSON-1822647413 None] Lock "cinder-quobyte-40d830a8-3fe2-4d05-92ce-95614658976d" released by "_copy_volume_from_snapshot" :: held 7.403s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:23:13 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-2bad7833-8260-415c-94f3-0f52d8cd5413 tempest-VolumesSnapshotTestJSON-1822647413 None] Lock "cinder-quobyte-68e77cad-1fc6-4221-9c16-273242a43cec-40d830a8-3fe2-4d05-92ce-95614658976d" released by "_create_volume_from_snapshot" :: held 7.443s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:23:13 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-2bad7833-8260-415c-94f3-0f52d8cd5413 tempest-VolumesSnapshotTestJSON-1822647413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.470s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:23:13 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-2b7c8669-4a88-46ae-b767-4f7e0f2f450d tempest-TestInstancesWithCinderVolumes-1475916076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.870s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:23:13 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-2b7c8669-4a88-46ae-b767-4f7e0f2f450d tempest-TestInstancesWithCinderVolumes-1475916076 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:22:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-486023640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b636260-1ddf-4058-b489-e696d283b079,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='419f02238ed0422085fef0c6f4fbb409',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:22:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:22:59Z,use_quota=True,user_id='2274af5c76d6400383d38c16933e1c74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7a53271-6412-4fdc-8180-872677c23df5),volume_type_id=b7a53271-6412-4fdc-8180-872677c23df5)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:23:13 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-2b7c8669-4a88-46ae-b767-4f7e0f2f450d tempest-TestInstancesWithCinderVolumes-1475916076 None] Creating volume 8b636260-1ddf-4058-b489-e696d283b079 {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:23:13 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-2b7c8669-4a88-46ae-b767-4f7e0f2f450d tempest-TestInstancesWithCinderVolumes-1475916076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:23:13 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-2b7c8669-4a88-46ae-b767-4f7e0f2f450d tempest-TestInstancesWithCinderVolumes-1475916076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:23:13 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-2b7c8669-4a88-46ae-b767-4f7e0f2f450d tempest-TestInstancesWithCinderVolumes-1475916076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:23:13 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-2b7c8669-4a88-46ae-b767-4f7e0f2f450d tempest-TestInstancesWithCinderVolumes-1475916076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:23:13 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-2b7c8669-4a88-46ae-b767-4f7e0f2f450d tempest-TestInstancesWithCinderVolumes-1475916076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:23:13 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-2b7c8669-4a88-46ae-b767-4f7e0f2f450d tempest-TestInstancesWithCinderVolumes-1475916076 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:23:13 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-2b7c8669-4a88-46ae-b767-4f7e0f2f450d tempest-TestInstancesWithCinderVolumes-1475916076 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:23:13 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2b7c8669-4a88-46ae-b767-4f7e0f2f450d tempest-TestInstancesWithCinderVolumes-1475916076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-8b636260-1ddf-4058-b489-e696d283b079 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:23:13 devstack sudo[96666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-8b636260-1ddf-4058-b489-e696d283b079 1073741824 Jul 22 03:23:13 devstack sudo[96666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:23:13 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2bad7833-8260-415c-94f3-0f52d8cd5413 tempest-VolumesSnapshotTestJSON-1822647413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6619b2a5-da82-4a8c-8a0f-865d9380bcfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40d830a8-3fe2-4d05-92ce-95614658976d', 'volume_size': 2, 'snapshot_id': '68e77cad-1fc6-4221-9c16-273242a43cec'}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:23:13 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2bad7833-8260-415c-94f3-0f52d8cd5413 tempest-VolumesSnapshotTestJSON-1822647413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d9d4b7f-23ac-47f4-84f1-44423844b14a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:23:13 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-2bad7833-8260-415c-94f3-0f52d8cd5413 tempest-VolumesSnapshotTestJSON-1822647413 None] Volume volume-40d830a8-3fe2-4d05-92ce-95614658976d (40d830a8-3fe2-4d05-92ce-95614658976d): created successfully Jul 22 03:23:13 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2bad7833-8260-415c-94f3-0f52d8cd5413 tempest-VolumesSnapshotTestJSON-1822647413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d9d4b7f-23ac-47f4-84f1-44423844b14a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:23:13 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2bad7833-8260-415c-94f3-0f52d8cd5413 tempest-VolumesSnapshotTestJSON-1822647413 None] Flow 'volume_create_manager' (b9688527-fa7b-4f7a-980c-6c47b2b55104) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:23:13 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-2bad7833-8260-415c-94f3-0f52d8cd5413 tempest-VolumesSnapshotTestJSON-1822647413 None] Created volume successfully. Jul 22 03:23:13 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-ec4b6418-166d-4b29-8318-57132c4c9ba9 tempest-VolumesSnapshotTestJSON-1822647413 None] Acquiring lock "cinder-40d830a8-3fe2-4d05-92ce-95614658976d-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:23:13 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-ec4b6418-166d-4b29-8318-57132c4c9ba9 tempest-VolumesSnapshotTestJSON-1822647413 None] Lock "cinder-40d830a8-3fe2-4d05-92ce-95614658976d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:23:14 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-ec4b6418-166d-4b29-8318-57132c4c9ba9 tempest-VolumesSnapshotTestJSON-1822647413 None] Acquiring lock "cinder-quobyte-40d830a8-3fe2-4d05-92ce-95614658976d" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:23:14 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-ec4b6418-166d-4b29-8318-57132c4c9ba9 tempest-VolumesSnapshotTestJSON-1822647413 None] Lock "cinder-quobyte-40d830a8-3fe2-4d05-92ce-95614658976d" acquired by "delete_volume" :: waited 0.020s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:23:14 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[260b1d7e-c5a3-4f39-aea2-63109ad80bc2]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:23:14 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ec4b6418-166d-4b29-8318-57132c4c9ba9 tempest-VolumesSnapshotTestJSON-1822647413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-40d830a8-3fe2-4d05-92ce-95614658976d {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:23:14 devstack sudo[96666]: pam_unix(sudo:session): session closed for user root Jul 22 03:23:14 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2b7c8669-4a88-46ae-b767-4f7e0f2f450d tempest-TestInstancesWithCinderVolumes-1475916076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-8b636260-1ddf-4058-b489-e696d283b079 1073741824" returned: 0 in 0.529s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:23:14 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2b7c8669-4a88-46ae-b767-4f7e0f2f450d tempest-TestInstancesWithCinderVolumes-1475916076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-8b636260-1ddf-4058-b489-e696d283b079 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:23:14 devstack sudo[96672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-40d830a8-3fe2-4d05-92ce-95614658976d Jul 22 03:23:14 devstack sudo[96672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:23:14 devstack sudo[96673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-8b636260-1ddf-4058-b489-e696d283b079 Jul 22 03:23:14 devstack sudo[96673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:23:14 devstack sudo[96672]: pam_unix(sudo:session): session closed for user root Jul 22 03:23:14 devstack sudo[96673]: pam_unix(sudo:session): session closed for user root Jul 22 03:23:14 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ec4b6418-166d-4b29-8318-57132c4c9ba9 tempest-VolumesSnapshotTestJSON-1822647413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-40d830a8-3fe2-4d05-92ce-95614658976d" returned: 0 in 0.366s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:23:14 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ec4b6418-166d-4b29-8318-57132c4c9ba9 tempest-VolumesSnapshotTestJSON-1822647413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-40d830a8-3fe2-4d05-92ce-95614658976d {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:23:14 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2b7c8669-4a88-46ae-b767-4f7e0f2f450d tempest-TestInstancesWithCinderVolumes-1475916076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-8b636260-1ddf-4058-b489-e696d283b079" returned: 0 in 0.279s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:23:14 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-2b7c8669-4a88-46ae-b767-4f7e0f2f450d tempest-TestInstancesWithCinderVolumes-1475916076 None] <== create_volume: return (851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:23:14 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-2b7c8669-4a88-46ae-b767-4f7e0f2f450d tempest-TestInstancesWithCinderVolumes-1475916076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.855s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:23:14 devstack sudo[96680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-40d830a8-3fe2-4d05-92ce-95614658976d Jul 22 03:23:14 devstack sudo[96680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:23:14 devstack cinder-volume[87747]: DEBUG cinder.volume.volume_utils [None req-2b7c8669-4a88-46ae-b767-4f7e0f2f450d tempest-TestInstancesWithCinderVolumes-1475916076 None] Attempting download of 9405b366-b9bd-4cc1-9dea-ba94c2fb6eab ((None, [{'url': 'file:///opt/stack/data/glance/images/9405b366-b9bd-4cc1-9dea-ba94c2fb6eab', 'metadata': {}}])) to volume 8b636260-1ddf-4058-b489-e696d283b079. {{(pid=87747) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 22 03:23:14 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[08fce4a0-d195-4238-a985-9736da5cba0b]: (4, 'raw') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:23:14 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2b7c8669-4a88-46ae-b767-4f7e0f2f450d tempest-TestInstancesWithCinderVolumes-1475916076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9405b366-b9bd-4cc1-9dea-ba94c2fb6eab_t5_v_syl {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:23:14 devstack sudo[96682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9405b366-b9bd-4cc1-9dea-ba94c2fb6eab_t5_v_syl Jul 22 03:23:14 devstack sudo[96682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:23:14 devstack sudo[96680]: pam_unix(sudo:session): session closed for user root Jul 22 03:23:14 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ec4b6418-166d-4b29-8318-57132c4c9ba9 tempest-VolumesSnapshotTestJSON-1822647413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-40d830a8-3fe2-4d05-92ce-95614658976d" returned: 0 in 0.291s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:23:14 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-ec4b6418-166d-4b29-8318-57132c4c9ba9 tempest-VolumesSnapshotTestJSON-1822647413 None] Lock "cinder-quobyte-40d830a8-3fe2-4d05-92ce-95614658976d" released by "delete_volume" :: held 0.709s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:23:14 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-ec4b6418-166d-4b29-8318-57132c4c9ba9 tempest-VolumesSnapshotTestJSON-1822647413 None] Created reservations ['00ed1fdd-ab86-4b7b-a766-4393f460f6ed', 'dfa17a3a-47d0-4e00-8603-0519b1134c77', 'de3773d5-64d6-4d13-be03-230cdac0a786', 'f787e8c9-3a81-432b-9030-ab8a1546a1d3'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:23:14 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-ec4b6418-166d-4b29-8318-57132c4c9ba9 tempest-VolumesSnapshotTestJSON-1822647413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:23:14 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-ec4b6418-166d-4b29-8318-57132c4c9ba9 tempest-VolumesSnapshotTestJSON-1822647413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:23:14 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-ec4b6418-166d-4b29-8318-57132c4c9ba9 tempest-VolumesSnapshotTestJSON-1822647413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:23:14 devstack sudo[96682]: pam_unix(sudo:session): session closed for user root Jul 22 03:23:14 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-ec4b6418-166d-4b29-8318-57132c4c9ba9 tempest-VolumesSnapshotTestJSON-1822647413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:23:14 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-ec4b6418-166d-4b29-8318-57132c4c9ba9 tempest-VolumesSnapshotTestJSON-1822647413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:23:14 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ec4b6418-166d-4b29-8318-57132c4c9ba9 tempest-VolumesSnapshotTestJSON-1822647413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:23:14 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2b7c8669-4a88-46ae-b767-4f7e0f2f450d tempest-TestInstancesWithCinderVolumes-1475916076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9405b366-b9bd-4cc1-9dea-ba94c2fb6eab_t5_v_syl" returned: 0 in 0.357s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:23:14 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2b7c8669-4a88-46ae-b767-4f7e0f2f450d tempest-TestInstancesWithCinderVolumes-1475916076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9405b366-b9bd-4cc1-9dea-ba94c2fb6eab_t5_v_syl {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:23:14 devstack sudo[96687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:23:14 devstack sudo[96687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:23:15 devstack sudo[96688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9405b366-b9bd-4cc1-9dea-ba94c2fb6eab_t5_v_syl Jul 22 03:23:15 devstack sudo[96688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:23:15 devstack sudo[96687]: pam_unix(sudo:session): session closed for user root Jul 22 03:23:15 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ec4b6418-166d-4b29-8318-57132c4c9ba9 tempest-VolumesSnapshotTestJSON-1822647413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.326s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:23:15 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-ec4b6418-166d-4b29-8318-57132c4c9ba9 tempest-VolumesSnapshotTestJSON-1822647413 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:23:15 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-ec4b6418-166d-4b29-8318-57132c4c9ba9 tempest-VolumesSnapshotTestJSON-1822647413 None] Deleted volume successfully. Jul 22 03:23:15 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-4e7bab55-c94f-4adb-91b9-3d4340337a92 tempest-VolumesSnapshotTestJSON-1822647413 None] Acquiring lock "cinder-68e77cad-1fc6-4221-9c16-273242a43cec-delete_snapshot" by "delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:23:15 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-ec4b6418-166d-4b29-8318-57132c4c9ba9 tempest-VolumesSnapshotTestJSON-1822647413 None] Lock "cinder-40d830a8-3fe2-4d05-92ce-95614658976d-delete_volume" released by "delete_volume" :: held 1.300s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:23:15 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-4e7bab55-c94f-4adb-91b9-3d4340337a92 tempest-VolumesSnapshotTestJSON-1822647413 None] Lock "cinder-68e77cad-1fc6-4221-9c16-273242a43cec-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:23:15 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-4e7bab55-c94f-4adb-91b9-3d4340337a92 tempest-VolumesSnapshotTestJSON-1822647413 None] Acquiring lock "cinder-quobyte-4f096da6-6b62-46a1-9dd5-206f57e9114e" by "delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:23:15 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-4e7bab55-c94f-4adb-91b9-3d4340337a92 tempest-VolumesSnapshotTestJSON-1822647413 None] Lock "cinder-quobyte-4f096da6-6b62-46a1-9dd5-206f57e9114e" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:23:15 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-4e7bab55-c94f-4adb-91b9-3d4340337a92 tempest-VolumesSnapshotTestJSON-1822647413 None] Acquiring lock "cinder-quobyte-68e77cad-1fc6-4221-9c16-273242a43cec" by "_delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:23:15 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-4e7bab55-c94f-4adb-91b9-3d4340337a92 tempest-VolumesSnapshotTestJSON-1822647413 None] Lock "cinder-quobyte-68e77cad-1fc6-4221-9c16-273242a43cec" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:23:15 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-4e7bab55-c94f-4adb-91b9-3d4340337a92 tempest-VolumesSnapshotTestJSON-1822647413 None] Deleting offline snapshot 68e77cad-1fc6-4221-9c16-273242a43cec of volume 4f096da6-6b62-46a1-9dd5-206f57e9114e {{(pid=87747) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 03:23:15 devstack sudo[96688]: pam_unix(sudo:session): session closed for user root Jul 22 03:23:15 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-4e7bab55-c94f-4adb-91b9-3d4340337a92 tempest-VolumesSnapshotTestJSON-1822647413 None] snapshot_file for this snap is: volume-4f096da6-6b62-46a1-9dd5-206f57e9114e.68e77cad-1fc6-4221-9c16-273242a43cec {{(pid=87747) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 03:23:15 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2b7c8669-4a88-46ae-b767-4f7e0f2f450d tempest-TestInstancesWithCinderVolumes-1475916076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9405b366-b9bd-4cc1-9dea-ba94c2fb6eab_t5_v_syl" returned: 1 in 0.435s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:23:15 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2b7c8669-4a88-46ae-b767-4f7e0f2f450d tempest-TestInstancesWithCinderVolumes-1475916076 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9405b366-b9bd-4cc1-9dea-ba94c2fb6eab_t5_v_syl' failed. Not Retrying. {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 22 03:23:15 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[34f70be7-dd0d-4dfb-83d0-9081ed9800cf]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:23:15 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2b7c8669-4a88-46ae-b767-4f7e0f2f450d tempest-TestInstancesWithCinderVolumes-1475916076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9405b366-b9bd-4cc1-9dea-ba94c2fb6eab_pc2_auxzdevstack@QuobyteHD {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:23:15 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[92b5b247-cd21-482a-b8c2-d6d29b8fe137]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:23:15 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-4e7bab55-c94f-4adb-91b9-3d4340337a92 tempest-VolumesSnapshotTestJSON-1822647413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4f096da6-6b62-46a1-9dd5-206f57e9114e.68e77cad-1fc6-4221-9c16-273242a43cec {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:23:15 devstack sudo[96695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9405b366-b9bd-4cc1-9dea-ba94c2fb6eab_pc2_auxzdevstack@QuobyteHD Jul 22 03:23:15 devstack sudo[96695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:23:15 devstack sudo[96696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4f096da6-6b62-46a1-9dd5-206f57e9114e.68e77cad-1fc6-4221-9c16-273242a43cec Jul 22 03:23:15 devstack sudo[96696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:23:15 devstack sudo[96695]: pam_unix(sudo:session): session closed for user root Jul 22 03:23:15 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2b7c8669-4a88-46ae-b767-4f7e0f2f450d tempest-TestInstancesWithCinderVolumes-1475916076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9405b366-b9bd-4cc1-9dea-ba94c2fb6eab_pc2_auxzdevstack@QuobyteHD" returned: 0 in 0.392s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:23:15 devstack cinder-volume[87747]: DEBUG cinder.image.image_utils [None req-2b7c8669-4a88-46ae-b767-4f7e0f2f450d tempest-TestInstancesWithCinderVolumes-1475916076 None] 9405b366-b9bd-4cc1-9dea-ba94c2fb6eab was qcow2, converting to qcow2 {{(pid=87747) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 22 03:23:15 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2b7c8669-4a88-46ae-b767-4f7e0f2f450d tempest-TestInstancesWithCinderVolumes-1475916076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9405b366-b9bd-4cc1-9dea-ba94c2fb6eab_pc2_auxzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-8b636260-1ddf-4058-b489-e696d283b079 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:23:15 devstack sudo[96696]: pam_unix(sudo:session): session closed for user root Jul 22 03:23:15 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-4e7bab55-c94f-4adb-91b9-3d4340337a92 tempest-VolumesSnapshotTestJSON-1822647413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4f096da6-6b62-46a1-9dd5-206f57e9114e.68e77cad-1fc6-4221-9c16-273242a43cec" returned: 0 in 0.411s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:23:15 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-4e7bab55-c94f-4adb-91b9-3d4340337a92 tempest-VolumesSnapshotTestJSON-1822647413 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4f096da6-6b62-46a1-9dd5-206f57e9114e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87747) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 03:23:15 devstack sudo[96705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9405b366-b9bd-4cc1-9dea-ba94c2fb6eab_pc2_auxzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-8b636260-1ddf-4058-b489-e696d283b079 Jul 22 03:23:15 devstack sudo[96705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:23:15 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[45af0c7b-4f1f-4f30-aec4-460c86640b3f]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:23:15 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-4e7bab55-c94f-4adb-91b9-3d4340337a92 tempest-VolumesSnapshotTestJSON-1822647413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4f096da6-6b62-46a1-9dd5-206f57e9114e {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:23:15 devstack sudo[96707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4f096da6-6b62-46a1-9dd5-206f57e9114e Jul 22 03:23:15 devstack sudo[96707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:23:16 devstack sudo[96707]: pam_unix(sudo:session): session closed for user root Jul 22 03:23:16 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-4e7bab55-c94f-4adb-91b9-3d4340337a92 tempest-VolumesSnapshotTestJSON-1822647413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4f096da6-6b62-46a1-9dd5-206f57e9114e" returned: 0 in 0.396s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:23:16 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-4e7bab55-c94f-4adb-91b9-3d4340337a92 tempest-VolumesSnapshotTestJSON-1822647413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4f096da6-6b62-46a1-9dd5-206f57e9114e.68e77cad-1fc6-4221-9c16-273242a43cec {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:23:16 devstack sudo[96722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4f096da6-6b62-46a1-9dd5-206f57e9114e.68e77cad-1fc6-4221-9c16-273242a43cec Jul 22 03:23:16 devstack sudo[96722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:23:16 devstack sudo[96722]: pam_unix(sudo:session): session closed for user root Jul 22 03:23:16 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-4e7bab55-c94f-4adb-91b9-3d4340337a92 tempest-VolumesSnapshotTestJSON-1822647413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4f096da6-6b62-46a1-9dd5-206f57e9114e.68e77cad-1fc6-4221-9c16-273242a43cec" returned: 0 in 0.444s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:23:16 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-4e7bab55-c94f-4adb-91b9-3d4340337a92 tempest-VolumesSnapshotTestJSON-1822647413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4f096da6-6b62-46a1-9dd5-206f57e9114e.68e77cad-1fc6-4221-9c16-273242a43cec {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:23:16 devstack sudo[96728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4f096da6-6b62-46a1-9dd5-206f57e9114e.68e77cad-1fc6-4221-9c16-273242a43cec Jul 22 03:23:16 devstack sudo[96728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:23:16 devstack sudo[96728]: pam_unix(sudo:session): session closed for user root Jul 22 03:23:16 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-4e7bab55-c94f-4adb-91b9-3d4340337a92 tempest-VolumesSnapshotTestJSON-1822647413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4f096da6-6b62-46a1-9dd5-206f57e9114e.68e77cad-1fc6-4221-9c16-273242a43cec" returned: 0 in 0.274s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:23:16 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-4e7bab55-c94f-4adb-91b9-3d4340337a92 tempest-VolumesSnapshotTestJSON-1822647413 None] Lock "cinder-quobyte-68e77cad-1fc6-4221-9c16-273242a43cec" released by "_delete_snapshot" :: held 1.660s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:23:16 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-4e7bab55-c94f-4adb-91b9-3d4340337a92 tempest-VolumesSnapshotTestJSON-1822647413 None] Lock "cinder-quobyte-4f096da6-6b62-46a1-9dd5-206f57e9114e" released by "delete_snapshot" :: held 1.687s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:23:17 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-4e7bab55-c94f-4adb-91b9-3d4340337a92 tempest-VolumesSnapshotTestJSON-1822647413 None] Created reservations ['a7dfb90f-a6bd-43f6-b3b7-9a11488f2c80', '9aed726e-1e7d-4398-8ee9-45031c8ed4ab', 'e64559d9-6fed-4656-8e4d-0db12cd93a01', '42d740aa-561c-4dde-9dd8-509f50646476'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:23:17 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-4e7bab55-c94f-4adb-91b9-3d4340337a92 tempest-VolumesSnapshotTestJSON-1822647413 None] Delete snapshot completed successfully. Jul 22 03:23:17 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-4e7bab55-c94f-4adb-91b9-3d4340337a92 tempest-VolumesSnapshotTestJSON-1822647413 None] Lock "cinder-68e77cad-1fc6-4221-9c16-273242a43cec-delete_snapshot" released by "delete_snapshot" :: held 1.842s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:23:17 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-6e96a039-907e-4133-9f07-9c9655e7bfc5 tempest-VolumesSnapshotTestJSON-1822647413 None] Acquiring lock "cinder-4f096da6-6b62-46a1-9dd5-206f57e9114e-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:23:17 devstack sudo[96705]: pam_unix(sudo:session): session closed for user root Jul 22 03:23:17 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-6e96a039-907e-4133-9f07-9c9655e7bfc5 tempest-VolumesSnapshotTestJSON-1822647413 None] Lock "cinder-4f096da6-6b62-46a1-9dd5-206f57e9114e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:23:17 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2b7c8669-4a88-46ae-b767-4f7e0f2f450d tempest-TestInstancesWithCinderVolumes-1475916076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9405b366-b9bd-4cc1-9dea-ba94c2fb6eab_pc2_auxzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-8b636260-1ddf-4058-b489-e696d283b079" returned: 0 in 1.756s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:23:17 devstack cinder-volume[87747]: DEBUG cinder.image.image_utils [None req-2b7c8669-4a88-46ae-b767-4f7e0f2f450d tempest-TestInstancesWithCinderVolumes-1475916076 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9405b366-b9bd-4cc1-9dea-ba94c2fb6eab_pc2_auxzdevstack@QuobyteHD, size 112.00 MB, duration 1.76 sec, destination /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-8b636260-1ddf-4058-b489-e696d283b079 {{(pid=87747) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 22 03:23:17 devstack cinder-volume[87747]: INFO cinder.image.image_utils [None req-2b7c8669-4a88-46ae-b767-4f7e0f2f450d tempest-TestInstancesWithCinderVolumes-1475916076 None] Converted 112.00 MB image at 63.75 MB/s Jul 22 03:23:17 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2b7c8669-4a88-46ae-b767-4f7e0f2f450d tempest-TestInstancesWithCinderVolumes-1475916076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-8b636260-1ddf-4058-b489-e696d283b079 1G {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:23:17 devstack sudo[96739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-8b636260-1ddf-4058-b489-e696d283b079 1G Jul 22 03:23:17 devstack sudo[96739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:23:17 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-6e96a039-907e-4133-9f07-9c9655e7bfc5 tempest-VolumesSnapshotTestJSON-1822647413 None] Acquiring lock "cinder-quobyte-4f096da6-6b62-46a1-9dd5-206f57e9114e" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:23:17 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-6e96a039-907e-4133-9f07-9c9655e7bfc5 tempest-VolumesSnapshotTestJSON-1822647413 None] Lock "cinder-quobyte-4f096da6-6b62-46a1-9dd5-206f57e9114e" acquired by "delete_volume" :: waited 0.015s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:23:17 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[361c7499-1367-47f2-ba5f-7d6bd555520c]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:23:17 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-6e96a039-907e-4133-9f07-9c9655e7bfc5 tempest-VolumesSnapshotTestJSON-1822647413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4f096da6-6b62-46a1-9dd5-206f57e9114e {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:23:17 devstack sudo[96741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4f096da6-6b62-46a1-9dd5-206f57e9114e Jul 22 03:23:17 devstack sudo[96741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:23:17 devstack sudo[96739]: pam_unix(sudo:session): session closed for user root Jul 22 03:23:17 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2b7c8669-4a88-46ae-b767-4f7e0f2f450d tempest-TestInstancesWithCinderVolumes-1475916076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-8b636260-1ddf-4058-b489-e696d283b079 1G" returned: 0 in 0.373s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:23:17 devstack cinder-volume[87747]: DEBUG cinder.volume.volume_utils [None req-2b7c8669-4a88-46ae-b767-4f7e0f2f450d tempest-TestInstancesWithCinderVolumes-1475916076 None] Downloaded image 9405b366-b9bd-4cc1-9dea-ba94c2fb6eab ((None, [{'url': 'file:///opt/stack/data/glance/images/9405b366-b9bd-4cc1-9dea-ba94c2fb6eab', 'metadata': {}}])) to volume 8b636260-1ddf-4058-b489-e696d283b079 successfully. {{(pid=87747) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 22 03:23:17 devstack cinder-volume[87747]: DEBUG cinder.image.image_utils [None req-2b7c8669-4a88-46ae-b767-4f7e0f2f450d tempest-TestInstancesWithCinderVolumes-1475916076 None] Temporary image 9405b366-b9bd-4cc1-9dea-ba94c2fb6eab for user 2274af5c76d6400383d38c16933e1c74 is deleted. {{(pid=87747) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 22 03:23:17 devstack cinder-volume[87747]: DEBUG cinder.volume.volume_utils [None req-2b7c8669-4a88-46ae-b767-4f7e0f2f450d tempest-TestInstancesWithCinderVolumes-1475916076 None] Marking volume 8b636260-1ddf-4058-b489-e696d283b079 as bootable. {{(pid=87747) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 22 03:23:17 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b7c8669-4a88-46ae-b767-4f7e0f2f450d tempest-TestInstancesWithCinderVolumes-1475916076 None] Copying metadata from image 9405b366-b9bd-4cc1-9dea-ba94c2fb6eab to 8b636260-1ddf-4058-b489-e696d283b079. {{(pid=87747) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 22 03:23:17 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b7c8669-4a88-46ae-b767-4f7e0f2f450d tempest-TestInstancesWithCinderVolumes-1475916076 None] Creating volume glance metadata for volume 8b636260-1ddf-4058-b489-e696d283b079 backed by image 9405b366-b9bd-4cc1-9dea-ba94c2fb6eab with: {'image_id': '9405b366-b9bd-4cc1-9dea-ba94c2fb6eab', 'image_name': 'tempest-scenario-img--1480235736', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87747) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 22 03:23:17 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2b7c8669-4a88-46ae-b767-4f7e0f2f450d tempest-TestInstancesWithCinderVolumes-1475916076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd6930d6-7791-42df-9b42-c7004e372a2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b636260-1ddf-4058-b489-e696d283b079', 'volume_size': 1, 'image_id': '9405b366-b9bd-4cc1-9dea-ba94c2fb6eab', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9405b366-b9bd-4cc1-9dea-ba94c2fb6eab', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1480235736', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '419f02238ed0422085fef0c6f4fbb409', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9405b366-b9bd-4cc1-9dea-ba94c2fb6eab', 'created_at': datetime.datetime(2026, 7, 22, 1, 22, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 22, 1, 22, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9405b366-b9bd-4cc1-9dea-ba94c2fb6eab/file', 'properties': {}}, 'image_service': }' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:23:17 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2b7c8669-4a88-46ae-b767-4f7e0f2f450d tempest-TestInstancesWithCinderVolumes-1475916076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f4e23a6-628c-4d7d-9b3d-929c8f126558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:23:17 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-2b7c8669-4a88-46ae-b767-4f7e0f2f450d tempest-TestInstancesWithCinderVolumes-1475916076 None] Volume volume-8b636260-1ddf-4058-b489-e696d283b079 (8b636260-1ddf-4058-b489-e696d283b079): created successfully Jul 22 03:23:17 devstack sudo[96741]: pam_unix(sudo:session): session closed for user root Jul 22 03:23:17 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2b7c8669-4a88-46ae-b767-4f7e0f2f450d tempest-TestInstancesWithCinderVolumes-1475916076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f4e23a6-628c-4d7d-9b3d-929c8f126558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:23:17 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2b7c8669-4a88-46ae-b767-4f7e0f2f450d tempest-TestInstancesWithCinderVolumes-1475916076 None] Flow 'volume_create_manager' (633d3c20-c395-44c6-8569-686007a2c918) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:23:17 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-6e96a039-907e-4133-9f07-9c9655e7bfc5 tempest-VolumesSnapshotTestJSON-1822647413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4f096da6-6b62-46a1-9dd5-206f57e9114e" returned: 0 in 0.390s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:23:17 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-6e96a039-907e-4133-9f07-9c9655e7bfc5 tempest-VolumesSnapshotTestJSON-1822647413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4f096da6-6b62-46a1-9dd5-206f57e9114e {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:23:18 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-2b7c8669-4a88-46ae-b767-4f7e0f2f450d tempest-TestInstancesWithCinderVolumes-1475916076 None] Created volume successfully. Jul 22 03:23:18 devstack sudo[96749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4f096da6-6b62-46a1-9dd5-206f57e9114e Jul 22 03:23:18 devstack sudo[96749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:23:18 devstack sudo[96749]: pam_unix(sudo:session): session closed for user root Jul 22 03:23:18 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-6e96a039-907e-4133-9f07-9c9655e7bfc5 tempest-VolumesSnapshotTestJSON-1822647413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4f096da6-6b62-46a1-9dd5-206f57e9114e" returned: 0 in 0.242s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:23:18 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-6e96a039-907e-4133-9f07-9c9655e7bfc5 tempest-VolumesSnapshotTestJSON-1822647413 None] Lock "cinder-quobyte-4f096da6-6b62-46a1-9dd5-206f57e9114e" released by "delete_volume" :: held 0.692s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:23:18 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-6e96a039-907e-4133-9f07-9c9655e7bfc5 tempest-VolumesSnapshotTestJSON-1822647413 None] Created reservations ['b7de7649-b9f2-4a93-85e7-8feab48f7972', 'd9ef61ab-5409-4eca-a21f-948cf1992c18', '646e751f-db95-441a-b91d-732eff13edef', '7c93c54c-609f-4348-83de-3fbeab5ebb8a'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:23:18 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-6e96a039-907e-4133-9f07-9c9655e7bfc5 tempest-VolumesSnapshotTestJSON-1822647413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:23:18 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-6e96a039-907e-4133-9f07-9c9655e7bfc5 tempest-VolumesSnapshotTestJSON-1822647413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:23:18 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-6e96a039-907e-4133-9f07-9c9655e7bfc5 tempest-VolumesSnapshotTestJSON-1822647413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:23:18 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-6e96a039-907e-4133-9f07-9c9655e7bfc5 tempest-VolumesSnapshotTestJSON-1822647413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:23:18 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-6e96a039-907e-4133-9f07-9c9655e7bfc5 tempest-VolumesSnapshotTestJSON-1822647413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:23:18 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-6e96a039-907e-4133-9f07-9c9655e7bfc5 tempest-VolumesSnapshotTestJSON-1822647413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:23:18 devstack sudo[96752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:23:18 devstack sudo[96752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:23:18 devstack sudo[96752]: pam_unix(sudo:session): session closed for user root Jul 22 03:23:18 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-6e96a039-907e-4133-9f07-9c9655e7bfc5 tempest-VolumesSnapshotTestJSON-1822647413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.251s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:23:18 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-6e96a039-907e-4133-9f07-9c9655e7bfc5 tempest-VolumesSnapshotTestJSON-1822647413 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:23:18 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-6e96a039-907e-4133-9f07-9c9655e7bfc5 tempest-VolumesSnapshotTestJSON-1822647413 None] Deleted volume successfully. Jul 22 03:23:18 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-6e96a039-907e-4133-9f07-9c9655e7bfc5 tempest-VolumesSnapshotTestJSON-1822647413 None] Lock "cinder-4f096da6-6b62-46a1-9dd5-206f57e9114e-delete_volume" released by "delete_volume" :: held 1.144s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:23:19 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-16fa8b82-21de-4952-817f-e32b5f458627 tempest-VolumesSnapshotTestJSON-1822647413 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:23:19 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-16fa8b82-21de-4952-817f-e32b5f458627 tempest-VolumesSnapshotTestJSON-1822647413 None] Flow 'volume_create_manager' (01acdef7-aac8-49a4-984f-969b4500d714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:23:19 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-16fa8b82-21de-4952-817f-e32b5f458627 tempest-VolumesSnapshotTestJSON-1822647413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f49be22-9a42-46a5-b5b6-6b17965683de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:23:19 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-16fa8b82-21de-4952-817f-e32b5f458627 tempest-VolumesSnapshotTestJSON-1822647413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f49be22-9a42-46a5-b5b6-6b17965683de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:23:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2119948047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d893632e-3fde-4f03-bdc2-97eed837402b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6166f63d820041daa3dbed33b7b5865e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:23:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:23:19Z,use_quota=True,user_id='d926305a7e4740cd89dcfbca5546f47f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:23:19 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-16fa8b82-21de-4952-817f-e32b5f458627 tempest-VolumesSnapshotTestJSON-1822647413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49d46335-f978-4eec-a2ec-726985e40d56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:23:19 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-16fa8b82-21de-4952-817f-e32b5f458627 tempest-VolumesSnapshotTestJSON-1822647413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49d46335-f978-4eec-a2ec-726985e40d56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:23:19 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-16fa8b82-21de-4952-817f-e32b5f458627 tempest-VolumesSnapshotTestJSON-1822647413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc503a3a-d435-4ce8-9aa0-3fbe856349ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:23:19 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-16fa8b82-21de-4952-817f-e32b5f458627 tempest-VolumesSnapshotTestJSON-1822647413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc503a3a-d435-4ce8-9aa0-3fbe856349ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd893632e-3fde-4f03-bdc2-97eed837402b', 'volume_name': 'volume-d893632e-3fde-4f03-bdc2-97eed837402b', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:23:19 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-16fa8b82-21de-4952-817f-e32b5f458627 tempest-VolumesSnapshotTestJSON-1822647413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70edd90c-ad2b-4863-98f8-b535c43ac3a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:23:19 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-16fa8b82-21de-4952-817f-e32b5f458627 tempest-VolumesSnapshotTestJSON-1822647413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70edd90c-ad2b-4863-98f8-b535c43ac3a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:23:19 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-16fa8b82-21de-4952-817f-e32b5f458627 tempest-VolumesSnapshotTestJSON-1822647413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (797344c3-3561-4d30-b037-e34eff6198d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:23:19 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-16fa8b82-21de-4952-817f-e32b5f458627 tempest-VolumesSnapshotTestJSON-1822647413 None] Volume d893632e-3fde-4f03-bdc2-97eed837402b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d893632e-3fde-4f03-bdc2-97eed837402b', 'volume_size': 1} Jul 22 03:23:19 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-16fa8b82-21de-4952-817f-e32b5f458627 tempest-VolumesSnapshotTestJSON-1822647413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:23:19 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-16fa8b82-21de-4952-817f-e32b5f458627 tempest-VolumesSnapshotTestJSON-1822647413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:23:19 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-16fa8b82-21de-4952-817f-e32b5f458627 tempest-VolumesSnapshotTestJSON-1822647413 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:23:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2119948047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d893632e-3fde-4f03-bdc2-97eed837402b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6166f63d820041daa3dbed33b7b5865e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:23:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:23:19Z,use_quota=True,user_id='d926305a7e4740cd89dcfbca5546f47f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:23:19 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-16fa8b82-21de-4952-817f-e32b5f458627 tempest-VolumesSnapshotTestJSON-1822647413 None] Creating volume d893632e-3fde-4f03-bdc2-97eed837402b {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:23:19 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-16fa8b82-21de-4952-817f-e32b5f458627 tempest-VolumesSnapshotTestJSON-1822647413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:23:19 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-16fa8b82-21de-4952-817f-e32b5f458627 tempest-VolumesSnapshotTestJSON-1822647413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:23:19 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-16fa8b82-21de-4952-817f-e32b5f458627 tempest-VolumesSnapshotTestJSON-1822647413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:23:19 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-16fa8b82-21de-4952-817f-e32b5f458627 tempest-VolumesSnapshotTestJSON-1822647413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:23:19 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-16fa8b82-21de-4952-817f-e32b5f458627 tempest-VolumesSnapshotTestJSON-1822647413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:23:19 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-16fa8b82-21de-4952-817f-e32b5f458627 tempest-VolumesSnapshotTestJSON-1822647413 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:23:19 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-16fa8b82-21de-4952-817f-e32b5f458627 tempest-VolumesSnapshotTestJSON-1822647413 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:23:19 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-16fa8b82-21de-4952-817f-e32b5f458627 tempest-VolumesSnapshotTestJSON-1822647413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d893632e-3fde-4f03-bdc2-97eed837402b 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:23:19 devstack sudo[96755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d893632e-3fde-4f03-bdc2-97eed837402b 1073741824 Jul 22 03:23:19 devstack sudo[96755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:23:19 devstack sudo[96755]: pam_unix(sudo:session): session closed for user root Jul 22 03:23:19 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-16fa8b82-21de-4952-817f-e32b5f458627 tempest-VolumesSnapshotTestJSON-1822647413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d893632e-3fde-4f03-bdc2-97eed837402b 1073741824" returned: 0 in 0.436s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:23:19 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-16fa8b82-21de-4952-817f-e32b5f458627 tempest-VolumesSnapshotTestJSON-1822647413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d893632e-3fde-4f03-bdc2-97eed837402b {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:23:19 devstack sudo[96761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d893632e-3fde-4f03-bdc2-97eed837402b Jul 22 03:23:19 devstack sudo[96761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:23:19 devstack sudo[96761]: pam_unix(sudo:session): session closed for user root Jul 22 03:23:19 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-16fa8b82-21de-4952-817f-e32b5f458627 tempest-VolumesSnapshotTestJSON-1822647413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d893632e-3fde-4f03-bdc2-97eed837402b" returned: 0 in 0.254s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:23:19 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-16fa8b82-21de-4952-817f-e32b5f458627 tempest-VolumesSnapshotTestJSON-1822647413 None] <== create_volume: return (746ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:23:19 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-16fa8b82-21de-4952-817f-e32b5f458627 tempest-VolumesSnapshotTestJSON-1822647413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.749s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:23:19 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-16fa8b82-21de-4952-817f-e32b5f458627 tempest-VolumesSnapshotTestJSON-1822647413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (797344c3-3561-4d30-b037-e34eff6198d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d893632e-3fde-4f03-bdc2-97eed837402b', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:23:19 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-16fa8b82-21de-4952-817f-e32b5f458627 tempest-VolumesSnapshotTestJSON-1822647413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e15f286-0570-482c-9f57-a80528b2a289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:23:20 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-16fa8b82-21de-4952-817f-e32b5f458627 tempest-VolumesSnapshotTestJSON-1822647413 None] Volume volume-d893632e-3fde-4f03-bdc2-97eed837402b (d893632e-3fde-4f03-bdc2-97eed837402b): created successfully Jul 22 03:23:20 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-16fa8b82-21de-4952-817f-e32b5f458627 tempest-VolumesSnapshotTestJSON-1822647413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e15f286-0570-482c-9f57-a80528b2a289) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:23:20 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-16fa8b82-21de-4952-817f-e32b5f458627 tempest-VolumesSnapshotTestJSON-1822647413 None] Flow 'volume_create_manager' (01acdef7-aac8-49a4-984f-969b4500d714) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:23:20 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-16fa8b82-21de-4952-817f-e32b5f458627 tempest-VolumesSnapshotTestJSON-1822647413 None] Created volume successfully. Jul 22 03:23:20 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-5f902953-473e-4a71-bb20-172f6a005fe2 tempest-VolumesSnapshotTestJSON-1822647413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:23:20 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-5f902953-473e-4a71-bb20-172f6a005fe2 tempest-VolumesSnapshotTestJSON-1822647413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:23:20 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-5f902953-473e-4a71-bb20-172f6a005fe2 tempest-VolumesSnapshotTestJSON-1822647413 None] Creating offline snapshot 02386c03-93c2-403e-bd09-4854574240a6 of volume d893632e-3fde-4f03-bdc2-97eed837402b {{(pid=87747) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 03:23:20 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b3978ff-eb76-44d4-acb4-fee0cfd13ee2]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:23:20 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5f902953-473e-4a71-bb20-172f6a005fe2 tempest-VolumesSnapshotTestJSON-1822647413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d893632e-3fde-4f03-bdc2-97eed837402b {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:23:20 devstack sudo[96767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d893632e-3fde-4f03-bdc2-97eed837402b Jul 22 03:23:20 devstack sudo[96767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:23:20 devstack sudo[96767]: pam_unix(sudo:session): session closed for user root Jul 22 03:23:20 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5f902953-473e-4a71-bb20-172f6a005fe2 tempest-VolumesSnapshotTestJSON-1822647413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d893632e-3fde-4f03-bdc2-97eed837402b" returned: 0 in 0.433s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:23:20 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5f902953-473e-4a71-bb20-172f6a005fe2 tempest-VolumesSnapshotTestJSON-1822647413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d893632e-3fde-4f03-bdc2-97eed837402b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d893632e-3fde-4f03-bdc2-97eed837402b.02386c03-93c2-403e-bd09-4854574240a6 1G {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:23:20 devstack sudo[96772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d893632e-3fde-4f03-bdc2-97eed837402b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d893632e-3fde-4f03-bdc2-97eed837402b.02386c03-93c2-403e-bd09-4854574240a6 1G Jul 22 03:23:20 devstack sudo[96772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:23:21 devstack sudo[96772]: pam_unix(sudo:session): session closed for user root Jul 22 03:23:21 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5f902953-473e-4a71-bb20-172f6a005fe2 tempest-VolumesSnapshotTestJSON-1822647413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d893632e-3fde-4f03-bdc2-97eed837402b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d893632e-3fde-4f03-bdc2-97eed837402b.02386c03-93c2-403e-bd09-4854574240a6 1G" returned: 0 in 0.561s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:23:21 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5f902953-473e-4a71-bb20-172f6a005fe2 tempest-VolumesSnapshotTestJSON-1822647413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d893632e-3fde-4f03-bdc2-97eed837402b -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d893632e-3fde-4f03-bdc2-97eed837402b.02386c03-93c2-403e-bd09-4854574240a6 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:23:21 devstack sudo[96778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d893632e-3fde-4f03-bdc2-97eed837402b -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d893632e-3fde-4f03-bdc2-97eed837402b.02386c03-93c2-403e-bd09-4854574240a6 Jul 22 03:23:21 devstack sudo[96778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:23:21 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [req-80c3fd96-3383-4881-bf40-ef9785dfea8b req-57aa9e72-7d75-4f3f-a923-0628e71d69ef tempest-TestInstancesWithCinderVolumes-1475916076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:23:21 devstack sudo[96778]: pam_unix(sudo:session): session closed for user root Jul 22 03:23:21 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5f902953-473e-4a71-bb20-172f6a005fe2 tempest-VolumesSnapshotTestJSON-1822647413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d893632e-3fde-4f03-bdc2-97eed837402b -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d893632e-3fde-4f03-bdc2-97eed837402b.02386c03-93c2-403e-bd09-4854574240a6" returned: 0 in 0.364s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:23:21 devstack cinder-volume[87747]: WARNING cinder.volume.drivers.remotefs [None req-5f902953-473e-4a71-bb20-172f6a005fe2 tempest-VolumesSnapshotTestJSON-1822647413 None] /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d893632e-3fde-4f03-bdc2-97eed837402b.02386c03-93c2-403e-bd09-4854574240a6 is being set with open permissions: ugo+rw Jul 22 03:23:21 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5f902953-473e-4a71-bb20-172f6a005fe2 tempest-VolumesSnapshotTestJSON-1822647413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d893632e-3fde-4f03-bdc2-97eed837402b.02386c03-93c2-403e-bd09-4854574240a6 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:23:21 devstack sudo[96791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d893632e-3fde-4f03-bdc2-97eed837402b.02386c03-93c2-403e-bd09-4854574240a6 Jul 22 03:23:21 devstack sudo[96791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:23:22 devstack sudo[96791]: pam_unix(sudo:session): session closed for user root Jul 22 03:23:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5f902953-473e-4a71-bb20-172f6a005fe2 tempest-VolumesSnapshotTestJSON-1822647413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d893632e-3fde-4f03-bdc2-97eed837402b.02386c03-93c2-403e-bd09-4854574240a6" returned: 0 in 0.371s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:23:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5f902953-473e-4a71-bb20-172f6a005fe2 tempest-VolumesSnapshotTestJSON-1822647413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d893632e-3fde-4f03-bdc2-97eed837402b.info {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:23:22 devstack sudo[96794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d893632e-3fde-4f03-bdc2-97eed837402b.info Jul 22 03:23:22 devstack sudo[96794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:23:22 devstack cinder-volume[87747]: DEBUG oslo_service.periodic_task [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87747) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 03:23:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:23:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:23:22 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:23:22 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:23:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:23:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:23:22 devstack sudo[96796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:23:22 devstack sudo[96796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:23:22 devstack sudo[96794]: pam_unix(sudo:session): session closed for user root Jul 22 03:23:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5f902953-473e-4a71-bb20-172f6a005fe2 tempest-VolumesSnapshotTestJSON-1822647413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d893632e-3fde-4f03-bdc2-97eed837402b.info" returned: 0 in 0.301s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:23:22 devstack cinder-volume[87747]: WARNING cinder.volume.drivers.remotefs [None req-5f902953-473e-4a71-bb20-172f6a005fe2 tempest-VolumesSnapshotTestJSON-1822647413 None] /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d893632e-3fde-4f03-bdc2-97eed837402b.info is being set with open permissions: ugo+rw Jul 22 03:23:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5f902953-473e-4a71-bb20-172f6a005fe2 tempest-VolumesSnapshotTestJSON-1822647413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d893632e-3fde-4f03-bdc2-97eed837402b.info {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:23:22 devstack sudo[96799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d893632e-3fde-4f03-bdc2-97eed837402b.info Jul 22 03:23:22 devstack sudo[96799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:23:22 devstack sudo[96796]: pam_unix(sudo:session): session closed for user root Jul 22 03:23:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.284s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:23:22 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:23:22 devstack cinder-volume[87747]: DEBUG oslo_service.periodic_task [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Running periodic task VolumeManager._thread_info {{(pid=87747) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 03:23:22 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] thread count: 28 {{(pid=87747) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 22 03:23:22 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] thread info: [<_MainThread(MainThread, started 132775275860096)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87747) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 22 03:23:22 devstack sudo[96799]: pam_unix(sudo:session): session closed for user root Jul 22 03:23:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5f902953-473e-4a71-bb20-172f6a005fe2 tempest-VolumesSnapshotTestJSON-1822647413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d893632e-3fde-4f03-bdc2-97eed837402b.info" returned: 0 in 0.288s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:23:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-5f902953-473e-4a71-bb20-172f6a005fe2 tempest-VolumesSnapshotTestJSON-1822647413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.428s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:23:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [req-80c3fd96-3383-4881-bf40-ef9785dfea8b req-57aa9e72-7d75-4f3f-a923-0628e71d69ef tempest-TestInstancesWithCinderVolumes-1475916076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.080s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:23:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [req-80c3fd96-3383-4881-bf40-ef9785dfea8b req-57aa9e72-7d75-4f3f-a923-0628e71d69ef tempest-TestInstancesWithCinderVolumes-1475916076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:23:22 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-5f902953-473e-4a71-bb20-172f6a005fe2 tempest-VolumesSnapshotTestJSON-1822647413 None] Create snapshot completed successfully Jul 22 03:23:22 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [req-80c3fd96-3383-4881-bf40-ef9785dfea8b req-57aa9e72-7d75-4f3f-a923-0628e71d69ef tempest-TestInstancesWithCinderVolumes-1475916076 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f', 'name': 'volume-8b636260-1ddf-4058-b489-e696d283b079', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '962b7fa4-55ce-4fba-8a29-bc6b8f2711d5', 'enforce_multipath': True} {{(pid=87747) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 22 03:23:22 devstack cinder-volume[87747]: INFO cinder.volume.manager [req-80c3fd96-3383-4881-bf40-ef9785dfea8b req-57aa9e72-7d75-4f3f-a923-0628e71d69ef tempest-TestInstancesWithCinderVolumes-1475916076 None] attachment_update completed successfully. Jul 22 03:23:23 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-e42a4262-922e-4153-9e6f-14e640c21650 tempest-AttachVolumeNegativeTest-443471683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:23:23 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-e42a4262-922e-4153-9e6f-14e640c21650 tempest-AttachVolumeNegativeTest-443471683 None] Flow 'volume_create_manager' (b5b2016a-6f0e-4771-ae2a-be99ed79883e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:23:23 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-e42a4262-922e-4153-9e6f-14e640c21650 tempest-AttachVolumeNegativeTest-443471683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bab5b837-6bf4-447f-83f9-cf20399ea126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:23:23 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-e42a4262-922e-4153-9e6f-14e640c21650 tempest-AttachVolumeNegativeTest-443471683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bab5b837-6bf4-447f-83f9-cf20399ea126) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:23:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-873874455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1585bdc0-262f-4518-95c8-1be386dc16d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d96401bdfbf4ea0b40cc88eccd9c07f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:23:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:23:24Z,use_quota=True,user_id='3a91996b03c94127b821ad7a93a4066b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:23:23 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-e42a4262-922e-4153-9e6f-14e640c21650 tempest-AttachVolumeNegativeTest-443471683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97cc1e62-56d4-4441-8df0-5d72162785c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:23:23 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-e42a4262-922e-4153-9e6f-14e640c21650 tempest-AttachVolumeNegativeTest-443471683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97cc1e62-56d4-4441-8df0-5d72162785c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:23:23 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-e42a4262-922e-4153-9e6f-14e640c21650 tempest-AttachVolumeNegativeTest-443471683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dd54bfa-d15b-4a76-8dc6-04c3e3fa86e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:23:23 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-e42a4262-922e-4153-9e6f-14e640c21650 tempest-AttachVolumeNegativeTest-443471683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dd54bfa-d15b-4a76-8dc6-04c3e3fa86e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1585bdc0-262f-4518-95c8-1be386dc16d0', 'volume_name': 'volume-1585bdc0-262f-4518-95c8-1be386dc16d0', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:23:23 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-e42a4262-922e-4153-9e6f-14e640c21650 tempest-AttachVolumeNegativeTest-443471683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba17a731-1fe9-49e6-a9c5-92e9d9878361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:23:23 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-e42a4262-922e-4153-9e6f-14e640c21650 tempest-AttachVolumeNegativeTest-443471683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba17a731-1fe9-49e6-a9c5-92e9d9878361) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:23:23 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-e42a4262-922e-4153-9e6f-14e640c21650 tempest-AttachVolumeNegativeTest-443471683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01b95b5c-0a4e-4418-9f32-aeed286d0512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:23:23 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-e42a4262-922e-4153-9e6f-14e640c21650 tempest-AttachVolumeNegativeTest-443471683 None] Volume 1585bdc0-262f-4518-95c8-1be386dc16d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1585bdc0-262f-4518-95c8-1be386dc16d0', 'volume_size': 1} Jul 22 03:23:23 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-e42a4262-922e-4153-9e6f-14e640c21650 tempest-AttachVolumeNegativeTest-443471683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:23:23 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-e42a4262-922e-4153-9e6f-14e640c21650 tempest-AttachVolumeNegativeTest-443471683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:23:23 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-e42a4262-922e-4153-9e6f-14e640c21650 tempest-AttachVolumeNegativeTest-443471683 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:23:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-873874455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1585bdc0-262f-4518-95c8-1be386dc16d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d96401bdfbf4ea0b40cc88eccd9c07f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:23:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:23:24Z,use_quota=True,user_id='3a91996b03c94127b821ad7a93a4066b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:23:23 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-e42a4262-922e-4153-9e6f-14e640c21650 tempest-AttachVolumeNegativeTest-443471683 None] Creating volume 1585bdc0-262f-4518-95c8-1be386dc16d0 {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:23:23 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-e42a4262-922e-4153-9e6f-14e640c21650 tempest-AttachVolumeNegativeTest-443471683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:23:23 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-e42a4262-922e-4153-9e6f-14e640c21650 tempest-AttachVolumeNegativeTest-443471683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:23:23 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-e42a4262-922e-4153-9e6f-14e640c21650 tempest-AttachVolumeNegativeTest-443471683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:23:23 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-e42a4262-922e-4153-9e6f-14e640c21650 tempest-AttachVolumeNegativeTest-443471683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:23:23 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-e42a4262-922e-4153-9e6f-14e640c21650 tempest-AttachVolumeNegativeTest-443471683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:23:23 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-e42a4262-922e-4153-9e6f-14e640c21650 tempest-AttachVolumeNegativeTest-443471683 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:23:23 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-e42a4262-922e-4153-9e6f-14e640c21650 tempest-AttachVolumeNegativeTest-443471683 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:23:23 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-e42a4262-922e-4153-9e6f-14e640c21650 tempest-AttachVolumeNegativeTest-443471683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1585bdc0-262f-4518-95c8-1be386dc16d0 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:23:23 devstack sudo[96807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1585bdc0-262f-4518-95c8-1be386dc16d0 1073741824 Jul 22 03:23:23 devstack sudo[96807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:23:24 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-f84e8f8d-950d-4894-b15e-1cf5f1db4373 tempest-VolumesSnapshotTestJSON-1822647413 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:23:24 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f84e8f8d-950d-4894-b15e-1cf5f1db4373 tempest-VolumesSnapshotTestJSON-1822647413 None] Flow 'volume_create_manager' (8efe2f7b-c87e-488d-8b4d-46ad80e7bcef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:23:24 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f84e8f8d-950d-4894-b15e-1cf5f1db4373 tempest-VolumesSnapshotTestJSON-1822647413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab553000-288c-4bb9-9418-8227bc455f07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:23:24 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f84e8f8d-950d-4894-b15e-1cf5f1db4373 tempest-VolumesSnapshotTestJSON-1822647413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab553000-288c-4bb9-9418-8227bc455f07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:23:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-760719095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60559494-b971-4c5f-bd9f-263145f0765f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6166f63d820041daa3dbed33b7b5865e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:23:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=02386c03-93c2-403e-bd09-4854574240a6,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:23:24Z,use_quota=True,user_id='d926305a7e4740cd89dcfbca5546f47f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:23:24 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f84e8f8d-950d-4894-b15e-1cf5f1db4373 tempest-VolumesSnapshotTestJSON-1822647413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21a02871-ddfb-416b-977c-26b832bfcfff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:23:24 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f84e8f8d-950d-4894-b15e-1cf5f1db4373 tempest-VolumesSnapshotTestJSON-1822647413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21a02871-ddfb-416b-977c-26b832bfcfff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:23:24 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f84e8f8d-950d-4894-b15e-1cf5f1db4373 tempest-VolumesSnapshotTestJSON-1822647413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78ab2224-7e1c-49fe-bf25-4abee0eab11d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:23:24 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f84e8f8d-950d-4894-b15e-1cf5f1db4373 tempest-VolumesSnapshotTestJSON-1822647413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78ab2224-7e1c-49fe-bf25-4abee0eab11d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '60559494-b971-4c5f-bd9f-263145f0765f', 'volume_name': 'volume-60559494-b971-4c5f-bd9f-263145f0765f', 'volume_size': 1, 'snapshot_id': '02386c03-93c2-403e-bd09-4854574240a6'}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:23:24 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f84e8f8d-950d-4894-b15e-1cf5f1db4373 tempest-VolumesSnapshotTestJSON-1822647413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7bef673-0a36-4dd1-9c3e-b09ca2f27099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:23:24 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f84e8f8d-950d-4894-b15e-1cf5f1db4373 tempest-VolumesSnapshotTestJSON-1822647413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7bef673-0a36-4dd1-9c3e-b09ca2f27099) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:23:24 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f84e8f8d-950d-4894-b15e-1cf5f1db4373 tempest-VolumesSnapshotTestJSON-1822647413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd279158-9ccf-4a84-a1da-d3e2d1953090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:23:24 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-f84e8f8d-950d-4894-b15e-1cf5f1db4373 tempest-VolumesSnapshotTestJSON-1822647413 None] Volume 60559494-b971-4c5f-bd9f-263145f0765f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-60559494-b971-4c5f-bd9f-263145f0765f', 'volume_size': 1, 'snapshot_id': '02386c03-93c2-403e-bd09-4854574240a6'} Jul 22 03:23:24 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-f84e8f8d-950d-4894-b15e-1cf5f1db4373 tempest-VolumesSnapshotTestJSON-1822647413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:23:24 devstack sudo[96807]: pam_unix(sudo:session): session closed for user root Jul 22 03:23:24 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-e42a4262-922e-4153-9e6f-14e640c21650 tempest-AttachVolumeNegativeTest-443471683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1585bdc0-262f-4518-95c8-1be386dc16d0 1073741824" returned: 0 in 0.777s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:23:24 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-e42a4262-922e-4153-9e6f-14e640c21650 tempest-AttachVolumeNegativeTest-443471683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1585bdc0-262f-4518-95c8-1be386dc16d0 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:23:24 devstack sudo[97226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1585bdc0-262f-4518-95c8-1be386dc16d0 Jul 22 03:23:24 devstack sudo[97226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:23:25 devstack sudo[97226]: pam_unix(sudo:session): session closed for user root Jul 22 03:23:25 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-e42a4262-922e-4153-9e6f-14e640c21650 tempest-AttachVolumeNegativeTest-443471683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1585bdc0-262f-4518-95c8-1be386dc16d0" returned: 0 in 0.318s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:23:25 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-e42a4262-922e-4153-9e6f-14e640c21650 tempest-AttachVolumeNegativeTest-443471683 None] <== create_volume: return (1167ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:23:25 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-e42a4262-922e-4153-9e6f-14e640c21650 tempest-AttachVolumeNegativeTest-443471683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.170s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:23:25 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-f84e8f8d-950d-4894-b15e-1cf5f1db4373 tempest-VolumesSnapshotTestJSON-1822647413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.545s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:23:25 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-f84e8f8d-950d-4894-b15e-1cf5f1db4373 tempest-VolumesSnapshotTestJSON-1822647413 None] Acquiring lock "cinder-quobyte-02386c03-93c2-403e-bd09-4854574240a6-60559494-b971-4c5f-bd9f-263145f0765f" by "_create_volume_from_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:23:25 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-e42a4262-922e-4153-9e6f-14e640c21650 tempest-AttachVolumeNegativeTest-443471683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01b95b5c-0a4e-4418-9f32-aeed286d0512) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1585bdc0-262f-4518-95c8-1be386dc16d0', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:23:25 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-e42a4262-922e-4153-9e6f-14e640c21650 tempest-AttachVolumeNegativeTest-443471683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (361d473c-c113-48a2-884f-85854d5f0f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:23:25 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-f84e8f8d-950d-4894-b15e-1cf5f1db4373 tempest-VolumesSnapshotTestJSON-1822647413 None] Lock "cinder-quobyte-02386c03-93c2-403e-bd09-4854574240a6-60559494-b971-4c5f-bd9f-263145f0765f" acquired by "_create_volume_from_snapshot" :: waited 0.054s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:23:25 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-f84e8f8d-950d-4894-b15e-1cf5f1db4373 tempest-VolumesSnapshotTestJSON-1822647413 None] Creating volume 60559494-b971-4c5f-bd9f-263145f0765f from snapshot 02386c03-93c2-403e-bd09-4854574240a6 {{(pid=87747) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 22 03:23:25 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-f84e8f8d-950d-4894-b15e-1cf5f1db4373 tempest-VolumesSnapshotTestJSON-1822647413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:23:25 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-f84e8f8d-950d-4894-b15e-1cf5f1db4373 tempest-VolumesSnapshotTestJSON-1822647413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:23:25 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-f84e8f8d-950d-4894-b15e-1cf5f1db4373 tempest-VolumesSnapshotTestJSON-1822647413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:23:25 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-f84e8f8d-950d-4894-b15e-1cf5f1db4373 tempest-VolumesSnapshotTestJSON-1822647413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:23:25 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-f84e8f8d-950d-4894-b15e-1cf5f1db4373 tempest-VolumesSnapshotTestJSON-1822647413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:23:25 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-f84e8f8d-950d-4894-b15e-1cf5f1db4373 tempest-VolumesSnapshotTestJSON-1822647413 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:23:25 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-f84e8f8d-950d-4894-b15e-1cf5f1db4373 tempest-VolumesSnapshotTestJSON-1822647413 None] Acquiring lock "cinder-quobyte-60559494-b971-4c5f-bd9f-263145f0765f" by "_copy_volume_from_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:23:25 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-e42a4262-922e-4153-9e6f-14e640c21650 tempest-AttachVolumeNegativeTest-443471683 None] Volume volume-1585bdc0-262f-4518-95c8-1be386dc16d0 (1585bdc0-262f-4518-95c8-1be386dc16d0): created successfully Jul 22 03:23:25 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-e42a4262-922e-4153-9e6f-14e640c21650 tempest-AttachVolumeNegativeTest-443471683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (361d473c-c113-48a2-884f-85854d5f0f2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:23:25 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-e42a4262-922e-4153-9e6f-14e640c21650 tempest-AttachVolumeNegativeTest-443471683 None] Flow 'volume_create_manager' (b5b2016a-6f0e-4771-ae2a-be99ed79883e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:23:25 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-f84e8f8d-950d-4894-b15e-1cf5f1db4373 tempest-VolumesSnapshotTestJSON-1822647413 None] Lock "cinder-quobyte-60559494-b971-4c5f-bd9f-263145f0765f" acquired by "_copy_volume_from_snapshot" :: waited 0.080s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:23:25 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-f84e8f8d-950d-4894-b15e-1cf5f1db4373 tempest-VolumesSnapshotTestJSON-1822647413 None] snapshot: 02386c03-93c2-403e-bd09-4854574240a6, volume: 60559494-b971-4c5f-bd9f-263145f0765f, {{(pid=87747) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 22 03:23:25 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-e42a4262-922e-4153-9e6f-14e640c21650 tempest-AttachVolumeNegativeTest-443471683 None] Created volume successfully. Jul 22 03:23:25 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-f84e8f8d-950d-4894-b15e-1cf5f1db4373 tempest-VolumesSnapshotTestJSON-1822647413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:23:25 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-f84e8f8d-950d-4894-b15e-1cf5f1db4373 tempest-VolumesSnapshotTestJSON-1822647413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:23:25 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-f84e8f8d-950d-4894-b15e-1cf5f1db4373 tempest-VolumesSnapshotTestJSON-1822647413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:23:25 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-f84e8f8d-950d-4894-b15e-1cf5f1db4373 tempest-VolumesSnapshotTestJSON-1822647413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:23:25 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-f84e8f8d-950d-4894-b15e-1cf5f1db4373 tempest-VolumesSnapshotTestJSON-1822647413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:23:25 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[4336caeb-3ece-4421-96da-01bd5e6fd228]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:23:25 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f84e8f8d-950d-4894-b15e-1cf5f1db4373 tempest-VolumesSnapshotTestJSON-1822647413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d893632e-3fde-4f03-bdc2-97eed837402b.02386c03-93c2-403e-bd09-4854574240a6 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:23:25 devstack sudo[97257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d893632e-3fde-4f03-bdc2-97eed837402b.02386c03-93c2-403e-bd09-4854574240a6 Jul 22 03:23:25 devstack sudo[97257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:23:25 devstack sudo[97257]: pam_unix(sudo:session): session closed for user root Jul 22 03:23:25 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f84e8f8d-950d-4894-b15e-1cf5f1db4373 tempest-VolumesSnapshotTestJSON-1822647413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d893632e-3fde-4f03-bdc2-97eed837402b.02386c03-93c2-403e-bd09-4854574240a6" returned: 0 in 0.430s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:23:25 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-f84e8f8d-950d-4894-b15e-1cf5f1db4373 tempest-VolumesSnapshotTestJSON-1822647413 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d893632e-3fde-4f03-bdc2-97eed837402b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87747) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 03:23:25 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-f84e8f8d-950d-4894-b15e-1cf5f1db4373 tempest-VolumesSnapshotTestJSON-1822647413 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d893632e-3fde-4f03-bdc2-97eed837402b {{(pid=87747) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 22 03:23:25 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-f84e8f8d-950d-4894-b15e-1cf5f1db4373 tempest-VolumesSnapshotTestJSON-1822647413 None] Creating direct copy from snapshot {{(pid=87747) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 22 03:23:25 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e4a72b7-ae19-473a-af7f-ff7e695c2a95]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:23:25 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f84e8f8d-950d-4894-b15e-1cf5f1db4373 tempest-VolumesSnapshotTestJSON-1822647413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d893632e-3fde-4f03-bdc2-97eed837402b {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:23:25 devstack sudo[97265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d893632e-3fde-4f03-bdc2-97eed837402b Jul 22 03:23:25 devstack sudo[97265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:23:26 devstack sudo[97265]: pam_unix(sudo:session): session closed for user root Jul 22 03:23:26 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f84e8f8d-950d-4894-b15e-1cf5f1db4373 tempest-VolumesSnapshotTestJSON-1822647413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d893632e-3fde-4f03-bdc2-97eed837402b" returned: 0 in 0.416s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:23:26 devstack cinder-volume[87747]: DEBUG cinder.utils [None req-f84e8f8d-950d-4894-b15e-1cf5f1db4373 tempest-VolumesSnapshotTestJSON-1822647413 None] Path /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-60559494-b971-4c5f-bd9f-263145f0765f not found in is_blk_device check {{(pid=87747) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 22 03:23:26 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f84e8f8d-950d-4894-b15e-1cf5f1db4373 tempest-VolumesSnapshotTestJSON-1822647413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d893632e-3fde-4f03-bdc2-97eed837402b /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-60559494-b971-4c5f-bd9f-263145f0765f {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:23:26 devstack sudo[97275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d893632e-3fde-4f03-bdc2-97eed837402b /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-60559494-b971-4c5f-bd9f-263145f0765f Jul 22 03:23:26 devstack sudo[97275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:23:26 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [req-c212c709-631b-4577-9503-a9e863934225 req-8081dc02-f7cd-48c9-9826-cf05775ccad3 tempest-AttachVolumeNegativeTest-443471683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:23:32 devstack sudo[97275]: pam_unix(sudo:session): session closed for user root Jul 22 03:23:32 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f84e8f8d-950d-4894-b15e-1cf5f1db4373 tempest-VolumesSnapshotTestJSON-1822647413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d893632e-3fde-4f03-bdc2-97eed837402b /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-60559494-b971-4c5f-bd9f-263145f0765f" returned: 0 in 6.790s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:23:33 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9561a23-0998-4d17-ab54-0e9fdd9e5494]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:23:33 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f84e8f8d-950d-4894-b15e-1cf5f1db4373 tempest-VolumesSnapshotTestJSON-1822647413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d893632e-3fde-4f03-bdc2-97eed837402b {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:23:33 devstack sudo[97331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d893632e-3fde-4f03-bdc2-97eed837402b Jul 22 03:23:33 devstack sudo[97331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:23:33 devstack sudo[97331]: pam_unix(sudo:session): session closed for user root Jul 22 03:23:33 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f84e8f8d-950d-4894-b15e-1cf5f1db4373 tempest-VolumesSnapshotTestJSON-1822647413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d893632e-3fde-4f03-bdc2-97eed837402b" returned: 0 in 0.795s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:23:33 devstack cinder-volume[87747]: DEBUG cinder.image.image_utils [None req-f84e8f8d-950d-4894-b15e-1cf5f1db4373 tempest-VolumesSnapshotTestJSON-1822647413 None] Image conversion details: src /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d893632e-3fde-4f03-bdc2-97eed837402b, size 1024.00 MB, duration 6.79 sec, destination /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-60559494-b971-4c5f-bd9f-263145f0765f {{(pid=87747) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 22 03:23:33 devstack cinder-volume[87747]: INFO cinder.image.image_utils [None req-f84e8f8d-950d-4894-b15e-1cf5f1db4373 tempest-VolumesSnapshotTestJSON-1822647413 None] Converted 1024.00 MB image at 150.78 MB/s Jul 22 03:23:33 devstack cinder-volume[87747]: WARNING cinder.volume.drivers.remotefs [None req-f84e8f8d-950d-4894-b15e-1cf5f1db4373 tempest-VolumesSnapshotTestJSON-1822647413 None] /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-60559494-b971-4c5f-bd9f-263145f0765f is being set with open permissions: ugo+rw Jul 22 03:23:33 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f84e8f8d-950d-4894-b15e-1cf5f1db4373 tempest-VolumesSnapshotTestJSON-1822647413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-60559494-b971-4c5f-bd9f-263145f0765f {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:23:33 devstack sudo[97340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-60559494-b971-4c5f-bd9f-263145f0765f Jul 22 03:23:33 devstack sudo[97340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:23:34 devstack sudo[97340]: pam_unix(sudo:session): session closed for user root Jul 22 03:23:34 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f84e8f8d-950d-4894-b15e-1cf5f1db4373 tempest-VolumesSnapshotTestJSON-1822647413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-60559494-b971-4c5f-bd9f-263145f0765f" returned: 0 in 0.297s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:23:34 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-f84e8f8d-950d-4894-b15e-1cf5f1db4373 tempest-VolumesSnapshotTestJSON-1822647413 None] Lock "cinder-quobyte-60559494-b971-4c5f-bd9f-263145f0765f" released by "_copy_volume_from_snapshot" :: held 8.906s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:23:34 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-f84e8f8d-950d-4894-b15e-1cf5f1db4373 tempest-VolumesSnapshotTestJSON-1822647413 None] Lock "cinder-quobyte-02386c03-93c2-403e-bd09-4854574240a6-60559494-b971-4c5f-bd9f-263145f0765f" released by "_create_volume_from_snapshot" :: held 9.012s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:23:34 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-f84e8f8d-950d-4894-b15e-1cf5f1db4373 tempest-VolumesSnapshotTestJSON-1822647413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.068s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:23:34 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [req-c212c709-631b-4577-9503-a9e863934225 req-8081dc02-f7cd-48c9-9826-cf05775ccad3 tempest-AttachVolumeNegativeTest-443471683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 7.255s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:23:34 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [req-c212c709-631b-4577-9503-a9e863934225 req-8081dc02-f7cd-48c9-9826-cf05775ccad3 tempest-AttachVolumeNegativeTest-443471683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.051s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:23:34 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f84e8f8d-950d-4894-b15e-1cf5f1db4373 tempest-VolumesSnapshotTestJSON-1822647413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd279158-9ccf-4a84-a1da-d3e2d1953090) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60559494-b971-4c5f-bd9f-263145f0765f', 'volume_size': 1, 'snapshot_id': '02386c03-93c2-403e-bd09-4854574240a6'}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:23:34 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f84e8f8d-950d-4894-b15e-1cf5f1db4373 tempest-VolumesSnapshotTestJSON-1822647413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0761bd5e-7d8f-4d55-b3ad-f4a5a5395ee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:23:34 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-f84e8f8d-950d-4894-b15e-1cf5f1db4373 tempest-VolumesSnapshotTestJSON-1822647413 None] Volume volume-60559494-b971-4c5f-bd9f-263145f0765f (60559494-b971-4c5f-bd9f-263145f0765f): created successfully Jul 22 03:23:34 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f84e8f8d-950d-4894-b15e-1cf5f1db4373 tempest-VolumesSnapshotTestJSON-1822647413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0761bd5e-7d8f-4d55-b3ad-f4a5a5395ee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:23:34 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f84e8f8d-950d-4894-b15e-1cf5f1db4373 tempest-VolumesSnapshotTestJSON-1822647413 None] Flow 'volume_create_manager' (8efe2f7b-c87e-488d-8b4d-46ad80e7bcef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:23:34 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [req-c212c709-631b-4577-9503-a9e863934225 req-8081dc02-f7cd-48c9-9826-cf05775ccad3 tempest-AttachVolumeNegativeTest-443471683 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f', 'name': 'volume-1585bdc0-262f-4518-95c8-1be386dc16d0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '20227e95-cefc-47fd-aec1-197a5e57394a', 'enforce_multipath': True} {{(pid=87747) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 22 03:23:34 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-f84e8f8d-950d-4894-b15e-1cf5f1db4373 tempest-VolumesSnapshotTestJSON-1822647413 None] Created volume successfully. Jul 22 03:23:34 devstack cinder-volume[87747]: INFO cinder.volume.manager [req-c212c709-631b-4577-9503-a9e863934225 req-8081dc02-f7cd-48c9-9826-cf05775ccad3 tempest-AttachVolumeNegativeTest-443471683 None] attachment_update completed successfully. Jul 22 03:23:34 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-017db098-2ede-492d-bfac-6181cf6cb404 tempest-VolumesSnapshotTestJSON-1822647413 None] Acquiring lock "cinder-60559494-b971-4c5f-bd9f-263145f0765f-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:23:35 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-017db098-2ede-492d-bfac-6181cf6cb404 tempest-VolumesSnapshotTestJSON-1822647413 None] Lock "cinder-60559494-b971-4c5f-bd9f-263145f0765f-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:23:35 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-017db098-2ede-492d-bfac-6181cf6cb404 tempest-VolumesSnapshotTestJSON-1822647413 None] Acquiring lock "cinder-quobyte-60559494-b971-4c5f-bd9f-263145f0765f" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:23:35 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-017db098-2ede-492d-bfac-6181cf6cb404 tempest-VolumesSnapshotTestJSON-1822647413 None] Lock "cinder-quobyte-60559494-b971-4c5f-bd9f-263145f0765f" acquired by "delete_volume" :: waited 0.016s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:23:35 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[694b8e28-cc03-4eaf-a176-fffd3cbc03a3]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:23:35 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-017db098-2ede-492d-bfac-6181cf6cb404 tempest-VolumesSnapshotTestJSON-1822647413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-60559494-b971-4c5f-bd9f-263145f0765f {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:23:35 devstack sudo[97347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-60559494-b971-4c5f-bd9f-263145f0765f Jul 22 03:23:35 devstack sudo[97347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:23:35 devstack sudo[97347]: pam_unix(sudo:session): session closed for user root Jul 22 03:23:35 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-017db098-2ede-492d-bfac-6181cf6cb404 tempest-VolumesSnapshotTestJSON-1822647413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-60559494-b971-4c5f-bd9f-263145f0765f" returned: 0 in 0.494s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:23:35 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-017db098-2ede-492d-bfac-6181cf6cb404 tempest-VolumesSnapshotTestJSON-1822647413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-60559494-b971-4c5f-bd9f-263145f0765f {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:23:35 devstack sudo[97352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-60559494-b971-4c5f-bd9f-263145f0765f Jul 22 03:23:35 devstack sudo[97352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:23:35 devstack sudo[97352]: pam_unix(sudo:session): session closed for user root Jul 22 03:23:35 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-017db098-2ede-492d-bfac-6181cf6cb404 tempest-VolumesSnapshotTestJSON-1822647413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-60559494-b971-4c5f-bd9f-263145f0765f" returned: 0 in 0.273s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:23:35 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-017db098-2ede-492d-bfac-6181cf6cb404 tempest-VolumesSnapshotTestJSON-1822647413 None] Lock "cinder-quobyte-60559494-b971-4c5f-bd9f-263145f0765f" released by "delete_volume" :: held 0.816s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:23:36 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-017db098-2ede-492d-bfac-6181cf6cb404 tempest-VolumesSnapshotTestJSON-1822647413 None] Created reservations ['8b26b85e-2ed4-4b3c-b9ce-f64fab50f857', '5d39d9f0-aea3-45e8-a16f-3c07ccc231ad', 'f1cb4c45-212c-4b6f-b010-6e1c8448f671', '14469dc6-15e6-4020-9129-cff270a22abb'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:23:36 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-017db098-2ede-492d-bfac-6181cf6cb404 tempest-VolumesSnapshotTestJSON-1822647413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:23:36 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-017db098-2ede-492d-bfac-6181cf6cb404 tempest-VolumesSnapshotTestJSON-1822647413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:23:36 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-017db098-2ede-492d-bfac-6181cf6cb404 tempest-VolumesSnapshotTestJSON-1822647413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:23:36 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-017db098-2ede-492d-bfac-6181cf6cb404 tempest-VolumesSnapshotTestJSON-1822647413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:23:36 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-017db098-2ede-492d-bfac-6181cf6cb404 tempest-VolumesSnapshotTestJSON-1822647413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:23:36 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-017db098-2ede-492d-bfac-6181cf6cb404 tempest-VolumesSnapshotTestJSON-1822647413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:23:36 devstack sudo[97355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:23:36 devstack sudo[97355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:23:36 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-116f5f81-836c-4ef2-b4e1-d913e9935bae tempest-VolumesSnapshotTestJSON-1822647413 None] Acquiring lock "cinder-02386c03-93c2-403e-bd09-4854574240a6-delete_snapshot" by "delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:23:36 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-116f5f81-836c-4ef2-b4e1-d913e9935bae tempest-VolumesSnapshotTestJSON-1822647413 None] Lock "cinder-02386c03-93c2-403e-bd09-4854574240a6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:23:36 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-116f5f81-836c-4ef2-b4e1-d913e9935bae tempest-VolumesSnapshotTestJSON-1822647413 None] Acquiring lock "cinder-quobyte-d893632e-3fde-4f03-bdc2-97eed837402b" by "delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:23:36 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-116f5f81-836c-4ef2-b4e1-d913e9935bae tempest-VolumesSnapshotTestJSON-1822647413 None] Lock "cinder-quobyte-d893632e-3fde-4f03-bdc2-97eed837402b" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:23:36 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-116f5f81-836c-4ef2-b4e1-d913e9935bae tempest-VolumesSnapshotTestJSON-1822647413 None] Acquiring lock "cinder-quobyte-02386c03-93c2-403e-bd09-4854574240a6" by "_delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:23:36 devstack sudo[97355]: pam_unix(sudo:session): session closed for user root Jul 22 03:23:36 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-017db098-2ede-492d-bfac-6181cf6cb404 tempest-VolumesSnapshotTestJSON-1822647413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.358s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:23:36 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-017db098-2ede-492d-bfac-6181cf6cb404 tempest-VolumesSnapshotTestJSON-1822647413 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:23:36 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-017db098-2ede-492d-bfac-6181cf6cb404 tempest-VolumesSnapshotTestJSON-1822647413 None] Deleted volume successfully. Jul 22 03:23:36 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-116f5f81-836c-4ef2-b4e1-d913e9935bae tempest-VolumesSnapshotTestJSON-1822647413 None] Lock "cinder-quobyte-02386c03-93c2-403e-bd09-4854574240a6" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:23:36 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-116f5f81-836c-4ef2-b4e1-d913e9935bae tempest-VolumesSnapshotTestJSON-1822647413 None] Deleting offline snapshot 02386c03-93c2-403e-bd09-4854574240a6 of volume d893632e-3fde-4f03-bdc2-97eed837402b {{(pid=87747) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 03:23:36 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-116f5f81-836c-4ef2-b4e1-d913e9935bae tempest-VolumesSnapshotTestJSON-1822647413 None] snapshot_file for this snap is: volume-d893632e-3fde-4f03-bdc2-97eed837402b.02386c03-93c2-403e-bd09-4854574240a6 {{(pid=87747) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 03:23:36 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[34f0facd-b5f8-4030-8f75-5dc534b93853]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:23:36 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-116f5f81-836c-4ef2-b4e1-d913e9935bae tempest-VolumesSnapshotTestJSON-1822647413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d893632e-3fde-4f03-bdc2-97eed837402b.02386c03-93c2-403e-bd09-4854574240a6 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:23:36 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-017db098-2ede-492d-bfac-6181cf6cb404 tempest-VolumesSnapshotTestJSON-1822647413 None] Lock "cinder-60559494-b971-4c5f-bd9f-263145f0765f-delete_volume" released by "delete_volume" :: held 1.549s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:23:36 devstack sudo[97358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d893632e-3fde-4f03-bdc2-97eed837402b.02386c03-93c2-403e-bd09-4854574240a6 Jul 22 03:23:36 devstack sudo[97358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:23:37 devstack sudo[97358]: pam_unix(sudo:session): session closed for user root Jul 22 03:23:37 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-116f5f81-836c-4ef2-b4e1-d913e9935bae tempest-VolumesSnapshotTestJSON-1822647413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d893632e-3fde-4f03-bdc2-97eed837402b.02386c03-93c2-403e-bd09-4854574240a6" returned: 0 in 0.502s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:23:37 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-116f5f81-836c-4ef2-b4e1-d913e9935bae tempest-VolumesSnapshotTestJSON-1822647413 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d893632e-3fde-4f03-bdc2-97eed837402b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87747) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 03:23:37 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[f669cbc9-3446-4146-a8e6-01fbd00c5ea7]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:23:37 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-116f5f81-836c-4ef2-b4e1-d913e9935bae tempest-VolumesSnapshotTestJSON-1822647413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d893632e-3fde-4f03-bdc2-97eed837402b {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:23:37 devstack sudo[97363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d893632e-3fde-4f03-bdc2-97eed837402b Jul 22 03:23:37 devstack sudo[97363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:23:37 devstack cinder-volume[87747]: INFO cinder.volume.manager [req-c7abbae1-9f71-4cb7-bd7d-5338b438a7ec req-19b54d3b-353c-4335-b40a-462215bbe2f1 tempest-AttachVolumeNegativeTest-443471683 None] Terminate volume connection completed successfully. Jul 22 03:23:37 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [req-c7abbae1-9f71-4cb7-bd7d-5338b438a7ec req-19b54d3b-353c-4335-b40a-462215bbe2f1 tempest-AttachVolumeNegativeTest-443471683 None] Deleting attachment 20227e95-cefc-47fd-aec1-197a5e57394a. {{(pid=87747) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 22 03:23:37 devstack sudo[97363]: pam_unix(sudo:session): session closed for user root Jul 22 03:23:37 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-116f5f81-836c-4ef2-b4e1-d913e9935bae tempest-VolumesSnapshotTestJSON-1822647413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d893632e-3fde-4f03-bdc2-97eed837402b" returned: 0 in 0.628s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:23:37 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-116f5f81-836c-4ef2-b4e1-d913e9935bae tempest-VolumesSnapshotTestJSON-1822647413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d893632e-3fde-4f03-bdc2-97eed837402b.02386c03-93c2-403e-bd09-4854574240a6 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:23:37 devstack sudo[97371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d893632e-3fde-4f03-bdc2-97eed837402b.02386c03-93c2-403e-bd09-4854574240a6 Jul 22 03:23:37 devstack sudo[97371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:23:38 devstack sudo[97371]: pam_unix(sudo:session): session closed for user root Jul 22 03:23:38 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-116f5f81-836c-4ef2-b4e1-d913e9935bae tempest-VolumesSnapshotTestJSON-1822647413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d893632e-3fde-4f03-bdc2-97eed837402b.02386c03-93c2-403e-bd09-4854574240a6" returned: 0 in 0.471s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:23:38 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-116f5f81-836c-4ef2-b4e1-d913e9935bae tempest-VolumesSnapshotTestJSON-1822647413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d893632e-3fde-4f03-bdc2-97eed837402b.02386c03-93c2-403e-bd09-4854574240a6 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:23:38 devstack sudo[97377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d893632e-3fde-4f03-bdc2-97eed837402b.02386c03-93c2-403e-bd09-4854574240a6 Jul 22 03:23:38 devstack sudo[97377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:23:38 devstack sudo[97377]: pam_unix(sudo:session): session closed for user root Jul 22 03:23:38 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-116f5f81-836c-4ef2-b4e1-d913e9935bae tempest-VolumesSnapshotTestJSON-1822647413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d893632e-3fde-4f03-bdc2-97eed837402b.02386c03-93c2-403e-bd09-4854574240a6" returned: 0 in 0.362s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:23:38 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-116f5f81-836c-4ef2-b4e1-d913e9935bae tempest-VolumesSnapshotTestJSON-1822647413 None] Lock "cinder-quobyte-02386c03-93c2-403e-bd09-4854574240a6" released by "_delete_snapshot" :: held 2.091s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:23:38 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-116f5f81-836c-4ef2-b4e1-d913e9935bae tempest-VolumesSnapshotTestJSON-1822647413 None] Lock "cinder-quobyte-d893632e-3fde-4f03-bdc2-97eed837402b" released by "delete_snapshot" :: held 2.132s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:23:38 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-116f5f81-836c-4ef2-b4e1-d913e9935bae tempest-VolumesSnapshotTestJSON-1822647413 None] Created reservations ['dc7c0813-d8d0-4f99-929a-4e8696b544ce', '4d1371ca-1162-4c7c-a396-4e8e4ce97953', '1f77cd59-ca9d-43db-b68e-080afb00b7d2', 'bf6c823f-8998-4f86-92a6-b4b38e9cf2e8'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:23:38 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-116f5f81-836c-4ef2-b4e1-d913e9935bae tempest-VolumesSnapshotTestJSON-1822647413 None] Delete snapshot completed successfully. Jul 22 03:23:38 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-116f5f81-836c-4ef2-b4e1-d913e9935bae tempest-VolumesSnapshotTestJSON-1822647413 None] Lock "cinder-02386c03-93c2-403e-bd09-4854574240a6-delete_snapshot" released by "delete_snapshot" :: held 2.423s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:23:39 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-75323203-9e1a-401b-9ea7-44b37c6f2db2 tempest-VolumesSnapshotTestJSON-1822647413 None] Acquiring lock "cinder-d893632e-3fde-4f03-bdc2-97eed837402b-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:23:39 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-75323203-9e1a-401b-9ea7-44b37c6f2db2 tempest-VolumesSnapshotTestJSON-1822647413 None] Lock "cinder-d893632e-3fde-4f03-bdc2-97eed837402b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:23:39 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-75323203-9e1a-401b-9ea7-44b37c6f2db2 tempest-VolumesSnapshotTestJSON-1822647413 None] Acquiring lock "cinder-quobyte-d893632e-3fde-4f03-bdc2-97eed837402b" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:23:39 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-75323203-9e1a-401b-9ea7-44b37c6f2db2 tempest-VolumesSnapshotTestJSON-1822647413 None] Lock "cinder-quobyte-d893632e-3fde-4f03-bdc2-97eed837402b" acquired by "delete_volume" :: waited 0.026s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:23:39 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[2724cb5c-a9d5-4b13-b705-a376f85157f6]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:23:39 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-75323203-9e1a-401b-9ea7-44b37c6f2db2 tempest-VolumesSnapshotTestJSON-1822647413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d893632e-3fde-4f03-bdc2-97eed837402b {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:23:40 devstack sudo[97402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d893632e-3fde-4f03-bdc2-97eed837402b Jul 22 03:23:40 devstack sudo[97402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:23:40 devstack sudo[97402]: pam_unix(sudo:session): session closed for user root Jul 22 03:23:40 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-75323203-9e1a-401b-9ea7-44b37c6f2db2 tempest-VolumesSnapshotTestJSON-1822647413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d893632e-3fde-4f03-bdc2-97eed837402b" returned: 0 in 0.495s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:23:40 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-75323203-9e1a-401b-9ea7-44b37c6f2db2 tempest-VolumesSnapshotTestJSON-1822647413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d893632e-3fde-4f03-bdc2-97eed837402b {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:23:40 devstack sudo[97410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d893632e-3fde-4f03-bdc2-97eed837402b Jul 22 03:23:40 devstack sudo[97410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:23:40 devstack sudo[97410]: pam_unix(sudo:session): session closed for user root Jul 22 03:23:40 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-75323203-9e1a-401b-9ea7-44b37c6f2db2 tempest-VolumesSnapshotTestJSON-1822647413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d893632e-3fde-4f03-bdc2-97eed837402b" returned: 0 in 0.263s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:23:40 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-75323203-9e1a-401b-9ea7-44b37c6f2db2 tempest-VolumesSnapshotTestJSON-1822647413 None] Lock "cinder-quobyte-d893632e-3fde-4f03-bdc2-97eed837402b" released by "delete_volume" :: held 0.841s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:23:40 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-75323203-9e1a-401b-9ea7-44b37c6f2db2 tempest-VolumesSnapshotTestJSON-1822647413 None] Created reservations ['58f9daee-270c-4b5c-8ec2-1785ed88630f', 'e7f7f9e2-0693-4e43-8a8f-d6c52ec85523', '4b9f7126-d49e-4a12-988e-cd675bae513e', '5a3249fe-f1dc-43b8-a8bc-0bc0ae508108'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:23:40 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-75323203-9e1a-401b-9ea7-44b37c6f2db2 tempest-VolumesSnapshotTestJSON-1822647413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:23:40 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-75323203-9e1a-401b-9ea7-44b37c6f2db2 tempest-VolumesSnapshotTestJSON-1822647413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:23:40 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-75323203-9e1a-401b-9ea7-44b37c6f2db2 tempest-VolumesSnapshotTestJSON-1822647413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:23:40 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-75323203-9e1a-401b-9ea7-44b37c6f2db2 tempest-VolumesSnapshotTestJSON-1822647413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:23:40 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-75323203-9e1a-401b-9ea7-44b37c6f2db2 tempest-VolumesSnapshotTestJSON-1822647413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:23:40 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-75323203-9e1a-401b-9ea7-44b37c6f2db2 tempest-VolumesSnapshotTestJSON-1822647413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:23:40 devstack sudo[97413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:23:40 devstack sudo[97413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:23:41 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-41f2c5e4-f2bc-440f-b22d-5a6addabe87e tempest-VolumesSnapshotTestJSON-1822647413 None] Acquiring lock "cinder-c84c07e7-b5c3-4aa6-be93-c6f8efc45942-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:23:41 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-41f2c5e4-f2bc-440f-b22d-5a6addabe87e tempest-VolumesSnapshotTestJSON-1822647413 None] Lock "cinder-c84c07e7-b5c3-4aa6-be93-c6f8efc45942-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:23:41 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-41f2c5e4-f2bc-440f-b22d-5a6addabe87e tempest-VolumesSnapshotTestJSON-1822647413 None] Acquiring lock "cinder-quobyte-c84c07e7-b5c3-4aa6-be93-c6f8efc45942" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:23:41 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-41f2c5e4-f2bc-440f-b22d-5a6addabe87e tempest-VolumesSnapshotTestJSON-1822647413 None] Lock "cinder-quobyte-c84c07e7-b5c3-4aa6-be93-c6f8efc45942" acquired by "delete_volume" :: waited 0.024s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:23:41 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8797e6b-20f5-447d-9459-7cfce6e731c0]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:23:41 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-41f2c5e4-f2bc-440f-b22d-5a6addabe87e tempest-VolumesSnapshotTestJSON-1822647413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c84c07e7-b5c3-4aa6-be93-c6f8efc45942 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:23:41 devstack sudo[97413]: pam_unix(sudo:session): session closed for user root Jul 22 03:23:41 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-75323203-9e1a-401b-9ea7-44b37c6f2db2 tempest-VolumesSnapshotTestJSON-1822647413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.542s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:23:41 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-75323203-9e1a-401b-9ea7-44b37c6f2db2 tempest-VolumesSnapshotTestJSON-1822647413 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:23:41 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-75323203-9e1a-401b-9ea7-44b37c6f2db2 tempest-VolumesSnapshotTestJSON-1822647413 None] Deleted volume successfully. Jul 22 03:23:41 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-75323203-9e1a-401b-9ea7-44b37c6f2db2 tempest-VolumesSnapshotTestJSON-1822647413 None] Lock "cinder-d893632e-3fde-4f03-bdc2-97eed837402b-delete_volume" released by "delete_volume" :: held 1.646s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:23:41 devstack sudo[97416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c84c07e7-b5c3-4aa6-be93-c6f8efc45942 Jul 22 03:23:41 devstack sudo[97416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:23:41 devstack sudo[97416]: pam_unix(sudo:session): session closed for user root Jul 22 03:23:41 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-41f2c5e4-f2bc-440f-b22d-5a6addabe87e tempest-VolumesSnapshotTestJSON-1822647413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c84c07e7-b5c3-4aa6-be93-c6f8efc45942" returned: 0 in 0.418s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:23:41 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-41f2c5e4-f2bc-440f-b22d-5a6addabe87e tempest-VolumesSnapshotTestJSON-1822647413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c84c07e7-b5c3-4aa6-be93-c6f8efc45942 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:23:41 devstack sudo[97421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c84c07e7-b5c3-4aa6-be93-c6f8efc45942 Jul 22 03:23:41 devstack sudo[97421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:23:42 devstack sudo[97421]: pam_unix(sudo:session): session closed for user root Jul 22 03:23:42 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-41f2c5e4-f2bc-440f-b22d-5a6addabe87e tempest-VolumesSnapshotTestJSON-1822647413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c84c07e7-b5c3-4aa6-be93-c6f8efc45942" returned: 0 in 0.262s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:23:42 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-41f2c5e4-f2bc-440f-b22d-5a6addabe87e tempest-VolumesSnapshotTestJSON-1822647413 None] Lock "cinder-quobyte-c84c07e7-b5c3-4aa6-be93-c6f8efc45942" released by "delete_volume" :: held 0.762s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:23:42 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-41f2c5e4-f2bc-440f-b22d-5a6addabe87e tempest-VolumesSnapshotTestJSON-1822647413 None] Created reservations ['f778da93-68be-48ff-af03-266b4f9ba3da', '4ced5ecd-b998-4c12-9d1d-1fb644d2a5b3', 'cd90dcdd-7241-447f-ab52-95a372e79879', '5b9a049f-2d99-4006-991e-54aa23476b12'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:23:42 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-41f2c5e4-f2bc-440f-b22d-5a6addabe87e tempest-VolumesSnapshotTestJSON-1822647413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:23:42 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-41f2c5e4-f2bc-440f-b22d-5a6addabe87e tempest-VolumesSnapshotTestJSON-1822647413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:23:42 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-41f2c5e4-f2bc-440f-b22d-5a6addabe87e tempest-VolumesSnapshotTestJSON-1822647413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:23:42 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-41f2c5e4-f2bc-440f-b22d-5a6addabe87e tempest-VolumesSnapshotTestJSON-1822647413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:23:42 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-41f2c5e4-f2bc-440f-b22d-5a6addabe87e tempest-VolumesSnapshotTestJSON-1822647413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:23:42 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-41f2c5e4-f2bc-440f-b22d-5a6addabe87e tempest-VolumesSnapshotTestJSON-1822647413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:23:42 devstack sudo[97424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:23:42 devstack sudo[97424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:23:42 devstack sudo[97424]: pam_unix(sudo:session): session closed for user root Jul 22 03:23:42 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-41f2c5e4-f2bc-440f-b22d-5a6addabe87e tempest-VolumesSnapshotTestJSON-1822647413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.279s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:23:42 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-41f2c5e4-f2bc-440f-b22d-5a6addabe87e tempest-VolumesSnapshotTestJSON-1822647413 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:23:42 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-41f2c5e4-f2bc-440f-b22d-5a6addabe87e tempest-VolumesSnapshotTestJSON-1822647413 None] Deleted volume successfully. Jul 22 03:23:42 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-41f2c5e4-f2bc-440f-b22d-5a6addabe87e tempest-VolumesSnapshotTestJSON-1822647413 None] Lock "cinder-c84c07e7-b5c3-4aa6-be93-c6f8efc45942-delete_volume" released by "delete_volume" :: held 1.332s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:23:48 devstack cinder-volume[87747]: DEBUG dbcounter [-] [87747] Writing DB stats cinder:SELECT=103,cinder:INSERT=34,cinder:UPDATE=97,cinder:DELETE=10 {{(pid=87747) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 03:23:48 devstack cinder-volume[87747]: DEBUG dbcounter [-] [87747] Writing DB stats cinder:UPDATE=112,cinder:SELECT=117,cinder:INSERT=31,cinder:DELETE=9 {{(pid=87747) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 03:23:48 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-4faac1f2-2ee6-44d8-bd68-3596d12c86a8 tempest-VolumesSnapshotNegativeTestJSON-307701042 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:23:48 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-4faac1f2-2ee6-44d8-bd68-3596d12c86a8 tempest-VolumesSnapshotNegativeTestJSON-307701042 None] Flow 'volume_create_manager' (47a24504-10dc-437f-8da1-bb4eece04e81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:23:48 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-4faac1f2-2ee6-44d8-bd68-3596d12c86a8 tempest-VolumesSnapshotNegativeTestJSON-307701042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43b304d0-2fd8-49be-a752-66ce54cc554b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:23:48 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-4faac1f2-2ee6-44d8-bd68-3596d12c86a8 tempest-VolumesSnapshotNegativeTestJSON-307701042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43b304d0-2fd8-49be-a752-66ce54cc554b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:23:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1868457455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1e84d8f-7eef-4c27-905a-1596f5fb195c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f653fa1f858544478b484c4f2459d03d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:23:49Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:23:49Z,use_quota=True,user_id='79b45b341cba48d8b06c5346216c1671',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:23:48 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-4faac1f2-2ee6-44d8-bd68-3596d12c86a8 tempest-VolumesSnapshotNegativeTestJSON-307701042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2a9d9e2-73fa-4251-9e96-eb7a408b711a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:23:48 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-4faac1f2-2ee6-44d8-bd68-3596d12c86a8 tempest-VolumesSnapshotNegativeTestJSON-307701042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2a9d9e2-73fa-4251-9e96-eb7a408b711a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:23:48 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-4faac1f2-2ee6-44d8-bd68-3596d12c86a8 tempest-VolumesSnapshotNegativeTestJSON-307701042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3b89805-d1b8-4089-82bc-d4874428ff07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:23:48 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-4faac1f2-2ee6-44d8-bd68-3596d12c86a8 tempest-VolumesSnapshotNegativeTestJSON-307701042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3b89805-d1b8-4089-82bc-d4874428ff07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1e84d8f-7eef-4c27-905a-1596f5fb195c', 'volume_name': 'volume-c1e84d8f-7eef-4c27-905a-1596f5fb195c', 'volume_size': 2}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:23:48 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-4faac1f2-2ee6-44d8-bd68-3596d12c86a8 tempest-VolumesSnapshotNegativeTestJSON-307701042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d8fa8e5-cad3-4bc7-b207-0ebc6e468492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:23:48 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-4faac1f2-2ee6-44d8-bd68-3596d12c86a8 tempest-VolumesSnapshotNegativeTestJSON-307701042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d8fa8e5-cad3-4bc7-b207-0ebc6e468492) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:23:49 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-4faac1f2-2ee6-44d8-bd68-3596d12c86a8 tempest-VolumesSnapshotNegativeTestJSON-307701042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6346650d-27ed-4f51-ab24-53709a9c9ca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:23:49 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-4faac1f2-2ee6-44d8-bd68-3596d12c86a8 tempest-VolumesSnapshotNegativeTestJSON-307701042 None] Volume c1e84d8f-7eef-4c27-905a-1596f5fb195c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1e84d8f-7eef-4c27-905a-1596f5fb195c', 'volume_size': 2} Jul 22 03:23:49 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-4faac1f2-2ee6-44d8-bd68-3596d12c86a8 tempest-VolumesSnapshotNegativeTestJSON-307701042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:23:49 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-4faac1f2-2ee6-44d8-bd68-3596d12c86a8 tempest-VolumesSnapshotNegativeTestJSON-307701042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:23:49 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-4faac1f2-2ee6-44d8-bd68-3596d12c86a8 tempest-VolumesSnapshotNegativeTestJSON-307701042 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:23:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1868457455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1e84d8f-7eef-4c27-905a-1596f5fb195c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f653fa1f858544478b484c4f2459d03d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:23:49Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:23:49Z,use_quota=True,user_id='79b45b341cba48d8b06c5346216c1671',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:23:49 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-4faac1f2-2ee6-44d8-bd68-3596d12c86a8 tempest-VolumesSnapshotNegativeTestJSON-307701042 None] Creating volume c1e84d8f-7eef-4c27-905a-1596f5fb195c {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:23:49 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-4faac1f2-2ee6-44d8-bd68-3596d12c86a8 tempest-VolumesSnapshotNegativeTestJSON-307701042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:23:49 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-4faac1f2-2ee6-44d8-bd68-3596d12c86a8 tempest-VolumesSnapshotNegativeTestJSON-307701042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:23:49 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-4faac1f2-2ee6-44d8-bd68-3596d12c86a8 tempest-VolumesSnapshotNegativeTestJSON-307701042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:23:49 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-4faac1f2-2ee6-44d8-bd68-3596d12c86a8 tempest-VolumesSnapshotNegativeTestJSON-307701042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:23:49 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-4faac1f2-2ee6-44d8-bd68-3596d12c86a8 tempest-VolumesSnapshotNegativeTestJSON-307701042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:23:49 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-4faac1f2-2ee6-44d8-bd68-3596d12c86a8 tempest-VolumesSnapshotNegativeTestJSON-307701042 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:23:49 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-4faac1f2-2ee6-44d8-bd68-3596d12c86a8 tempest-VolumesSnapshotNegativeTestJSON-307701042 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:23:49 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-4faac1f2-2ee6-44d8-bd68-3596d12c86a8 tempest-VolumesSnapshotNegativeTestJSON-307701042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c1e84d8f-7eef-4c27-905a-1596f5fb195c 2147483648 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:23:49 devstack sudo[97489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c1e84d8f-7eef-4c27-905a-1596f5fb195c 2147483648 Jul 22 03:23:49 devstack sudo[97489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:23:49 devstack sudo[97489]: pam_unix(sudo:session): session closed for user root Jul 22 03:23:49 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-4faac1f2-2ee6-44d8-bd68-3596d12c86a8 tempest-VolumesSnapshotNegativeTestJSON-307701042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c1e84d8f-7eef-4c27-905a-1596f5fb195c 2147483648" returned: 0 in 0.529s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:23:49 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-4faac1f2-2ee6-44d8-bd68-3596d12c86a8 tempest-VolumesSnapshotNegativeTestJSON-307701042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c1e84d8f-7eef-4c27-905a-1596f5fb195c {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:23:49 devstack sudo[97496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c1e84d8f-7eef-4c27-905a-1596f5fb195c Jul 22 03:23:49 devstack sudo[97496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:23:49 devstack sudo[97496]: pam_unix(sudo:session): session closed for user root Jul 22 03:23:49 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-4faac1f2-2ee6-44d8-bd68-3596d12c86a8 tempest-VolumesSnapshotNegativeTestJSON-307701042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c1e84d8f-7eef-4c27-905a-1596f5fb195c" returned: 0 in 0.275s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:23:49 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-4faac1f2-2ee6-44d8-bd68-3596d12c86a8 tempest-VolumesSnapshotNegativeTestJSON-307701042 None] <== create_volume: return (845ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:23:49 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-4faac1f2-2ee6-44d8-bd68-3596d12c86a8 tempest-VolumesSnapshotNegativeTestJSON-307701042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.849s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:23:49 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-4faac1f2-2ee6-44d8-bd68-3596d12c86a8 tempest-VolumesSnapshotNegativeTestJSON-307701042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6346650d-27ed-4f51-ab24-53709a9c9ca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1e84d8f-7eef-4c27-905a-1596f5fb195c', 'volume_size': 2}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:23:49 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-4faac1f2-2ee6-44d8-bd68-3596d12c86a8 tempest-VolumesSnapshotNegativeTestJSON-307701042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f372967-732b-4d3a-ba17-d511d03f0147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:23:49 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-4faac1f2-2ee6-44d8-bd68-3596d12c86a8 tempest-VolumesSnapshotNegativeTestJSON-307701042 None] Volume volume-c1e84d8f-7eef-4c27-905a-1596f5fb195c (c1e84d8f-7eef-4c27-905a-1596f5fb195c): created successfully Jul 22 03:23:49 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-4faac1f2-2ee6-44d8-bd68-3596d12c86a8 tempest-VolumesSnapshotNegativeTestJSON-307701042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f372967-732b-4d3a-ba17-d511d03f0147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:23:49 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-4faac1f2-2ee6-44d8-bd68-3596d12c86a8 tempest-VolumesSnapshotNegativeTestJSON-307701042 None] Flow 'volume_create_manager' (47a24504-10dc-437f-8da1-bb4eece04e81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:23:49 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-4faac1f2-2ee6-44d8-bd68-3596d12c86a8 tempest-VolumesSnapshotNegativeTestJSON-307701042 None] Created volume successfully. Jul 22 03:23:51 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-a9304234-d3ba-47d9-895e-46ce0e18d5cc tempest-VolumesSnapshotNegativeTestJSON-307701042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:23:51 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-a9304234-d3ba-47d9-895e-46ce0e18d5cc tempest-VolumesSnapshotNegativeTestJSON-307701042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:23:51 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-a9304234-d3ba-47d9-895e-46ce0e18d5cc tempest-VolumesSnapshotNegativeTestJSON-307701042 None] Creating offline snapshot b0f10a13-cb20-4ac5-8f82-f41e3165ac75 of volume c1e84d8f-7eef-4c27-905a-1596f5fb195c {{(pid=87747) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 03:23:51 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c8e7b08-ee49-4a98-8b79-7320e30fa4c8]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:23:51 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-a9304234-d3ba-47d9-895e-46ce0e18d5cc tempest-VolumesSnapshotNegativeTestJSON-307701042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c1e84d8f-7eef-4c27-905a-1596f5fb195c {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:23:51 devstack sudo[97566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c1e84d8f-7eef-4c27-905a-1596f5fb195c Jul 22 03:23:51 devstack sudo[97566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:23:51 devstack sudo[97566]: pam_unix(sudo:session): session closed for user root Jul 22 03:23:51 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-a9304234-d3ba-47d9-895e-46ce0e18d5cc tempest-VolumesSnapshotNegativeTestJSON-307701042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c1e84d8f-7eef-4c27-905a-1596f5fb195c" returned: 0 in 0.461s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:23:51 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-a9304234-d3ba-47d9-895e-46ce0e18d5cc tempest-VolumesSnapshotNegativeTestJSON-307701042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c1e84d8f-7eef-4c27-905a-1596f5fb195c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c1e84d8f-7eef-4c27-905a-1596f5fb195c.b0f10a13-cb20-4ac5-8f82-f41e3165ac75 2G {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:23:52 devstack sudo[97573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c1e84d8f-7eef-4c27-905a-1596f5fb195c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c1e84d8f-7eef-4c27-905a-1596f5fb195c.b0f10a13-cb20-4ac5-8f82-f41e3165ac75 2G Jul 22 03:23:52 devstack sudo[97573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:23:52 devstack sudo[97573]: pam_unix(sudo:session): session closed for user root Jul 22 03:23:52 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-a9304234-d3ba-47d9-895e-46ce0e18d5cc tempest-VolumesSnapshotNegativeTestJSON-307701042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c1e84d8f-7eef-4c27-905a-1596f5fb195c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c1e84d8f-7eef-4c27-905a-1596f5fb195c.b0f10a13-cb20-4ac5-8f82-f41e3165ac75 2G" returned: 0 in 0.465s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:23:52 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-a9304234-d3ba-47d9-895e-46ce0e18d5cc tempest-VolumesSnapshotNegativeTestJSON-307701042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1e84d8f-7eef-4c27-905a-1596f5fb195c -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c1e84d8f-7eef-4c27-905a-1596f5fb195c.b0f10a13-cb20-4ac5-8f82-f41e3165ac75 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:23:52 devstack sudo[97579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1e84d8f-7eef-4c27-905a-1596f5fb195c -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c1e84d8f-7eef-4c27-905a-1596f5fb195c.b0f10a13-cb20-4ac5-8f82-f41e3165ac75 Jul 22 03:23:52 devstack sudo[97579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:23:52 devstack sudo[97579]: pam_unix(sudo:session): session closed for user root Jul 22 03:23:52 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-a9304234-d3ba-47d9-895e-46ce0e18d5cc tempest-VolumesSnapshotNegativeTestJSON-307701042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1e84d8f-7eef-4c27-905a-1596f5fb195c -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c1e84d8f-7eef-4c27-905a-1596f5fb195c.b0f10a13-cb20-4ac5-8f82-f41e3165ac75" returned: 0 in 0.325s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:23:52 devstack cinder-volume[87747]: WARNING cinder.volume.drivers.remotefs [None req-a9304234-d3ba-47d9-895e-46ce0e18d5cc tempest-VolumesSnapshotNegativeTestJSON-307701042 None] /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c1e84d8f-7eef-4c27-905a-1596f5fb195c.b0f10a13-cb20-4ac5-8f82-f41e3165ac75 is being set with open permissions: ugo+rw Jul 22 03:23:52 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-a9304234-d3ba-47d9-895e-46ce0e18d5cc tempest-VolumesSnapshotNegativeTestJSON-307701042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c1e84d8f-7eef-4c27-905a-1596f5fb195c.b0f10a13-cb20-4ac5-8f82-f41e3165ac75 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:23:52 devstack sudo[97585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c1e84d8f-7eef-4c27-905a-1596f5fb195c.b0f10a13-cb20-4ac5-8f82-f41e3165ac75 Jul 22 03:23:52 devstack sudo[97585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:23:53 devstack sudo[97585]: pam_unix(sudo:session): session closed for user root Jul 22 03:23:53 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-a9304234-d3ba-47d9-895e-46ce0e18d5cc tempest-VolumesSnapshotNegativeTestJSON-307701042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c1e84d8f-7eef-4c27-905a-1596f5fb195c.b0f10a13-cb20-4ac5-8f82-f41e3165ac75" returned: 0 in 0.330s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:23:53 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-a9304234-d3ba-47d9-895e-46ce0e18d5cc tempest-VolumesSnapshotNegativeTestJSON-307701042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c1e84d8f-7eef-4c27-905a-1596f5fb195c.info {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:23:53 devstack sudo[97593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c1e84d8f-7eef-4c27-905a-1596f5fb195c.info Jul 22 03:23:53 devstack sudo[97593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:23:53 devstack sudo[97593]: pam_unix(sudo:session): session closed for user root Jul 22 03:23:53 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-a9304234-d3ba-47d9-895e-46ce0e18d5cc tempest-VolumesSnapshotNegativeTestJSON-307701042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c1e84d8f-7eef-4c27-905a-1596f5fb195c.info" returned: 0 in 0.344s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:23:53 devstack cinder-volume[87747]: WARNING cinder.volume.drivers.remotefs [None req-a9304234-d3ba-47d9-895e-46ce0e18d5cc tempest-VolumesSnapshotNegativeTestJSON-307701042 None] /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c1e84d8f-7eef-4c27-905a-1596f5fb195c.info is being set with open permissions: ugo+rw Jul 22 03:23:53 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-a9304234-d3ba-47d9-895e-46ce0e18d5cc tempest-VolumesSnapshotNegativeTestJSON-307701042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c1e84d8f-7eef-4c27-905a-1596f5fb195c.info {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:23:53 devstack sudo[97596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c1e84d8f-7eef-4c27-905a-1596f5fb195c.info Jul 22 03:23:53 devstack sudo[97596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:23:53 devstack sudo[97596]: pam_unix(sudo:session): session closed for user root Jul 22 03:23:53 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-a9304234-d3ba-47d9-895e-46ce0e18d5cc tempest-VolumesSnapshotNegativeTestJSON-307701042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c1e84d8f-7eef-4c27-905a-1596f5fb195c.info" returned: 0 in 0.355s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:23:53 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-a9304234-d3ba-47d9-895e-46ce0e18d5cc tempest-VolumesSnapshotNegativeTestJSON-307701042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.388s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:23:53 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-a9304234-d3ba-47d9-895e-46ce0e18d5cc tempest-VolumesSnapshotNegativeTestJSON-307701042 None] Create snapshot completed successfully Jul 22 03:23:54 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-fe550bfa-6e58-4bbc-bfdf-85eac1d9c44c tempest-VolumesSnapshotNegativeTestJSON-307701042 None] Acquiring lock "cinder-b0f10a13-cb20-4ac5-8f82-f41e3165ac75-delete_snapshot" by "delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:23:54 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-fe550bfa-6e58-4bbc-bfdf-85eac1d9c44c tempest-VolumesSnapshotNegativeTestJSON-307701042 None] Lock "cinder-b0f10a13-cb20-4ac5-8f82-f41e3165ac75-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:23:54 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-fe550bfa-6e58-4bbc-bfdf-85eac1d9c44c tempest-VolumesSnapshotNegativeTestJSON-307701042 None] Acquiring lock "cinder-quobyte-c1e84d8f-7eef-4c27-905a-1596f5fb195c" by "delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:23:54 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-fe550bfa-6e58-4bbc-bfdf-85eac1d9c44c tempest-VolumesSnapshotNegativeTestJSON-307701042 None] Lock "cinder-quobyte-c1e84d8f-7eef-4c27-905a-1596f5fb195c" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:23:54 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-fe550bfa-6e58-4bbc-bfdf-85eac1d9c44c tempest-VolumesSnapshotNegativeTestJSON-307701042 None] Acquiring lock "cinder-quobyte-b0f10a13-cb20-4ac5-8f82-f41e3165ac75" by "_delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:23:54 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-fe550bfa-6e58-4bbc-bfdf-85eac1d9c44c tempest-VolumesSnapshotNegativeTestJSON-307701042 None] Lock "cinder-quobyte-b0f10a13-cb20-4ac5-8f82-f41e3165ac75" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:23:54 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-fe550bfa-6e58-4bbc-bfdf-85eac1d9c44c tempest-VolumesSnapshotNegativeTestJSON-307701042 None] Deleting offline snapshot b0f10a13-cb20-4ac5-8f82-f41e3165ac75 of volume c1e84d8f-7eef-4c27-905a-1596f5fb195c {{(pid=87747) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 03:23:54 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-fe550bfa-6e58-4bbc-bfdf-85eac1d9c44c tempest-VolumesSnapshotNegativeTestJSON-307701042 None] snapshot_file for this snap is: volume-c1e84d8f-7eef-4c27-905a-1596f5fb195c.b0f10a13-cb20-4ac5-8f82-f41e3165ac75 {{(pid=87747) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 03:23:54 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[84ae1a83-06e2-4ea4-a081-98e902a7d796]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:23:54 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-fe550bfa-6e58-4bbc-bfdf-85eac1d9c44c tempest-VolumesSnapshotNegativeTestJSON-307701042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c1e84d8f-7eef-4c27-905a-1596f5fb195c.b0f10a13-cb20-4ac5-8f82-f41e3165ac75 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:23:55 devstack sudo[97601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c1e84d8f-7eef-4c27-905a-1596f5fb195c.b0f10a13-cb20-4ac5-8f82-f41e3165ac75 Jul 22 03:23:55 devstack sudo[97601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:23:55 devstack sudo[97601]: pam_unix(sudo:session): session closed for user root Jul 22 03:23:55 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-fe550bfa-6e58-4bbc-bfdf-85eac1d9c44c tempest-VolumesSnapshotNegativeTestJSON-307701042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c1e84d8f-7eef-4c27-905a-1596f5fb195c.b0f10a13-cb20-4ac5-8f82-f41e3165ac75" returned: 0 in 0.404s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:23:55 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-fe550bfa-6e58-4bbc-bfdf-85eac1d9c44c tempest-VolumesSnapshotNegativeTestJSON-307701042 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c1e84d8f-7eef-4c27-905a-1596f5fb195c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87747) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 03:23:55 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[34b5837b-99c7-4a92-945a-6093d2a3b78f]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:23:55 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-fe550bfa-6e58-4bbc-bfdf-85eac1d9c44c tempest-VolumesSnapshotNegativeTestJSON-307701042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c1e84d8f-7eef-4c27-905a-1596f5fb195c {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:23:55 devstack sudo[97606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c1e84d8f-7eef-4c27-905a-1596f5fb195c Jul 22 03:23:55 devstack sudo[97606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:23:55 devstack sudo[97606]: pam_unix(sudo:session): session closed for user root Jul 22 03:23:55 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-fe550bfa-6e58-4bbc-bfdf-85eac1d9c44c tempest-VolumesSnapshotNegativeTestJSON-307701042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c1e84d8f-7eef-4c27-905a-1596f5fb195c" returned: 0 in 0.372s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:23:55 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-fe550bfa-6e58-4bbc-bfdf-85eac1d9c44c tempest-VolumesSnapshotNegativeTestJSON-307701042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c1e84d8f-7eef-4c27-905a-1596f5fb195c.b0f10a13-cb20-4ac5-8f82-f41e3165ac75 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:23:55 devstack sudo[97611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c1e84d8f-7eef-4c27-905a-1596f5fb195c.b0f10a13-cb20-4ac5-8f82-f41e3165ac75 Jul 22 03:23:55 devstack sudo[97611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:23:56 devstack sudo[97611]: pam_unix(sudo:session): session closed for user root Jul 22 03:23:56 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-fe550bfa-6e58-4bbc-bfdf-85eac1d9c44c tempest-VolumesSnapshotNegativeTestJSON-307701042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c1e84d8f-7eef-4c27-905a-1596f5fb195c.b0f10a13-cb20-4ac5-8f82-f41e3165ac75" returned: 0 in 0.330s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:23:56 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-fe550bfa-6e58-4bbc-bfdf-85eac1d9c44c tempest-VolumesSnapshotNegativeTestJSON-307701042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c1e84d8f-7eef-4c27-905a-1596f5fb195c.b0f10a13-cb20-4ac5-8f82-f41e3165ac75 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:23:56 devstack sudo[97617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c1e84d8f-7eef-4c27-905a-1596f5fb195c.b0f10a13-cb20-4ac5-8f82-f41e3165ac75 Jul 22 03:23:56 devstack sudo[97617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:23:56 devstack sudo[97617]: pam_unix(sudo:session): session closed for user root Jul 22 03:23:56 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-fe550bfa-6e58-4bbc-bfdf-85eac1d9c44c tempest-VolumesSnapshotNegativeTestJSON-307701042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c1e84d8f-7eef-4c27-905a-1596f5fb195c.b0f10a13-cb20-4ac5-8f82-f41e3165ac75" returned: 0 in 0.245s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:23:56 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-fe550bfa-6e58-4bbc-bfdf-85eac1d9c44c tempest-VolumesSnapshotNegativeTestJSON-307701042 None] Lock "cinder-quobyte-b0f10a13-cb20-4ac5-8f82-f41e3165ac75" released by "_delete_snapshot" :: held 1.462s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:23:56 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-fe550bfa-6e58-4bbc-bfdf-85eac1d9c44c tempest-VolumesSnapshotNegativeTestJSON-307701042 None] Lock "cinder-quobyte-c1e84d8f-7eef-4c27-905a-1596f5fb195c" released by "delete_snapshot" :: held 1.489s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:23:56 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-fe550bfa-6e58-4bbc-bfdf-85eac1d9c44c tempest-VolumesSnapshotNegativeTestJSON-307701042 None] Created reservations ['2c2ab3a6-0340-4f7c-9b49-7394343cedf9', '3282def6-b8b7-4936-b77c-7258a664c037', '3eb7e845-e8c4-4339-9cf0-aa1acdc5591a', '3a66d96f-2e0e-4010-8855-23bd95fda652'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:23:56 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-fe550bfa-6e58-4bbc-bfdf-85eac1d9c44c tempest-VolumesSnapshotNegativeTestJSON-307701042 None] Delete snapshot completed successfully. Jul 22 03:23:56 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-fe550bfa-6e58-4bbc-bfdf-85eac1d9c44c tempest-VolumesSnapshotNegativeTestJSON-307701042 None] Lock "cinder-b0f10a13-cb20-4ac5-8f82-f41e3165ac75-delete_snapshot" released by "delete_snapshot" :: held 1.637s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:23:57 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-8c1159f7-082e-4512-a8c2-2f68850b12ed tempest-VolumesSnapshotNegativeTestJSON-307701042 None] Acquiring lock "cinder-c1e84d8f-7eef-4c27-905a-1596f5fb195c-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:23:57 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-8c1159f7-082e-4512-a8c2-2f68850b12ed tempest-VolumesSnapshotNegativeTestJSON-307701042 None] Lock "cinder-c1e84d8f-7eef-4c27-905a-1596f5fb195c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:23:57 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-8c1159f7-082e-4512-a8c2-2f68850b12ed tempest-VolumesSnapshotNegativeTestJSON-307701042 None] Acquiring lock "cinder-quobyte-c1e84d8f-7eef-4c27-905a-1596f5fb195c" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:23:57 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-8c1159f7-082e-4512-a8c2-2f68850b12ed tempest-VolumesSnapshotNegativeTestJSON-307701042 None] Lock "cinder-quobyte-c1e84d8f-7eef-4c27-905a-1596f5fb195c" acquired by "delete_volume" :: waited 0.024s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:23:57 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e87304f-5129-47a7-89ea-f3d0626e227d]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:23:57 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-8c1159f7-082e-4512-a8c2-2f68850b12ed tempest-VolumesSnapshotNegativeTestJSON-307701042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c1e84d8f-7eef-4c27-905a-1596f5fb195c {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:23:57 devstack sudo[97620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c1e84d8f-7eef-4c27-905a-1596f5fb195c Jul 22 03:23:57 devstack sudo[97620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:23:57 devstack sudo[97620]: pam_unix(sudo:session): session closed for user root Jul 22 03:23:57 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-8c1159f7-082e-4512-a8c2-2f68850b12ed tempest-VolumesSnapshotNegativeTestJSON-307701042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c1e84d8f-7eef-4c27-905a-1596f5fb195c" returned: 0 in 0.384s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:23:57 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-8c1159f7-082e-4512-a8c2-2f68850b12ed tempest-VolumesSnapshotNegativeTestJSON-307701042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c1e84d8f-7eef-4c27-905a-1596f5fb195c {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:23:57 devstack sudo[97629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c1e84d8f-7eef-4c27-905a-1596f5fb195c Jul 22 03:23:57 devstack sudo[97629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:23:57 devstack sudo[97629]: pam_unix(sudo:session): session closed for user root Jul 22 03:23:57 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-8c1159f7-082e-4512-a8c2-2f68850b12ed tempest-VolumesSnapshotNegativeTestJSON-307701042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c1e84d8f-7eef-4c27-905a-1596f5fb195c" returned: 0 in 0.292s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:23:57 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-8c1159f7-082e-4512-a8c2-2f68850b12ed tempest-VolumesSnapshotNegativeTestJSON-307701042 None] Lock "cinder-quobyte-c1e84d8f-7eef-4c27-905a-1596f5fb195c" released by "delete_volume" :: held 0.739s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:23:57 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-8c1159f7-082e-4512-a8c2-2f68850b12ed tempest-VolumesSnapshotNegativeTestJSON-307701042 None] Created reservations ['f73091cd-cce9-4f01-9185-fe677e13fc0d', '292d11b5-a67c-4f29-a159-4a393ac072ab', '11205a3c-26a3-4a2b-af1e-29302d9c1e81', '210007eb-353b-4920-8060-0f06d352c2eb'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:23:57 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-8c1159f7-082e-4512-a8c2-2f68850b12ed tempest-VolumesSnapshotNegativeTestJSON-307701042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:23:57 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-8c1159f7-082e-4512-a8c2-2f68850b12ed tempest-VolumesSnapshotNegativeTestJSON-307701042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:23:57 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-8c1159f7-082e-4512-a8c2-2f68850b12ed tempest-VolumesSnapshotNegativeTestJSON-307701042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:23:57 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-8c1159f7-082e-4512-a8c2-2f68850b12ed tempest-VolumesSnapshotNegativeTestJSON-307701042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:23:57 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-8c1159f7-082e-4512-a8c2-2f68850b12ed tempest-VolumesSnapshotNegativeTestJSON-307701042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:23:57 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-8c1159f7-082e-4512-a8c2-2f68850b12ed tempest-VolumesSnapshotNegativeTestJSON-307701042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:23:58 devstack sudo[97635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:23:58 devstack sudo[97635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:23:58 devstack sudo[97635]: pam_unix(sudo:session): session closed for user root Jul 22 03:23:58 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-8c1159f7-082e-4512-a8c2-2f68850b12ed tempest-VolumesSnapshotNegativeTestJSON-307701042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.313s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:23:58 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-8c1159f7-082e-4512-a8c2-2f68850b12ed tempest-VolumesSnapshotNegativeTestJSON-307701042 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:23:58 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-8c1159f7-082e-4512-a8c2-2f68850b12ed tempest-VolumesSnapshotNegativeTestJSON-307701042 None] Deleted volume successfully. Jul 22 03:23:58 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-8c1159f7-082e-4512-a8c2-2f68850b12ed tempest-VolumesSnapshotNegativeTestJSON-307701042 None] Lock "cinder-c1e84d8f-7eef-4c27-905a-1596f5fb195c-delete_volume" released by "delete_volume" :: held 1.318s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:23:58 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [req-fbe11318-998a-44fb-8d74-67c18aa495d7 req-c8ed34ad-c32a-4c0d-9415-c28ce129dfc9 tempest-TestInstancesWithCinderVolumes-1475916076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:23:58 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [req-fbe11318-998a-44fb-8d74-67c18aa495d7 req-c8ed34ad-c32a-4c0d-9415-c28ce129dfc9 tempest-TestInstancesWithCinderVolumes-1475916076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:23:58 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [req-fbe11318-998a-44fb-8d74-67c18aa495d7 req-c8ed34ad-c32a-4c0d-9415-c28ce129dfc9 tempest-TestInstancesWithCinderVolumes-1475916076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:23:58 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [req-fbe11318-998a-44fb-8d74-67c18aa495d7 req-c8ed34ad-c32a-4c0d-9415-c28ce129dfc9 tempest-TestInstancesWithCinderVolumes-1475916076 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f', 'name': 'volume-45e0a249-97f8-4eef-8f91-d1c9a742fbb0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c294345a-30bb-4e8e-a922-3bb86dac6b31', 'enforce_multipath': True} {{(pid=87747) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 22 03:23:58 devstack cinder-volume[87747]: INFO cinder.volume.manager [req-fbe11318-998a-44fb-8d74-67c18aa495d7 req-c8ed34ad-c32a-4c0d-9415-c28ce129dfc9 tempest-TestInstancesWithCinderVolumes-1475916076 None] attachment_update completed successfully. Jul 22 03:24:01 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [req-e96530e0-0046-4cb0-9da4-edec6639d6c5 req-80cf250e-1950-45b7-86d6-32a7a80cd3ab tempest-TestInstancesWithCinderVolumes-1475916076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:24:01 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [req-e96530e0-0046-4cb0-9da4-edec6639d6c5 req-80cf250e-1950-45b7-86d6-32a7a80cd3ab tempest-TestInstancesWithCinderVolumes-1475916076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:24:01 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [req-e96530e0-0046-4cb0-9da4-edec6639d6c5 req-80cf250e-1950-45b7-86d6-32a7a80cd3ab tempest-TestInstancesWithCinderVolumes-1475916076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:24:01 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [req-e96530e0-0046-4cb0-9da4-edec6639d6c5 req-80cf250e-1950-45b7-86d6-32a7a80cd3ab tempest-TestInstancesWithCinderVolumes-1475916076 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f', 'name': 'volume-872a1498-bc9f-4ac5-9f4d-ae3a1cb3cb0f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f5d7a977-af43-416f-ae80-84eb4d683c0c', 'enforce_multipath': True} {{(pid=87747) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 22 03:24:01 devstack cinder-volume[87747]: INFO cinder.volume.manager [req-e96530e0-0046-4cb0-9da4-edec6639d6c5 req-80cf250e-1950-45b7-86d6-32a7a80cd3ab tempest-TestInstancesWithCinderVolumes-1475916076 None] attachment_update completed successfully. Jul 22 03:24:05 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb325d09-ef91-4f0a-9ced-97bf5bd3a559 tempest-VolumeAndVolumeTypeFromImageTest-803569115 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:24:05 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-bb325d09-ef91-4f0a-9ced-97bf5bd3a559 tempest-VolumeAndVolumeTypeFromImageTest-803569115 None] Flow 'volume_create_manager' (0c099c33-3da3-438b-beed-851cd7e1a8a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:24:05 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-bb325d09-ef91-4f0a-9ced-97bf5bd3a559 tempest-VolumeAndVolumeTypeFromImageTest-803569115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a77369d5-f8dc-4973-a5c8-75347496586b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:24:05 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-bb325d09-ef91-4f0a-9ced-97bf5bd3a559 tempest-VolumeAndVolumeTypeFromImageTest-803569115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a77369d5-f8dc-4973-a5c8-75347496586b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:24:05Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e2b20b1-1b99-4115-813d-bd0b75ef9026,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0052f80ff1f493583a9ab143de14c16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:24:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:24:05Z,use_quota=True,user_id='db66270a333e4512bc731025c2d66368',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7ef15d42-7d31-422e-9967-6987e7f84fd7),volume_type_id=7ef15d42-7d31-422e-9967-6987e7f84fd7)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:24:05 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-bb325d09-ef91-4f0a-9ced-97bf5bd3a559 tempest-VolumeAndVolumeTypeFromImageTest-803569115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f7ea0aa-3a82-42db-85f6-35a37929002e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:24:05 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-bb325d09-ef91-4f0a-9ced-97bf5bd3a559 tempest-VolumeAndVolumeTypeFromImageTest-803569115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f7ea0aa-3a82-42db-85f6-35a37929002e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:24:05 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-bb325d09-ef91-4f0a-9ced-97bf5bd3a559 tempest-VolumeAndVolumeTypeFromImageTest-803569115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e56d62f-b003-4787-ae5e-76ec916ca2f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:24:05 devstack cinder-volume[87747]: DEBUG cinder.image.glance [None req-bb325d09-ef91-4f0a-9ced-97bf5bd3a559 tempest-VolumeAndVolumeTypeFromImageTest-803569115 None] Creating Keystone auth plugin from conf {{(pid=87747) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 22 03:24:05 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-bb325d09-ef91-4f0a-9ced-97bf5bd3a559 tempest-VolumeAndVolumeTypeFromImageTest-803569115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e56d62f-b003-4787-ae5e-76ec916ca2f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4e2b20b1-1b99-4115-813d-bd0b75ef9026', 'volume_name': 'volume-4e2b20b1-1b99-4115-813d-bd0b75ef9026', 'volume_size': 1, 'image_id': '2357bad3-0466-4119-9589-1be1f92dce20', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2357bad3-0466-4119-9589-1be1f92dce20', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '57e99cd0d57d76b231bb4049b121d4c0', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f0052f80ff1f493583a9ab143de14c16', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'be9ee153554f7e92ff75d15456afbd84d0fb64adb3752cb6f09f026a184930f79d2d23b044fe78109a1850829f7b0afd3eaa0c4e6f6a31403f74de892b878e3d', 'id': '2357bad3-0466-4119-9589-1be1f92dce20', 'created_at': datetime.datetime(2026, 7, 22, 1, 24, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 22, 1, 24, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2357bad3-0466-4119-9589-1be1f92dce20/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:24:05 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-bb325d09-ef91-4f0a-9ced-97bf5bd3a559 tempest-VolumeAndVolumeTypeFromImageTest-803569115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (168333cb-05b3-4fef-9231-8d3a6031974d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:24:05 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-bb325d09-ef91-4f0a-9ced-97bf5bd3a559 tempest-VolumeAndVolumeTypeFromImageTest-803569115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (168333cb-05b3-4fef-9231-8d3a6031974d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:24:05 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-bb325d09-ef91-4f0a-9ced-97bf5bd3a559 tempest-VolumeAndVolumeTypeFromImageTest-803569115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (056148a5-b91e-429e-9558-89fb4b2384fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:24:05 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-bb325d09-ef91-4f0a-9ced-97bf5bd3a559 tempest-VolumeAndVolumeTypeFromImageTest-803569115 None] Volume 4e2b20b1-1b99-4115-813d-bd0b75ef9026: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4e2b20b1-1b99-4115-813d-bd0b75ef9026', 'volume_size': 1, 'image_id': '2357bad3-0466-4119-9589-1be1f92dce20', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2357bad3-0466-4119-9589-1be1f92dce20', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '57e99cd0d57d76b231bb4049b121d4c0', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f0052f80ff1f493583a9ab143de14c16', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'be9ee153554f7e92ff75d15456afbd84d0fb64adb3752cb6f09f026a184930f79d2d23b044fe78109a1850829f7b0afd3eaa0c4e6f6a31403f74de892b878e3d', 'id': '2357bad3-0466-4119-9589-1be1f92dce20', 'created_at': datetime.datetime(2026, 7, 22, 1, 24, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 22, 1, 24, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2357bad3-0466-4119-9589-1be1f92dce20/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 22 03:24:05 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb325d09-ef91-4f0a-9ced-97bf5bd3a559 tempest-VolumeAndVolumeTypeFromImageTest-803569115 None] Trying to clone 4e2b20b1-1b99-4115-813d-bd0b75ef9026 from image 2357bad3-0466-4119-9589-1be1f92dce20 at location (None, [{'url': 'file:///opt/stack/data/glance/images/2357bad3-0466-4119-9589-1be1f92dce20', 'metadata': {}}]). {{(pid=87747) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 22 03:24:05 devstack cinder-volume[87747]: DEBUG cinder.image.image_utils [None req-bb325d09-ef91-4f0a-9ced-97bf5bd3a559 tempest-VolumeAndVolumeTypeFromImageTest-803569115 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2357bad3-0466-4119-9589-1be1f92dce20_968mftbpdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87747) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 22 03:24:05 devstack cinder-volume[87747]: INFO cinder.image.image_utils [None req-bb325d09-ef91-4f0a-9ced-97bf5bd3a559 tempest-VolumeAndVolumeTypeFromImageTest-803569115 None] Image download 0.00 MB at 0.00 MB/s Jul 22 03:24:05 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[171285cd-ea36-4352-83d9-75573f681d74]: (4, 'raw') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:24:05 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-bb325d09-ef91-4f0a-9ced-97bf5bd3a559 tempest-VolumeAndVolumeTypeFromImageTest-803569115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2357bad3-0466-4119-9589-1be1f92dce20_968mftbpdevstack@QuobyteHD {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:24:05 devstack sudo[97717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2357bad3-0466-4119-9589-1be1f92dce20_968mftbpdevstack@QuobyteHD Jul 22 03:24:05 devstack sudo[97717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:24:05 devstack sudo[97717]: pam_unix(sudo:session): session closed for user root Jul 22 03:24:05 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-bb325d09-ef91-4f0a-9ced-97bf5bd3a559 tempest-VolumeAndVolumeTypeFromImageTest-803569115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2357bad3-0466-4119-9589-1be1f92dce20_968mftbpdevstack@QuobyteHD" returned: 0 in 0.329s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:24:05 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-bb325d09-ef91-4f0a-9ced-97bf5bd3a559 tempest-VolumeAndVolumeTypeFromImageTest-803569115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2357bad3-0466-4119-9589-1be1f92dce20_968mftbpdevstack@QuobyteHD {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:24:06 devstack sudo[97727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2357bad3-0466-4119-9589-1be1f92dce20_968mftbpdevstack@QuobyteHD Jul 22 03:24:06 devstack sudo[97727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:24:06 devstack sudo[97727]: pam_unix(sudo:session): session closed for user root Jul 22 03:24:06 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-bb325d09-ef91-4f0a-9ced-97bf5bd3a559 tempest-VolumeAndVolumeTypeFromImageTest-803569115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2357bad3-0466-4119-9589-1be1f92dce20_968mftbpdevstack@QuobyteHD" returned: 1 in 0.358s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:24:06 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-bb325d09-ef91-4f0a-9ced-97bf5bd3a559 tempest-VolumeAndVolumeTypeFromImageTest-803569115 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2357bad3-0466-4119-9589-1be1f92dce20_968mftbpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 22 03:24:06 devstack cinder-volume[87747]: DEBUG cinder.image.image_utils [None req-bb325d09-ef91-4f0a-9ced-97bf5bd3a559 tempest-VolumeAndVolumeTypeFromImageTest-803569115 None] Temporary image 2357bad3-0466-4119-9589-1be1f92dce20 is fetched for user db66270a333e4512bc731025c2d66368. {{(pid=87747) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 22 03:24:06 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e73782e-843d-4d48-b0db-6dd9bb85a70d]: (4, 'raw') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:24:06 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-bb325d09-ef91-4f0a-9ced-97bf5bd3a559 tempest-VolumeAndVolumeTypeFromImageTest-803569115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2357bad3-0466-4119-9589-1be1f92dce20_968mftbpdevstack@QuobyteHD {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:24:06 devstack sudo[97732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2357bad3-0466-4119-9589-1be1f92dce20_968mftbpdevstack@QuobyteHD Jul 22 03:24:06 devstack sudo[97732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:24:06 devstack cinder-volume[87747]: INFO cinder.volume.manager [req-44635cea-ec40-4d11-a65f-cc33f9b15643 req-b5387fec-a05f-4832-81dd-82c553eb2d9e tempest-TestInstancesWithCinderVolumes-1475916076 None] Terminate volume connection completed successfully. Jul 22 03:24:06 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [req-44635cea-ec40-4d11-a65f-cc33f9b15643 req-b5387fec-a05f-4832-81dd-82c553eb2d9e tempest-TestInstancesWithCinderVolumes-1475916076 None] Deleting attachment c294345a-30bb-4e8e-a922-3bb86dac6b31. {{(pid=87747) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 22 03:24:06 devstack sudo[97732]: pam_unix(sudo:session): session closed for user root Jul 22 03:24:06 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-bb325d09-ef91-4f0a-9ced-97bf5bd3a559 tempest-VolumeAndVolumeTypeFromImageTest-803569115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2357bad3-0466-4119-9589-1be1f92dce20_968mftbpdevstack@QuobyteHD" returned: 0 in 0.324s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:24:06 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-bb325d09-ef91-4f0a-9ced-97bf5bd3a559 tempest-VolumeAndVolumeTypeFromImageTest-803569115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2357bad3-0466-4119-9589-1be1f92dce20_968mftbpdevstack@QuobyteHD {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:24:06 devstack sudo[97738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2357bad3-0466-4119-9589-1be1f92dce20_968mftbpdevstack@QuobyteHD Jul 22 03:24:06 devstack sudo[97738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:24:07 devstack sudo[97738]: pam_unix(sudo:session): session closed for user root Jul 22 03:24:07 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-bb325d09-ef91-4f0a-9ced-97bf5bd3a559 tempest-VolumeAndVolumeTypeFromImageTest-803569115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2357bad3-0466-4119-9589-1be1f92dce20_968mftbpdevstack@QuobyteHD" returned: 1 in 0.338s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:24:07 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-bb325d09-ef91-4f0a-9ced-97bf5bd3a559 tempest-VolumeAndVolumeTypeFromImageTest-803569115 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2357bad3-0466-4119-9589-1be1f92dce20_968mftbpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 22 03:24:07 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-bb325d09-ef91-4f0a-9ced-97bf5bd3a559 tempest-VolumeAndVolumeTypeFromImageTest-803569115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:24:07 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-bb325d09-ef91-4f0a-9ced-97bf5bd3a559 tempest-VolumeAndVolumeTypeFromImageTest-803569115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:24:07 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-bb325d09-ef91-4f0a-9ced-97bf5bd3a559 tempest-VolumeAndVolumeTypeFromImageTest-803569115 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:24:05Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e2b20b1-1b99-4115-813d-bd0b75ef9026,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0052f80ff1f493583a9ab143de14c16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:24:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:24:05Z,use_quota=True,user_id='db66270a333e4512bc731025c2d66368',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7ef15d42-7d31-422e-9967-6987e7f84fd7),volume_type_id=7ef15d42-7d31-422e-9967-6987e7f84fd7)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:24:07 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-bb325d09-ef91-4f0a-9ced-97bf5bd3a559 tempest-VolumeAndVolumeTypeFromImageTest-803569115 None] Creating volume 4e2b20b1-1b99-4115-813d-bd0b75ef9026 {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:24:07 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-bb325d09-ef91-4f0a-9ced-97bf5bd3a559 tempest-VolumeAndVolumeTypeFromImageTest-803569115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:24:07 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-bb325d09-ef91-4f0a-9ced-97bf5bd3a559 tempest-VolumeAndVolumeTypeFromImageTest-803569115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:24:07 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-bb325d09-ef91-4f0a-9ced-97bf5bd3a559 tempest-VolumeAndVolumeTypeFromImageTest-803569115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:24:07 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-bb325d09-ef91-4f0a-9ced-97bf5bd3a559 tempest-VolumeAndVolumeTypeFromImageTest-803569115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:24:07 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-bb325d09-ef91-4f0a-9ced-97bf5bd3a559 tempest-VolumeAndVolumeTypeFromImageTest-803569115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:24:07 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-bb325d09-ef91-4f0a-9ced-97bf5bd3a559 tempest-VolumeAndVolumeTypeFromImageTest-803569115 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:24:07 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-bb325d09-ef91-4f0a-9ced-97bf5bd3a559 tempest-VolumeAndVolumeTypeFromImageTest-803569115 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:24:07 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-bb325d09-ef91-4f0a-9ced-97bf5bd3a559 tempest-VolumeAndVolumeTypeFromImageTest-803569115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4e2b20b1-1b99-4115-813d-bd0b75ef9026 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:24:07 devstack sudo[97743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4e2b20b1-1b99-4115-813d-bd0b75ef9026 1073741824 Jul 22 03:24:07 devstack sudo[97743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:24:07 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-fbd94dbd-241d-496b-bd25-366737edf15c tempest-TestInstancesWithCinderVolumes-1475916076 None] Acquiring lock "cinder-45e0a249-97f8-4eef-8f91-d1c9a742fbb0-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:24:07 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-fbd94dbd-241d-496b-bd25-366737edf15c tempest-TestInstancesWithCinderVolumes-1475916076 None] Lock "cinder-45e0a249-97f8-4eef-8f91-d1c9a742fbb0-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:24:07 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-fbd94dbd-241d-496b-bd25-366737edf15c tempest-TestInstancesWithCinderVolumes-1475916076 None] Acquiring lock "cinder-quobyte-45e0a249-97f8-4eef-8f91-d1c9a742fbb0" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:24:07 devstack sudo[97743]: pam_unix(sudo:session): session closed for user root Jul 22 03:24:07 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-bb325d09-ef91-4f0a-9ced-97bf5bd3a559 tempest-VolumeAndVolumeTypeFromImageTest-803569115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4e2b20b1-1b99-4115-813d-bd0b75ef9026 1073741824" returned: 0 in 0.449s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:24:07 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-fbd94dbd-241d-496b-bd25-366737edf15c tempest-TestInstancesWithCinderVolumes-1475916076 None] Lock "cinder-quobyte-45e0a249-97f8-4eef-8f91-d1c9a742fbb0" acquired by "delete_volume" :: waited 0.015s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:24:07 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[07a03c70-e167-4b54-be3d-508cf65a8791]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:24:07 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-fbd94dbd-241d-496b-bd25-366737edf15c tempest-TestInstancesWithCinderVolumes-1475916076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-45e0a249-97f8-4eef-8f91-d1c9a742fbb0 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:24:07 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-bb325d09-ef91-4f0a-9ced-97bf5bd3a559 tempest-VolumeAndVolumeTypeFromImageTest-803569115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4e2b20b1-1b99-4115-813d-bd0b75ef9026 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:24:07 devstack sudo[97754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4e2b20b1-1b99-4115-813d-bd0b75ef9026 Jul 22 03:24:07 devstack sudo[97754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:24:07 devstack sudo[97753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-45e0a249-97f8-4eef-8f91-d1c9a742fbb0 Jul 22 03:24:07 devstack sudo[97753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:24:07 devstack sudo[97754]: pam_unix(sudo:session): session closed for user root Jul 22 03:24:07 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-bb325d09-ef91-4f0a-9ced-97bf5bd3a559 tempest-VolumeAndVolumeTypeFromImageTest-803569115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4e2b20b1-1b99-4115-813d-bd0b75ef9026" returned: 0 in 0.266s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:24:07 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-bb325d09-ef91-4f0a-9ced-97bf5bd3a559 tempest-VolumeAndVolumeTypeFromImageTest-803569115 None] <== create_volume: return (782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:24:07 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-bb325d09-ef91-4f0a-9ced-97bf5bd3a559 tempest-VolumeAndVolumeTypeFromImageTest-803569115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.784s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:24:07 devstack cinder-volume[87747]: DEBUG cinder.volume.volume_utils [None req-bb325d09-ef91-4f0a-9ced-97bf5bd3a559 tempest-VolumeAndVolumeTypeFromImageTest-803569115 None] Attempting download of 2357bad3-0466-4119-9589-1be1f92dce20 ((None, [{'url': 'file:///opt/stack/data/glance/images/2357bad3-0466-4119-9589-1be1f92dce20', 'metadata': {}}])) to volume 4e2b20b1-1b99-4115-813d-bd0b75ef9026. {{(pid=87747) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 22 03:24:07 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[a02bb7cf-be69-4785-8563-f554b34dff0a]: (4, 'raw') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:24:07 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-bb325d09-ef91-4f0a-9ced-97bf5bd3a559 tempest-VolumeAndVolumeTypeFromImageTest-803569115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2357bad3-0466-4119-9589-1be1f92dce20_x629o7uh {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:24:07 devstack sudo[97753]: pam_unix(sudo:session): session closed for user root Jul 22 03:24:07 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-fbd94dbd-241d-496b-bd25-366737edf15c tempest-TestInstancesWithCinderVolumes-1475916076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-45e0a249-97f8-4eef-8f91-d1c9a742fbb0" returned: 0 in 0.396s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:24:07 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-fbd94dbd-241d-496b-bd25-366737edf15c tempest-TestInstancesWithCinderVolumes-1475916076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-45e0a249-97f8-4eef-8f91-d1c9a742fbb0 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:24:07 devstack sudo[97762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-45e0a249-97f8-4eef-8f91-d1c9a742fbb0 Jul 22 03:24:07 devstack sudo[97762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:24:08 devstack sudo[97761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2357bad3-0466-4119-9589-1be1f92dce20_x629o7uh Jul 22 03:24:08 devstack sudo[97761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:24:08 devstack sudo[97762]: pam_unix(sudo:session): session closed for user root Jul 22 03:24:08 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-fbd94dbd-241d-496b-bd25-366737edf15c tempest-TestInstancesWithCinderVolumes-1475916076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-45e0a249-97f8-4eef-8f91-d1c9a742fbb0" returned: 0 in 0.267s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:24:08 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-fbd94dbd-241d-496b-bd25-366737edf15c tempest-TestInstancesWithCinderVolumes-1475916076 None] Lock "cinder-quobyte-45e0a249-97f8-4eef-8f91-d1c9a742fbb0" released by "delete_volume" :: held 0.713s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:24:08 devstack cinder-volume[87747]: WARNING cinder.quota [None req-fbd94dbd-241d-496b-bd25-366737edf15c tempest-TestInstancesWithCinderVolumes-1475916076 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-300033169-390560586 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-300033169-390560586, it is now deprecated. Please use the default quota class for default quota. Jul 22 03:24:08 devstack cinder-volume[87747]: WARNING cinder.quota [None req-fbd94dbd-241d-496b-bd25-366737edf15c tempest-TestInstancesWithCinderVolumes-1475916076 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-300033169-390560586 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-300033169-390560586, it is now deprecated. Please use the default quota class for default quota. Jul 22 03:24:08 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-fbd94dbd-241d-496b-bd25-366737edf15c tempest-TestInstancesWithCinderVolumes-1475916076 None] Created reservations ['857a980a-dd80-4312-b48d-9d9f06980bcb', 'da4ab675-a3b5-419f-b9b5-94dfa907e2ba', '9f2144b4-9ee1-46a8-9bcb-742ed534eeee', '1594087f-cee5-49c6-8792-2f88906f5fbe'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:24:08 devstack sudo[97761]: pam_unix(sudo:session): session closed for user root Jul 22 03:24:08 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-bb325d09-ef91-4f0a-9ced-97bf5bd3a559 tempest-VolumeAndVolumeTypeFromImageTest-803569115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2357bad3-0466-4119-9589-1be1f92dce20_x629o7uh" returned: 0 in 0.383s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:24:08 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-bb325d09-ef91-4f0a-9ced-97bf5bd3a559 tempest-VolumeAndVolumeTypeFromImageTest-803569115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2357bad3-0466-4119-9589-1be1f92dce20_x629o7uh {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:24:08 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-fbd94dbd-241d-496b-bd25-366737edf15c tempest-TestInstancesWithCinderVolumes-1475916076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:24:08 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-fbd94dbd-241d-496b-bd25-366737edf15c tempest-TestInstancesWithCinderVolumes-1475916076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:24:08 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-fbd94dbd-241d-496b-bd25-366737edf15c tempest-TestInstancesWithCinderVolumes-1475916076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:24:08 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-fbd94dbd-241d-496b-bd25-366737edf15c tempest-TestInstancesWithCinderVolumes-1475916076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:24:08 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-fbd94dbd-241d-496b-bd25-366737edf15c tempest-TestInstancesWithCinderVolumes-1475916076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:24:08 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-fbd94dbd-241d-496b-bd25-366737edf15c tempest-TestInstancesWithCinderVolumes-1475916076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:24:08 devstack sudo[97769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:24:08 devstack sudo[97769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:24:08 devstack sudo[97768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2357bad3-0466-4119-9589-1be1f92dce20_x629o7uh Jul 22 03:24:08 devstack sudo[97768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:24:08 devstack sudo[97768]: pam_unix(sudo:session): session closed for user root Jul 22 03:24:08 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-bb325d09-ef91-4f0a-9ced-97bf5bd3a559 tempest-VolumeAndVolumeTypeFromImageTest-803569115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2357bad3-0466-4119-9589-1be1f92dce20_x629o7uh" returned: 1 in 0.341s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:24:08 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-bb325d09-ef91-4f0a-9ced-97bf5bd3a559 tempest-VolumeAndVolumeTypeFromImageTest-803569115 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2357bad3-0466-4119-9589-1be1f92dce20_x629o7uh' failed. Not Retrying. {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 22 03:24:08 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[d64db313-1cde-42a2-84b9-e2a602a7f466]: (4, 'raw') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:24:08 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-bb325d09-ef91-4f0a-9ced-97bf5bd3a559 tempest-VolumeAndVolumeTypeFromImageTest-803569115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2357bad3-0466-4119-9589-1be1f92dce20_968mftbpdevstack@QuobyteHD {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:24:08 devstack sudo[97769]: pam_unix(sudo:session): session closed for user root Jul 22 03:24:08 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-fbd94dbd-241d-496b-bd25-366737edf15c tempest-TestInstancesWithCinderVolumes-1475916076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.278s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:24:08 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-fbd94dbd-241d-496b-bd25-366737edf15c tempest-TestInstancesWithCinderVolumes-1475916076 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:24:08 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-fbd94dbd-241d-496b-bd25-366737edf15c tempest-TestInstancesWithCinderVolumes-1475916076 None] Deleted volume successfully. Jul 22 03:24:08 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-fbd94dbd-241d-496b-bd25-366737edf15c tempest-TestInstancesWithCinderVolumes-1475916076 None] Lock "cinder-45e0a249-97f8-4eef-8f91-d1c9a742fbb0-delete_volume" released by "delete_volume" :: held 1.234s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:24:08 devstack sudo[97775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2357bad3-0466-4119-9589-1be1f92dce20_968mftbpdevstack@QuobyteHD Jul 22 03:24:08 devstack sudo[97775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:24:08 devstack sudo[97775]: pam_unix(sudo:session): session closed for user root Jul 22 03:24:08 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-bb325d09-ef91-4f0a-9ced-97bf5bd3a559 tempest-VolumeAndVolumeTypeFromImageTest-803569115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2357bad3-0466-4119-9589-1be1f92dce20_968mftbpdevstack@QuobyteHD" returned: 0 in 0.353s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:24:08 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-bb325d09-ef91-4f0a-9ced-97bf5bd3a559 tempest-VolumeAndVolumeTypeFromImageTest-803569115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2357bad3-0466-4119-9589-1be1f92dce20_968mftbpdevstack@QuobyteHD {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:24:09 devstack sudo[97779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2357bad3-0466-4119-9589-1be1f92dce20_968mftbpdevstack@QuobyteHD Jul 22 03:24:09 devstack sudo[97779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:24:09 devstack sudo[97779]: pam_unix(sudo:session): session closed for user root Jul 22 03:24:09 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-bb325d09-ef91-4f0a-9ced-97bf5bd3a559 tempest-VolumeAndVolumeTypeFromImageTest-803569115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2357bad3-0466-4119-9589-1be1f92dce20_968mftbpdevstack@QuobyteHD" returned: 1 in 0.337s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:24:09 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-bb325d09-ef91-4f0a-9ced-97bf5bd3a559 tempest-VolumeAndVolumeTypeFromImageTest-803569115 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2357bad3-0466-4119-9589-1be1f92dce20_968mftbpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 22 03:24:09 devstack cinder-volume[87747]: DEBUG cinder.image.image_utils [None req-bb325d09-ef91-4f0a-9ced-97bf5bd3a559 tempest-VolumeAndVolumeTypeFromImageTest-803569115 None] 2357bad3-0466-4119-9589-1be1f92dce20 was raw, converting to qcow2 {{(pid=87747) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 22 03:24:09 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-bb325d09-ef91-4f0a-9ced-97bf5bd3a559 tempest-VolumeAndVolumeTypeFromImageTest-803569115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_2357bad3-0466-4119-9589-1be1f92dce20_968mftbpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4e2b20b1-1b99-4115-813d-bd0b75ef9026 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:24:09 devstack sudo[97788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_2357bad3-0466-4119-9589-1be1f92dce20_968mftbpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4e2b20b1-1b99-4115-813d-bd0b75ef9026 Jul 22 03:24:09 devstack sudo[97788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:24:09 devstack sudo[97788]: pam_unix(sudo:session): session closed for user root Jul 22 03:24:09 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-bb325d09-ef91-4f0a-9ced-97bf5bd3a559 tempest-VolumeAndVolumeTypeFromImageTest-803569115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_2357bad3-0466-4119-9589-1be1f92dce20_968mftbpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4e2b20b1-1b99-4115-813d-bd0b75ef9026" returned: 0 in 0.457s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:24:09 devstack cinder-volume[87747]: DEBUG cinder.image.image_utils [None req-bb325d09-ef91-4f0a-9ced-97bf5bd3a559 tempest-VolumeAndVolumeTypeFromImageTest-803569115 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2357bad3-0466-4119-9589-1be1f92dce20_968mftbpdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4e2b20b1-1b99-4115-813d-bd0b75ef9026 {{(pid=87747) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 22 03:24:09 devstack cinder-volume[87747]: INFO cinder.image.image_utils [None req-bb325d09-ef91-4f0a-9ced-97bf5bd3a559 tempest-VolumeAndVolumeTypeFromImageTest-803569115 None] Converted 0.00 MB image at 0.00 MB/s Jul 22 03:24:09 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-bb325d09-ef91-4f0a-9ced-97bf5bd3a559 tempest-VolumeAndVolumeTypeFromImageTest-803569115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4e2b20b1-1b99-4115-813d-bd0b75ef9026 1G {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:24:09 devstack sudo[97799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4e2b20b1-1b99-4115-813d-bd0b75ef9026 1G Jul 22 03:24:09 devstack sudo[97799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:24:10 devstack sudo[97799]: pam_unix(sudo:session): session closed for user root Jul 22 03:24:10 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-bb325d09-ef91-4f0a-9ced-97bf5bd3a559 tempest-VolumeAndVolumeTypeFromImageTest-803569115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4e2b20b1-1b99-4115-813d-bd0b75ef9026 1G" returned: 0 in 0.305s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:24:10 devstack cinder-volume[87747]: DEBUG cinder.volume.volume_utils [None req-bb325d09-ef91-4f0a-9ced-97bf5bd3a559 tempest-VolumeAndVolumeTypeFromImageTest-803569115 None] Downloaded image 2357bad3-0466-4119-9589-1be1f92dce20 ((None, [{'url': 'file:///opt/stack/data/glance/images/2357bad3-0466-4119-9589-1be1f92dce20', 'metadata': {}}])) to volume 4e2b20b1-1b99-4115-813d-bd0b75ef9026 successfully. {{(pid=87747) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 22 03:24:10 devstack cinder-volume[87747]: DEBUG cinder.image.image_utils [None req-bb325d09-ef91-4f0a-9ced-97bf5bd3a559 tempest-VolumeAndVolumeTypeFromImageTest-803569115 None] Temporary image 2357bad3-0466-4119-9589-1be1f92dce20 for user db66270a333e4512bc731025c2d66368 is deleted. {{(pid=87747) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 22 03:24:10 devstack cinder-volume[87747]: DEBUG cinder.volume.volume_utils [None req-bb325d09-ef91-4f0a-9ced-97bf5bd3a559 tempest-VolumeAndVolumeTypeFromImageTest-803569115 None] Marking volume 4e2b20b1-1b99-4115-813d-bd0b75ef9026 as bootable. {{(pid=87747) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 22 03:24:10 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb325d09-ef91-4f0a-9ced-97bf5bd3a559 tempest-VolumeAndVolumeTypeFromImageTest-803569115 None] Copying metadata from image 2357bad3-0466-4119-9589-1be1f92dce20 to 4e2b20b1-1b99-4115-813d-bd0b75ef9026. {{(pid=87747) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 22 03:24:10 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb325d09-ef91-4f0a-9ced-97bf5bd3a559 tempest-VolumeAndVolumeTypeFromImageTest-803569115 None] Creating volume glance metadata for volume 4e2b20b1-1b99-4115-813d-bd0b75ef9026 backed by image 2357bad3-0466-4119-9589-1be1f92dce20 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '2357bad3-0466-4119-9589-1be1f92dce20', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '57e99cd0d57d76b231bb4049b121d4c0', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87747) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 22 03:24:10 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-bb325d09-ef91-4f0a-9ced-97bf5bd3a559 tempest-VolumeAndVolumeTypeFromImageTest-803569115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (056148a5-b91e-429e-9558-89fb4b2384fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e2b20b1-1b99-4115-813d-bd0b75ef9026', 'volume_size': 1, 'image_id': '2357bad3-0466-4119-9589-1be1f92dce20', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2357bad3-0466-4119-9589-1be1f92dce20', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '57e99cd0d57d76b231bb4049b121d4c0', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f0052f80ff1f493583a9ab143de14c16', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'be9ee153554f7e92ff75d15456afbd84d0fb64adb3752cb6f09f026a184930f79d2d23b044fe78109a1850829f7b0afd3eaa0c4e6f6a31403f74de892b878e3d', 'id': '2357bad3-0466-4119-9589-1be1f92dce20', 'created_at': datetime.datetime(2026, 7, 22, 1, 24, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 22, 1, 24, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2357bad3-0466-4119-9589-1be1f92dce20/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:24:10 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-bb325d09-ef91-4f0a-9ced-97bf5bd3a559 tempest-VolumeAndVolumeTypeFromImageTest-803569115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d477f55e-b8cd-43de-ae92-cd9c25c39d98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:24:10 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-bb325d09-ef91-4f0a-9ced-97bf5bd3a559 tempest-VolumeAndVolumeTypeFromImageTest-803569115 None] Volume volume-4e2b20b1-1b99-4115-813d-bd0b75ef9026 (4e2b20b1-1b99-4115-813d-bd0b75ef9026): created successfully Jul 22 03:24:10 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-bb325d09-ef91-4f0a-9ced-97bf5bd3a559 tempest-VolumeAndVolumeTypeFromImageTest-803569115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d477f55e-b8cd-43de-ae92-cd9c25c39d98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:24:10 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-bb325d09-ef91-4f0a-9ced-97bf5bd3a559 tempest-VolumeAndVolumeTypeFromImageTest-803569115 None] Flow 'volume_create_manager' (0c099c33-3da3-438b-beed-851cd7e1a8a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:24:10 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-bb325d09-ef91-4f0a-9ced-97bf5bd3a559 tempest-VolumeAndVolumeTypeFromImageTest-803569115 None] Created volume successfully. Jul 22 03:24:10 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-a1b7af64-c36f-4939-9a67-503b4962162f tempest-VolumeAndVolumeTypeFromImageTest-803569115 None] Acquiring lock "cinder-4e2b20b1-1b99-4115-813d-bd0b75ef9026-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:24:10 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-a1b7af64-c36f-4939-9a67-503b4962162f tempest-VolumeAndVolumeTypeFromImageTest-803569115 None] Lock "cinder-4e2b20b1-1b99-4115-813d-bd0b75ef9026-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:24:10 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-a1b7af64-c36f-4939-9a67-503b4962162f tempest-VolumeAndVolumeTypeFromImageTest-803569115 None] Acquiring lock "cinder-quobyte-4e2b20b1-1b99-4115-813d-bd0b75ef9026" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:24:10 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-a1b7af64-c36f-4939-9a67-503b4962162f tempest-VolumeAndVolumeTypeFromImageTest-803569115 None] Lock "cinder-quobyte-4e2b20b1-1b99-4115-813d-bd0b75ef9026" acquired by "delete_volume" :: waited 0.013s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:24:10 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[6033dfc0-9bce-4ae1-8ec9-f0cee2a69eb3]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:24:10 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-a1b7af64-c36f-4939-9a67-503b4962162f tempest-VolumeAndVolumeTypeFromImageTest-803569115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4e2b20b1-1b99-4115-813d-bd0b75ef9026 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:24:10 devstack sudo[97814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4e2b20b1-1b99-4115-813d-bd0b75ef9026 Jul 22 03:24:10 devstack sudo[97814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:24:10 devstack sudo[97814]: pam_unix(sudo:session): session closed for user root Jul 22 03:24:10 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-a1b7af64-c36f-4939-9a67-503b4962162f tempest-VolumeAndVolumeTypeFromImageTest-803569115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4e2b20b1-1b99-4115-813d-bd0b75ef9026" returned: 0 in 0.381s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:24:10 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-a1b7af64-c36f-4939-9a67-503b4962162f tempest-VolumeAndVolumeTypeFromImageTest-803569115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4e2b20b1-1b99-4115-813d-bd0b75ef9026 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:24:10 devstack sudo[97819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4e2b20b1-1b99-4115-813d-bd0b75ef9026 Jul 22 03:24:10 devstack sudo[97819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:24:11 devstack sudo[97819]: pam_unix(sudo:session): session closed for user root Jul 22 03:24:11 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-a1b7af64-c36f-4939-9a67-503b4962162f tempest-VolumeAndVolumeTypeFromImageTest-803569115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4e2b20b1-1b99-4115-813d-bd0b75ef9026" returned: 0 in 0.263s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:24:11 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-a1b7af64-c36f-4939-9a67-503b4962162f tempest-VolumeAndVolumeTypeFromImageTest-803569115 None] Lock "cinder-quobyte-4e2b20b1-1b99-4115-813d-bd0b75ef9026" released by "delete_volume" :: held 0.689s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:24:11 devstack cinder-volume[87747]: INFO cinder.volume.manager [req-94bf5eb5-9546-490f-a5b7-fe8da29d0162 req-14e3cd1e-b02c-43bd-a529-32c835679254 tempest-TestInstancesWithCinderVolumes-1475916076 None] Terminate volume connection completed successfully. Jul 22 03:24:11 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [req-94bf5eb5-9546-490f-a5b7-fe8da29d0162 req-14e3cd1e-b02c-43bd-a529-32c835679254 tempest-TestInstancesWithCinderVolumes-1475916076 None] Deleting attachment f5d7a977-af43-416f-ae80-84eb4d683c0c. {{(pid=87747) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 22 03:24:11 devstack cinder-volume[87747]: WARNING cinder.quota [None req-a1b7af64-c36f-4939-9a67-503b4962162f tempest-VolumeAndVolumeTypeFromImageTest-803569115 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 22 03:24:11 devstack cinder-volume[87747]: WARNING cinder.quota [None req-a1b7af64-c36f-4939-9a67-503b4962162f tempest-VolumeAndVolumeTypeFromImageTest-803569115 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 22 03:24:11 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-a1b7af64-c36f-4939-9a67-503b4962162f tempest-VolumeAndVolumeTypeFromImageTest-803569115 None] Created reservations ['74b74a77-2359-4f22-a008-885515a6e639', '9226231c-2374-4e59-9ccd-1dfad779f5bd', 'a6082fe7-b6a1-4111-85ee-c0f5ad4f8200', '2ee42298-e33b-4d19-a73b-ea49d0876236'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:24:11 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-a1b7af64-c36f-4939-9a67-503b4962162f tempest-VolumeAndVolumeTypeFromImageTest-803569115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:24:11 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-a1b7af64-c36f-4939-9a67-503b4962162f tempest-VolumeAndVolumeTypeFromImageTest-803569115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:24:11 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-a1b7af64-c36f-4939-9a67-503b4962162f tempest-VolumeAndVolumeTypeFromImageTest-803569115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:24:11 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-a1b7af64-c36f-4939-9a67-503b4962162f tempest-VolumeAndVolumeTypeFromImageTest-803569115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:24:11 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-a1b7af64-c36f-4939-9a67-503b4962162f tempest-VolumeAndVolumeTypeFromImageTest-803569115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:24:11 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-a1b7af64-c36f-4939-9a67-503b4962162f tempest-VolumeAndVolumeTypeFromImageTest-803569115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:24:11 devstack sudo[97824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:24:11 devstack sudo[97824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:24:11 devstack sudo[97824]: pam_unix(sudo:session): session closed for user root Jul 22 03:24:11 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-a1b7af64-c36f-4939-9a67-503b4962162f tempest-VolumeAndVolumeTypeFromImageTest-803569115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.270s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:24:11 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-a1b7af64-c36f-4939-9a67-503b4962162f tempest-VolumeAndVolumeTypeFromImageTest-803569115 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:24:11 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-a1b7af64-c36f-4939-9a67-503b4962162f tempest-VolumeAndVolumeTypeFromImageTest-803569115 None] Deleted volume successfully. Jul 22 03:24:11 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-a1b7af64-c36f-4939-9a67-503b4962162f tempest-VolumeAndVolumeTypeFromImageTest-803569115 None] Lock "cinder-4e2b20b1-1b99-4115-813d-bd0b75ef9026-delete_volume" released by "delete_volume" :: held 1.194s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:24:12 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-d8835862-ae8a-4a45-a76c-0e9282d33283 tempest-TestInstancesWithCinderVolumes-1475916076 None] Acquiring lock "cinder-872a1498-bc9f-4ac5-9f4d-ae3a1cb3cb0f-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:24:12 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-d8835862-ae8a-4a45-a76c-0e9282d33283 tempest-TestInstancesWithCinderVolumes-1475916076 None] Lock "cinder-872a1498-bc9f-4ac5-9f4d-ae3a1cb3cb0f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:24:12 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-d8835862-ae8a-4a45-a76c-0e9282d33283 tempest-TestInstancesWithCinderVolumes-1475916076 None] Acquiring lock "cinder-quobyte-872a1498-bc9f-4ac5-9f4d-ae3a1cb3cb0f" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:24:12 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-d8835862-ae8a-4a45-a76c-0e9282d33283 tempest-TestInstancesWithCinderVolumes-1475916076 None] Lock "cinder-quobyte-872a1498-bc9f-4ac5-9f4d-ae3a1cb3cb0f" acquired by "delete_volume" :: waited 0.016s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:24:12 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d6fcdeb-1d5e-4211-b1e6-1b02cc381218]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:24:12 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d8835862-ae8a-4a45-a76c-0e9282d33283 tempest-TestInstancesWithCinderVolumes-1475916076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-872a1498-bc9f-4ac5-9f4d-ae3a1cb3cb0f {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:24:12 devstack sudo[97827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-872a1498-bc9f-4ac5-9f4d-ae3a1cb3cb0f Jul 22 03:24:12 devstack sudo[97827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:24:12 devstack sudo[97827]: pam_unix(sudo:session): session closed for user root Jul 22 03:24:12 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d8835862-ae8a-4a45-a76c-0e9282d33283 tempest-TestInstancesWithCinderVolumes-1475916076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-872a1498-bc9f-4ac5-9f4d-ae3a1cb3cb0f" returned: 0 in 0.509s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:24:12 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d8835862-ae8a-4a45-a76c-0e9282d33283 tempest-TestInstancesWithCinderVolumes-1475916076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-872a1498-bc9f-4ac5-9f4d-ae3a1cb3cb0f {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:24:12 devstack sudo[97832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-872a1498-bc9f-4ac5-9f4d-ae3a1cb3cb0f Jul 22 03:24:12 devstack sudo[97832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:24:13 devstack sudo[97832]: pam_unix(sudo:session): session closed for user root Jul 22 03:24:13 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d8835862-ae8a-4a45-a76c-0e9282d33283 tempest-TestInstancesWithCinderVolumes-1475916076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-872a1498-bc9f-4ac5-9f4d-ae3a1cb3cb0f" returned: 0 in 0.357s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:24:13 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-d8835862-ae8a-4a45-a76c-0e9282d33283 tempest-TestInstancesWithCinderVolumes-1475916076 None] Lock "cinder-quobyte-872a1498-bc9f-4ac5-9f4d-ae3a1cb3cb0f" released by "delete_volume" :: held 0.920s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:24:13 devstack cinder-volume[87747]: WARNING cinder.quota [None req-d8835862-ae8a-4a45-a76c-0e9282d33283 tempest-TestInstancesWithCinderVolumes-1475916076 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1548351744-1663256300 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1548351744-1663256300, it is now deprecated. Please use the default quota class for default quota. Jul 22 03:24:13 devstack cinder-volume[87747]: WARNING cinder.quota [None req-d8835862-ae8a-4a45-a76c-0e9282d33283 tempest-TestInstancesWithCinderVolumes-1475916076 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1548351744-1663256300 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1548351744-1663256300, it is now deprecated. Please use the default quota class for default quota. Jul 22 03:24:13 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-d8835862-ae8a-4a45-a76c-0e9282d33283 tempest-TestInstancesWithCinderVolumes-1475916076 None] Created reservations ['7d36ae6a-1c24-46a0-870e-9130d6c86e8c', '3cfbc84e-c2f6-4213-8013-05228df4fdf8', '03820ee8-da7f-4e51-b04b-97aa7e526edd', '495485c4-32d3-4d7a-af00-90031bcd3a0c'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:24:13 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-d8835862-ae8a-4a45-a76c-0e9282d33283 tempest-TestInstancesWithCinderVolumes-1475916076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:24:13 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-d8835862-ae8a-4a45-a76c-0e9282d33283 tempest-TestInstancesWithCinderVolumes-1475916076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:24:13 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-d8835862-ae8a-4a45-a76c-0e9282d33283 tempest-TestInstancesWithCinderVolumes-1475916076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:24:13 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-d8835862-ae8a-4a45-a76c-0e9282d33283 tempest-TestInstancesWithCinderVolumes-1475916076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:24:13 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-d8835862-ae8a-4a45-a76c-0e9282d33283 tempest-TestInstancesWithCinderVolumes-1475916076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:24:13 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d8835862-ae8a-4a45-a76c-0e9282d33283 tempest-TestInstancesWithCinderVolumes-1475916076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:24:13 devstack sudo[97836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:24:13 devstack sudo[97836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:24:13 devstack sudo[97836]: pam_unix(sudo:session): session closed for user root Jul 22 03:24:13 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d8835862-ae8a-4a45-a76c-0e9282d33283 tempest-TestInstancesWithCinderVolumes-1475916076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.341s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:24:13 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-d8835862-ae8a-4a45-a76c-0e9282d33283 tempest-TestInstancesWithCinderVolumes-1475916076 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:24:13 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-d8835862-ae8a-4a45-a76c-0e9282d33283 tempest-TestInstancesWithCinderVolumes-1475916076 None] Deleted volume successfully. Jul 22 03:24:13 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-d8835862-ae8a-4a45-a76c-0e9282d33283 tempest-TestInstancesWithCinderVolumes-1475916076 None] Lock "cinder-872a1498-bc9f-4ac5-9f4d-ae3a1cb3cb0f-delete_volume" released by "delete_volume" :: held 1.556s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:24:15 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-658e3942-dee9-4c97-8cc9-b2ed8adf491b tempest-AttachVolumeNegativeTest-443471683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:24:15 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-658e3942-dee9-4c97-8cc9-b2ed8adf491b tempest-AttachVolumeNegativeTest-443471683 None] Flow 'volume_create_manager' (8051aab6-b672-4b78-8179-354080ea401a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:24:15 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-658e3942-dee9-4c97-8cc9-b2ed8adf491b tempest-AttachVolumeNegativeTest-443471683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcbf97ac-43c2-481a-af49-f5f2a17c6e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:24:15 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-658e3942-dee9-4c97-8cc9-b2ed8adf491b tempest-AttachVolumeNegativeTest-443471683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcbf97ac-43c2-481a-af49-f5f2a17c6e7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:24:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-399800563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=461c81bc-2379-4e12-b7a9-87409c537bea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d96401bdfbf4ea0b40cc88eccd9c07f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:24:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:24:15Z,use_quota=True,user_id='3a91996b03c94127b821ad7a93a4066b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:24:15 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-658e3942-dee9-4c97-8cc9-b2ed8adf491b tempest-AttachVolumeNegativeTest-443471683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7f9e774-68e8-4926-84ee-8ce8b51e2b88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:24:15 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-658e3942-dee9-4c97-8cc9-b2ed8adf491b tempest-AttachVolumeNegativeTest-443471683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7f9e774-68e8-4926-84ee-8ce8b51e2b88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:24:15 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-658e3942-dee9-4c97-8cc9-b2ed8adf491b tempest-AttachVolumeNegativeTest-443471683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4190b8f-9e49-4176-ac91-fcec5b3934ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:24:15 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-658e3942-dee9-4c97-8cc9-b2ed8adf491b tempest-AttachVolumeNegativeTest-443471683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4190b8f-9e49-4176-ac91-fcec5b3934ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '461c81bc-2379-4e12-b7a9-87409c537bea', 'volume_name': 'volume-461c81bc-2379-4e12-b7a9-87409c537bea', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:24:15 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-658e3942-dee9-4c97-8cc9-b2ed8adf491b tempest-AttachVolumeNegativeTest-443471683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5028094e-9282-40c3-bfd3-bc8f1ea8163c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:24:15 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-658e3942-dee9-4c97-8cc9-b2ed8adf491b tempest-AttachVolumeNegativeTest-443471683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5028094e-9282-40c3-bfd3-bc8f1ea8163c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:24:15 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-658e3942-dee9-4c97-8cc9-b2ed8adf491b tempest-AttachVolumeNegativeTest-443471683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8164a6f5-eec2-45da-9599-f2772a35e511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:24:15 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-658e3942-dee9-4c97-8cc9-b2ed8adf491b tempest-AttachVolumeNegativeTest-443471683 None] Volume 461c81bc-2379-4e12-b7a9-87409c537bea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-461c81bc-2379-4e12-b7a9-87409c537bea', 'volume_size': 1} Jul 22 03:24:15 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-658e3942-dee9-4c97-8cc9-b2ed8adf491b tempest-AttachVolumeNegativeTest-443471683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:24:15 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-658e3942-dee9-4c97-8cc9-b2ed8adf491b tempest-AttachVolumeNegativeTest-443471683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:24:15 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-658e3942-dee9-4c97-8cc9-b2ed8adf491b tempest-AttachVolumeNegativeTest-443471683 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:24:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-399800563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=461c81bc-2379-4e12-b7a9-87409c537bea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d96401bdfbf4ea0b40cc88eccd9c07f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:24:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:24:15Z,use_quota=True,user_id='3a91996b03c94127b821ad7a93a4066b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:24:15 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-658e3942-dee9-4c97-8cc9-b2ed8adf491b tempest-AttachVolumeNegativeTest-443471683 None] Creating volume 461c81bc-2379-4e12-b7a9-87409c537bea {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:24:15 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-658e3942-dee9-4c97-8cc9-b2ed8adf491b tempest-AttachVolumeNegativeTest-443471683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:24:15 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-658e3942-dee9-4c97-8cc9-b2ed8adf491b tempest-AttachVolumeNegativeTest-443471683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:24:15 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-658e3942-dee9-4c97-8cc9-b2ed8adf491b tempest-AttachVolumeNegativeTest-443471683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:24:15 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-658e3942-dee9-4c97-8cc9-b2ed8adf491b tempest-AttachVolumeNegativeTest-443471683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:24:15 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-658e3942-dee9-4c97-8cc9-b2ed8adf491b tempest-AttachVolumeNegativeTest-443471683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:24:15 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-658e3942-dee9-4c97-8cc9-b2ed8adf491b tempest-AttachVolumeNegativeTest-443471683 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:24:15 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-658e3942-dee9-4c97-8cc9-b2ed8adf491b tempest-AttachVolumeNegativeTest-443471683 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:24:15 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-658e3942-dee9-4c97-8cc9-b2ed8adf491b tempest-AttachVolumeNegativeTest-443471683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-461c81bc-2379-4e12-b7a9-87409c537bea 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:24:15 devstack sudo[97845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-461c81bc-2379-4e12-b7a9-87409c537bea 1073741824 Jul 22 03:24:15 devstack sudo[97845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:24:16 devstack sudo[97845]: pam_unix(sudo:session): session closed for user root Jul 22 03:24:16 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-658e3942-dee9-4c97-8cc9-b2ed8adf491b tempest-AttachVolumeNegativeTest-443471683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-461c81bc-2379-4e12-b7a9-87409c537bea 1073741824" returned: 0 in 0.773s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:24:16 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-658e3942-dee9-4c97-8cc9-b2ed8adf491b tempest-AttachVolumeNegativeTest-443471683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-461c81bc-2379-4e12-b7a9-87409c537bea {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:24:16 devstack sudo[97871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-461c81bc-2379-4e12-b7a9-87409c537bea Jul 22 03:24:16 devstack sudo[97871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:24:16 devstack sudo[97871]: pam_unix(sudo:session): session closed for user root Jul 22 03:24:16 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-658e3942-dee9-4c97-8cc9-b2ed8adf491b tempest-AttachVolumeNegativeTest-443471683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-461c81bc-2379-4e12-b7a9-87409c537bea" returned: 0 in 0.354s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:24:16 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-658e3942-dee9-4c97-8cc9-b2ed8adf491b tempest-AttachVolumeNegativeTest-443471683 None] <== create_volume: return (1199ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:24:16 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-658e3942-dee9-4c97-8cc9-b2ed8adf491b tempest-AttachVolumeNegativeTest-443471683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.201s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:24:16 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-658e3942-dee9-4c97-8cc9-b2ed8adf491b tempest-AttachVolumeNegativeTest-443471683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8164a6f5-eec2-45da-9599-f2772a35e511) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-461c81bc-2379-4e12-b7a9-87409c537bea', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:24:16 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-658e3942-dee9-4c97-8cc9-b2ed8adf491b tempest-AttachVolumeNegativeTest-443471683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aacc2d64-d772-4339-b854-612010a89524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:24:16 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-658e3942-dee9-4c97-8cc9-b2ed8adf491b tempest-AttachVolumeNegativeTest-443471683 None] Volume volume-461c81bc-2379-4e12-b7a9-87409c537bea (461c81bc-2379-4e12-b7a9-87409c537bea): created successfully Jul 22 03:24:16 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-658e3942-dee9-4c97-8cc9-b2ed8adf491b tempest-AttachVolumeNegativeTest-443471683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aacc2d64-d772-4339-b854-612010a89524) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:24:16 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-658e3942-dee9-4c97-8cc9-b2ed8adf491b tempest-AttachVolumeNegativeTest-443471683 None] Flow 'volume_create_manager' (8051aab6-b672-4b78-8179-354080ea401a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:24:16 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-658e3942-dee9-4c97-8cc9-b2ed8adf491b tempest-AttachVolumeNegativeTest-443471683 None] Created volume successfully. Jul 22 03:24:17 devstack cinder-volume[87747]: INFO cinder.volume.manager [req-4a905064-5c13-415c-b6e7-86667dc778d2 req-2ec2c20a-d09c-46f2-9e52-0b3ff1030836 tempest-TestInstancesWithCinderVolumes-1475916076 None] Terminate volume connection completed successfully. Jul 22 03:24:17 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [req-4a905064-5c13-415c-b6e7-86667dc778d2 req-2ec2c20a-d09c-46f2-9e52-0b3ff1030836 tempest-TestInstancesWithCinderVolumes-1475916076 None] Deleting attachment 962b7fa4-55ce-4fba-8a29-bc6b8f2711d5. {{(pid=87747) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 22 03:24:17 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-40c02b88-861d-4fd6-819d-784cf023c012 tempest-CreateVolumesFromSnapshotTest-1827509654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:24:17 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-40c02b88-861d-4fd6-819d-784cf023c012 tempest-CreateVolumesFromSnapshotTest-1827509654 None] Flow 'volume_create_manager' (e4a91fef-303a-4399-9dea-4a5fb7d4909b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:24:17 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-40c02b88-861d-4fd6-819d-784cf023c012 tempest-CreateVolumesFromSnapshotTest-1827509654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d65a3b7c-72ba-43d0-9703-8114548f3c63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:24:17 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-40c02b88-861d-4fd6-819d-784cf023c012 tempest-CreateVolumesFromSnapshotTest-1827509654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d65a3b7c-72ba-43d0-9703-8114548f3c63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:24:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1783263751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eecb6bad-b49e-4a8a-978b-5ab22790092e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0de5ce3a42af492c9bd3677a6070d6d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:24:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:24:18Z,use_quota=True,user_id='51c089d8598e47fe9415e1a8cce987ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:24:17 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-40c02b88-861d-4fd6-819d-784cf023c012 tempest-CreateVolumesFromSnapshotTest-1827509654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e35c2c7-5ef9-4b42-aa60-7d1075bb0a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:24:17 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-40c02b88-861d-4fd6-819d-784cf023c012 tempest-CreateVolumesFromSnapshotTest-1827509654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e35c2c7-5ef9-4b42-aa60-7d1075bb0a6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:24:17 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-40c02b88-861d-4fd6-819d-784cf023c012 tempest-CreateVolumesFromSnapshotTest-1827509654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc2a688d-6ada-48e6-9993-e345ef3dfaae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:24:17 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-40c02b88-861d-4fd6-819d-784cf023c012 tempest-CreateVolumesFromSnapshotTest-1827509654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc2a688d-6ada-48e6-9993-e345ef3dfaae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eecb6bad-b49e-4a8a-978b-5ab22790092e', 'volume_name': 'volume-eecb6bad-b49e-4a8a-978b-5ab22790092e', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:24:17 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-40c02b88-861d-4fd6-819d-784cf023c012 tempest-CreateVolumesFromSnapshotTest-1827509654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc7aa1e5-aa3a-4348-8ae5-ef568b5a5569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:24:17 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-40c02b88-861d-4fd6-819d-784cf023c012 tempest-CreateVolumesFromSnapshotTest-1827509654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc7aa1e5-aa3a-4348-8ae5-ef568b5a5569) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:24:17 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-40c02b88-861d-4fd6-819d-784cf023c012 tempest-CreateVolumesFromSnapshotTest-1827509654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bad26a13-a092-495d-a27d-d8c9b258774a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:24:17 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-40c02b88-861d-4fd6-819d-784cf023c012 tempest-CreateVolumesFromSnapshotTest-1827509654 None] Volume eecb6bad-b49e-4a8a-978b-5ab22790092e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eecb6bad-b49e-4a8a-978b-5ab22790092e', 'volume_size': 1} Jul 22 03:24:17 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-40c02b88-861d-4fd6-819d-784cf023c012 tempest-CreateVolumesFromSnapshotTest-1827509654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:24:17 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-40c02b88-861d-4fd6-819d-784cf023c012 tempest-CreateVolumesFromSnapshotTest-1827509654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:24:17 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-40c02b88-861d-4fd6-819d-784cf023c012 tempest-CreateVolumesFromSnapshotTest-1827509654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:24:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1783263751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eecb6bad-b49e-4a8a-978b-5ab22790092e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0de5ce3a42af492c9bd3677a6070d6d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:24:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:24:18Z,use_quota=True,user_id='51c089d8598e47fe9415e1a8cce987ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:24:17 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-40c02b88-861d-4fd6-819d-784cf023c012 tempest-CreateVolumesFromSnapshotTest-1827509654 None] Creating volume eecb6bad-b49e-4a8a-978b-5ab22790092e {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:24:17 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-40c02b88-861d-4fd6-819d-784cf023c012 tempest-CreateVolumesFromSnapshotTest-1827509654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:24:17 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-40c02b88-861d-4fd6-819d-784cf023c012 tempest-CreateVolumesFromSnapshotTest-1827509654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:24:17 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-40c02b88-861d-4fd6-819d-784cf023c012 tempest-CreateVolumesFromSnapshotTest-1827509654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:24:17 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-40c02b88-861d-4fd6-819d-784cf023c012 tempest-CreateVolumesFromSnapshotTest-1827509654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:24:17 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-40c02b88-861d-4fd6-819d-784cf023c012 tempest-CreateVolumesFromSnapshotTest-1827509654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:24:17 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-40c02b88-861d-4fd6-819d-784cf023c012 tempest-CreateVolumesFromSnapshotTest-1827509654 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:24:17 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-40c02b88-861d-4fd6-819d-784cf023c012 tempest-CreateVolumesFromSnapshotTest-1827509654 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:24:17 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-40c02b88-861d-4fd6-819d-784cf023c012 tempest-CreateVolumesFromSnapshotTest-1827509654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-eecb6bad-b49e-4a8a-978b-5ab22790092e 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:24:17 devstack sudo[97889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-eecb6bad-b49e-4a8a-978b-5ab22790092e 1073741824 Jul 22 03:24:17 devstack sudo[97889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:24:18 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [req-95effaf9-a5fd-4bd1-b995-90a26364cdb5 req-b596caaf-b01d-4e68-89bc-5e5245fac04f tempest-AttachVolumeNegativeTest-443471683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:24:18 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-d8d1737a-3dd3-47c1-a12a-558fda0d24f0 tempest-TestInstancesWithCinderVolumes-1475916076 None] Acquiring lock "cinder-8b636260-1ddf-4058-b489-e696d283b079-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:24:18 devstack sudo[97889]: pam_unix(sudo:session): session closed for user root Jul 22 03:24:18 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-40c02b88-861d-4fd6-819d-784cf023c012 tempest-CreateVolumesFromSnapshotTest-1827509654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-eecb6bad-b49e-4a8a-978b-5ab22790092e 1073741824" returned: 0 in 0.524s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:24:18 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-d8d1737a-3dd3-47c1-a12a-558fda0d24f0 tempest-TestInstancesWithCinderVolumes-1475916076 None] Lock "cinder-8b636260-1ddf-4058-b489-e696d283b079-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:24:18 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-40c02b88-861d-4fd6-819d-784cf023c012 tempest-CreateVolumesFromSnapshotTest-1827509654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-eecb6bad-b49e-4a8a-978b-5ab22790092e {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:24:18 devstack sudo[97903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-eecb6bad-b49e-4a8a-978b-5ab22790092e Jul 22 03:24:18 devstack sudo[97903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:24:18 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-d8d1737a-3dd3-47c1-a12a-558fda0d24f0 tempest-TestInstancesWithCinderVolumes-1475916076 None] Acquiring lock "cinder-quobyte-8b636260-1ddf-4058-b489-e696d283b079" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:24:18 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-d8d1737a-3dd3-47c1-a12a-558fda0d24f0 tempest-TestInstancesWithCinderVolumes-1475916076 None] Lock "cinder-quobyte-8b636260-1ddf-4058-b489-e696d283b079" acquired by "delete_volume" :: waited 0.015s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:24:18 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[29b3565d-80eb-4e32-a4f6-3871908fb691]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:24:18 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d8d1737a-3dd3-47c1-a12a-558fda0d24f0 tempest-TestInstancesWithCinderVolumes-1475916076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-8b636260-1ddf-4058-b489-e696d283b079 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:24:18 devstack sudo[97905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-8b636260-1ddf-4058-b489-e696d283b079 Jul 22 03:24:18 devstack sudo[97905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:24:18 devstack sudo[97903]: pam_unix(sudo:session): session closed for user root Jul 22 03:24:18 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-40c02b88-861d-4fd6-819d-784cf023c012 tempest-CreateVolumesFromSnapshotTest-1827509654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-eecb6bad-b49e-4a8a-978b-5ab22790092e" returned: 0 in 0.245s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:24:18 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-40c02b88-861d-4fd6-819d-784cf023c012 tempest-CreateVolumesFromSnapshotTest-1827509654 None] <== create_volume: return (837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:24:18 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-40c02b88-861d-4fd6-819d-784cf023c012 tempest-CreateVolumesFromSnapshotTest-1827509654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.840s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:24:18 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [req-95effaf9-a5fd-4bd1-b995-90a26364cdb5 req-b596caaf-b01d-4e68-89bc-5e5245fac04f tempest-AttachVolumeNegativeTest-443471683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.472s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:24:18 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [req-95effaf9-a5fd-4bd1-b995-90a26364cdb5 req-b596caaf-b01d-4e68-89bc-5e5245fac04f tempest-AttachVolumeNegativeTest-443471683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:24:18 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-40c02b88-861d-4fd6-819d-784cf023c012 tempest-CreateVolumesFromSnapshotTest-1827509654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bad26a13-a092-495d-a27d-d8c9b258774a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eecb6bad-b49e-4a8a-978b-5ab22790092e', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:24:18 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-40c02b88-861d-4fd6-819d-784cf023c012 tempest-CreateVolumesFromSnapshotTest-1827509654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f755545-2843-43e7-bf7b-9de36c21007c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:24:18 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-40c02b88-861d-4fd6-819d-784cf023c012 tempest-CreateVolumesFromSnapshotTest-1827509654 None] Volume volume-eecb6bad-b49e-4a8a-978b-5ab22790092e (eecb6bad-b49e-4a8a-978b-5ab22790092e): created successfully Jul 22 03:24:18 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-40c02b88-861d-4fd6-819d-784cf023c012 tempest-CreateVolumesFromSnapshotTest-1827509654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f755545-2843-43e7-bf7b-9de36c21007c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:24:18 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-40c02b88-861d-4fd6-819d-784cf023c012 tempest-CreateVolumesFromSnapshotTest-1827509654 None] Flow 'volume_create_manager' (e4a91fef-303a-4399-9dea-4a5fb7d4909b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:24:18 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [req-95effaf9-a5fd-4bd1-b995-90a26364cdb5 req-b596caaf-b01d-4e68-89bc-5e5245fac04f tempest-AttachVolumeNegativeTest-443471683 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f', 'name': 'volume-461c81bc-2379-4e12-b7a9-87409c537bea', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b949acfb-e6b2-4827-b2e7-2f0f3f57e827', 'enforce_multipath': True} {{(pid=87747) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 22 03:24:18 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-40c02b88-861d-4fd6-819d-784cf023c012 tempest-CreateVolumesFromSnapshotTest-1827509654 None] Created volume successfully. Jul 22 03:24:18 devstack cinder-volume[87747]: INFO cinder.volume.manager [req-95effaf9-a5fd-4bd1-b995-90a26364cdb5 req-b596caaf-b01d-4e68-89bc-5e5245fac04f tempest-AttachVolumeNegativeTest-443471683 None] attachment_update completed successfully. Jul 22 03:24:18 devstack sudo[97905]: pam_unix(sudo:session): session closed for user root Jul 22 03:24:18 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d8d1737a-3dd3-47c1-a12a-558fda0d24f0 tempest-TestInstancesWithCinderVolumes-1475916076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-8b636260-1ddf-4058-b489-e696d283b079" returned: 0 in 0.381s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:24:18 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d8d1737a-3dd3-47c1-a12a-558fda0d24f0 tempest-TestInstancesWithCinderVolumes-1475916076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-8b636260-1ddf-4058-b489-e696d283b079 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:24:18 devstack sudo[97912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-8b636260-1ddf-4058-b489-e696d283b079 Jul 22 03:24:18 devstack sudo[97912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:24:19 devstack sudo[97912]: pam_unix(sudo:session): session closed for user root Jul 22 03:24:19 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d8d1737a-3dd3-47c1-a12a-558fda0d24f0 tempest-TestInstancesWithCinderVolumes-1475916076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-8b636260-1ddf-4058-b489-e696d283b079" returned: 0 in 0.273s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:24:19 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-d8d1737a-3dd3-47c1-a12a-558fda0d24f0 tempest-TestInstancesWithCinderVolumes-1475916076 None] Lock "cinder-quobyte-8b636260-1ddf-4058-b489-e696d283b079" released by "delete_volume" :: held 0.693s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:24:19 devstack cinder-volume[87747]: WARNING cinder.quota [None req-d8d1737a-3dd3-47c1-a12a-558fda0d24f0 tempest-TestInstancesWithCinderVolumes-1475916076 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-498478200-1977558446 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-498478200-1977558446, it is now deprecated. Please use the default quota class for default quota. Jul 22 03:24:19 devstack cinder-volume[87747]: WARNING cinder.quota [None req-d8d1737a-3dd3-47c1-a12a-558fda0d24f0 tempest-TestInstancesWithCinderVolumes-1475916076 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-498478200-1977558446 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-498478200-1977558446, it is now deprecated. Please use the default quota class for default quota. Jul 22 03:24:19 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-d8d1737a-3dd3-47c1-a12a-558fda0d24f0 tempest-TestInstancesWithCinderVolumes-1475916076 None] Created reservations ['d03fcb07-bd30-4a8a-bc01-90a3d274e0dc', '93fb5d55-80a5-4a9d-934d-99b3ab605f96', '0c39f3cd-7ac5-41c1-9518-3a0ece061535', '6a26c4f5-9636-4839-ad91-231fc13baf05'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:24:19 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-d8d1737a-3dd3-47c1-a12a-558fda0d24f0 tempest-TestInstancesWithCinderVolumes-1475916076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:24:19 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-d8d1737a-3dd3-47c1-a12a-558fda0d24f0 tempest-TestInstancesWithCinderVolumes-1475916076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:24:19 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-d8d1737a-3dd3-47c1-a12a-558fda0d24f0 tempest-TestInstancesWithCinderVolumes-1475916076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:24:19 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-d8d1737a-3dd3-47c1-a12a-558fda0d24f0 tempest-TestInstancesWithCinderVolumes-1475916076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:24:19 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-d8d1737a-3dd3-47c1-a12a-558fda0d24f0 tempest-TestInstancesWithCinderVolumes-1475916076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:24:19 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d8d1737a-3dd3-47c1-a12a-558fda0d24f0 tempest-TestInstancesWithCinderVolumes-1475916076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:24:19 devstack sudo[98296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:24:19 devstack sudo[98296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:24:19 devstack sudo[98296]: pam_unix(sudo:session): session closed for user root Jul 22 03:24:19 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d8d1737a-3dd3-47c1-a12a-558fda0d24f0 tempest-TestInstancesWithCinderVolumes-1475916076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.256s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:24:19 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-d8d1737a-3dd3-47c1-a12a-558fda0d24f0 tempest-TestInstancesWithCinderVolumes-1475916076 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:24:19 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-d8d1737a-3dd3-47c1-a12a-558fda0d24f0 tempest-TestInstancesWithCinderVolumes-1475916076 None] Deleted volume successfully. Jul 22 03:24:19 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-d8d1737a-3dd3-47c1-a12a-558fda0d24f0 tempest-TestInstancesWithCinderVolumes-1475916076 None] Lock "cinder-8b636260-1ddf-4058-b489-e696d283b079-delete_volume" released by "delete_volume" :: held 1.215s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:24:19 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-0f62c099-dc6e-4ad3-9ff9-ff933dd8d906 tempest-CreateVolumesFromSnapshotTest-1827509654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:24:19 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-0f62c099-dc6e-4ad3-9ff9-ff933dd8d906 tempest-CreateVolumesFromSnapshotTest-1827509654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:24:19 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-0f62c099-dc6e-4ad3-9ff9-ff933dd8d906 tempest-CreateVolumesFromSnapshotTest-1827509654 None] Creating offline snapshot c3bc32a0-4bf1-4946-867d-1c4e34ae621c of volume eecb6bad-b49e-4a8a-978b-5ab22790092e {{(pid=87747) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 03:24:19 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebba0e92-6dbe-44ea-b7c1-dde4e3441eb0]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:24:19 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-0f62c099-dc6e-4ad3-9ff9-ff933dd8d906 tempest-CreateVolumesFromSnapshotTest-1827509654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-eecb6bad-b49e-4a8a-978b-5ab22790092e {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:24:20 devstack sudo[98299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-eecb6bad-b49e-4a8a-978b-5ab22790092e Jul 22 03:24:20 devstack sudo[98299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:24:20 devstack sudo[98299]: pam_unix(sudo:session): session closed for user root Jul 22 03:24:20 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-0f62c099-dc6e-4ad3-9ff9-ff933dd8d906 tempest-CreateVolumesFromSnapshotTest-1827509654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-eecb6bad-b49e-4a8a-978b-5ab22790092e" returned: 0 in 0.400s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:24:20 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-0f62c099-dc6e-4ad3-9ff9-ff933dd8d906 tempest-CreateVolumesFromSnapshotTest-1827509654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-eecb6bad-b49e-4a8a-978b-5ab22790092e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-eecb6bad-b49e-4a8a-978b-5ab22790092e.c3bc32a0-4bf1-4946-867d-1c4e34ae621c 1G {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:24:20 devstack sudo[98304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-eecb6bad-b49e-4a8a-978b-5ab22790092e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-eecb6bad-b49e-4a8a-978b-5ab22790092e.c3bc32a0-4bf1-4946-867d-1c4e34ae621c 1G Jul 22 03:24:20 devstack sudo[98304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:24:20 devstack sudo[98304]: pam_unix(sudo:session): session closed for user root Jul 22 03:24:20 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-0f62c099-dc6e-4ad3-9ff9-ff933dd8d906 tempest-CreateVolumesFromSnapshotTest-1827509654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-eecb6bad-b49e-4a8a-978b-5ab22790092e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-eecb6bad-b49e-4a8a-978b-5ab22790092e.c3bc32a0-4bf1-4946-867d-1c4e34ae621c 1G" returned: 0 in 0.499s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:24:20 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-0f62c099-dc6e-4ad3-9ff9-ff933dd8d906 tempest-CreateVolumesFromSnapshotTest-1827509654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eecb6bad-b49e-4a8a-978b-5ab22790092e -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-eecb6bad-b49e-4a8a-978b-5ab22790092e.c3bc32a0-4bf1-4946-867d-1c4e34ae621c {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:24:20 devstack sudo[98310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eecb6bad-b49e-4a8a-978b-5ab22790092e -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-eecb6bad-b49e-4a8a-978b-5ab22790092e.c3bc32a0-4bf1-4946-867d-1c4e34ae621c Jul 22 03:24:20 devstack sudo[98310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:24:21 devstack cinder-volume[87747]: INFO cinder.volume.manager [req-7d283443-f59b-45e6-878d-79fdfefcacc4 req-517c0d6c-d69c-4e54-aead-7ecaf0ed27a9 tempest-AttachVolumeNegativeTest-443471683 None] Terminate volume connection completed successfully. Jul 22 03:24:21 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [req-7d283443-f59b-45e6-878d-79fdfefcacc4 req-517c0d6c-d69c-4e54-aead-7ecaf0ed27a9 tempest-AttachVolumeNegativeTest-443471683 None] Deleting attachment b949acfb-e6b2-4827-b2e7-2f0f3f57e827. {{(pid=87747) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 22 03:24:21 devstack sudo[98310]: pam_unix(sudo:session): session closed for user root Jul 22 03:24:21 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-0f62c099-dc6e-4ad3-9ff9-ff933dd8d906 tempest-CreateVolumesFromSnapshotTest-1827509654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eecb6bad-b49e-4a8a-978b-5ab22790092e -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-eecb6bad-b49e-4a8a-978b-5ab22790092e.c3bc32a0-4bf1-4946-867d-1c4e34ae621c" returned: 0 in 0.409s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:24:21 devstack cinder-volume[87747]: WARNING cinder.volume.drivers.remotefs [None req-0f62c099-dc6e-4ad3-9ff9-ff933dd8d906 tempest-CreateVolumesFromSnapshotTest-1827509654 None] /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-eecb6bad-b49e-4a8a-978b-5ab22790092e.c3bc32a0-4bf1-4946-867d-1c4e34ae621c is being set with open permissions: ugo+rw Jul 22 03:24:21 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-0f62c099-dc6e-4ad3-9ff9-ff933dd8d906 tempest-CreateVolumesFromSnapshotTest-1827509654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-eecb6bad-b49e-4a8a-978b-5ab22790092e.c3bc32a0-4bf1-4946-867d-1c4e34ae621c {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:24:21 devstack sudo[98343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-eecb6bad-b49e-4a8a-978b-5ab22790092e.c3bc32a0-4bf1-4946-867d-1c4e34ae621c Jul 22 03:24:21 devstack sudo[98343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:24:21 devstack sudo[98343]: pam_unix(sudo:session): session closed for user root Jul 22 03:24:21 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-0f62c099-dc6e-4ad3-9ff9-ff933dd8d906 tempest-CreateVolumesFromSnapshotTest-1827509654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-eecb6bad-b49e-4a8a-978b-5ab22790092e.c3bc32a0-4bf1-4946-867d-1c4e34ae621c" returned: 0 in 0.273s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:24:21 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-0f62c099-dc6e-4ad3-9ff9-ff933dd8d906 tempest-CreateVolumesFromSnapshotTest-1827509654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-eecb6bad-b49e-4a8a-978b-5ab22790092e.info {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:24:21 devstack sudo[98346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-eecb6bad-b49e-4a8a-978b-5ab22790092e.info Jul 22 03:24:21 devstack sudo[98346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:24:21 devstack sudo[98346]: pam_unix(sudo:session): session closed for user root Jul 22 03:24:21 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-0f62c099-dc6e-4ad3-9ff9-ff933dd8d906 tempest-CreateVolumesFromSnapshotTest-1827509654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-eecb6bad-b49e-4a8a-978b-5ab22790092e.info" returned: 0 in 0.263s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:24:21 devstack cinder-volume[87747]: WARNING cinder.volume.drivers.remotefs [None req-0f62c099-dc6e-4ad3-9ff9-ff933dd8d906 tempest-CreateVolumesFromSnapshotTest-1827509654 None] /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-eecb6bad-b49e-4a8a-978b-5ab22790092e.info is being set with open permissions: ugo+rw Jul 22 03:24:21 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-0f62c099-dc6e-4ad3-9ff9-ff933dd8d906 tempest-CreateVolumesFromSnapshotTest-1827509654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-eecb6bad-b49e-4a8a-978b-5ab22790092e.info {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:24:21 devstack sudo[98350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-eecb6bad-b49e-4a8a-978b-5ab22790092e.info Jul 22 03:24:21 devstack sudo[98350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:24:22 devstack sudo[98350]: pam_unix(sudo:session): session closed for user root Jul 22 03:24:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-0f62c099-dc6e-4ad3-9ff9-ff933dd8d906 tempest-CreateVolumesFromSnapshotTest-1827509654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-eecb6bad-b49e-4a8a-978b-5ab22790092e.info" returned: 0 in 0.329s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:24:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-0f62c099-dc6e-4ad3-9ff9-ff933dd8d906 tempest-CreateVolumesFromSnapshotTest-1827509654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.274s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:24:22 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-0f62c099-dc6e-4ad3-9ff9-ff933dd8d906 tempest-CreateVolumesFromSnapshotTest-1827509654 None] Create snapshot completed successfully Jul 22 03:24:22 devstack cinder-volume[87747]: DEBUG oslo_service.periodic_task [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87747) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 03:24:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:24:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:24:22 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:24:22 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:24:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:24:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:24:22 devstack sudo[98368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:24:22 devstack sudo[98368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:24:22 devstack sudo[98368]: pam_unix(sudo:session): session closed for user root Jul 22 03:24:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.267s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:24:22 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:24:22 devstack cinder-volume[87747]: DEBUG oslo_service.periodic_task [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Running periodic task VolumeManager._thread_info {{(pid=87747) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 03:24:22 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] thread count: 28 {{(pid=87747) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 22 03:24:22 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] thread info: [<_MainThread(MainThread, started 132775275860096)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87747) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 22 03:24:23 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc088123-b656-415b-bbb8-faa6a5cef70c tempest-CreateVolumesFromSnapshotTest-1827509654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:24:23 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-bc088123-b656-415b-bbb8-faa6a5cef70c tempest-CreateVolumesFromSnapshotTest-1827509654 None] Flow 'volume_create_manager' (3fb821d7-284a-4bcd-b1cf-d584311e5ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:24:23 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-bc088123-b656-415b-bbb8-faa6a5cef70c tempest-CreateVolumesFromSnapshotTest-1827509654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7cdb479-e6fe-48aa-80cf-588f9e60a3ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:24:23 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-bc088123-b656-415b-bbb8-faa6a5cef70c tempest-CreateVolumesFromSnapshotTest-1827509654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7cdb479-e6fe-48aa-80cf-588f9e60a3ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:24:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-137038163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50dd51d3-c1ee-4277-8230-ee259890f67c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0de5ce3a42af492c9bd3677a6070d6d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:24:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:24:24Z,use_quota=True,user_id='51c089d8598e47fe9415e1a8cce987ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:24:23 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-bc088123-b656-415b-bbb8-faa6a5cef70c tempest-CreateVolumesFromSnapshotTest-1827509654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2587e801-943e-4c1c-962d-0e0eed6e570d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:24:23 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-bc088123-b656-415b-bbb8-faa6a5cef70c tempest-CreateVolumesFromSnapshotTest-1827509654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2587e801-943e-4c1c-962d-0e0eed6e570d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:24:23 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-bc088123-b656-415b-bbb8-faa6a5cef70c tempest-CreateVolumesFromSnapshotTest-1827509654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9de3de69-3e39-4728-b169-bb8f184818ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:24:23 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-bc088123-b656-415b-bbb8-faa6a5cef70c tempest-CreateVolumesFromSnapshotTest-1827509654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9de3de69-3e39-4728-b169-bb8f184818ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50dd51d3-c1ee-4277-8230-ee259890f67c', 'volume_name': 'volume-50dd51d3-c1ee-4277-8230-ee259890f67c', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:24:23 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-bc088123-b656-415b-bbb8-faa6a5cef70c tempest-CreateVolumesFromSnapshotTest-1827509654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5aa0d279-9d0d-4b00-96a9-7c75f2e8b10c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:24:23 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-bc088123-b656-415b-bbb8-faa6a5cef70c tempest-CreateVolumesFromSnapshotTest-1827509654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5aa0d279-9d0d-4b00-96a9-7c75f2e8b10c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:24:23 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-bc088123-b656-415b-bbb8-faa6a5cef70c tempest-CreateVolumesFromSnapshotTest-1827509654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (015c2442-ecce-487a-be92-85259c822a2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:24:23 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-bc088123-b656-415b-bbb8-faa6a5cef70c tempest-CreateVolumesFromSnapshotTest-1827509654 None] Volume 50dd51d3-c1ee-4277-8230-ee259890f67c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50dd51d3-c1ee-4277-8230-ee259890f67c', 'volume_size': 1} Jul 22 03:24:23 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-bc088123-b656-415b-bbb8-faa6a5cef70c tempest-CreateVolumesFromSnapshotTest-1827509654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:24:23 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-bc088123-b656-415b-bbb8-faa6a5cef70c tempest-CreateVolumesFromSnapshotTest-1827509654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:24:23 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-bc088123-b656-415b-bbb8-faa6a5cef70c tempest-CreateVolumesFromSnapshotTest-1827509654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:24:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-137038163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50dd51d3-c1ee-4277-8230-ee259890f67c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0de5ce3a42af492c9bd3677a6070d6d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:24:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:24:24Z,use_quota=True,user_id='51c089d8598e47fe9415e1a8cce987ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:24:23 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-bc088123-b656-415b-bbb8-faa6a5cef70c tempest-CreateVolumesFromSnapshotTest-1827509654 None] Creating volume 50dd51d3-c1ee-4277-8230-ee259890f67c {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:24:23 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-bc088123-b656-415b-bbb8-faa6a5cef70c tempest-CreateVolumesFromSnapshotTest-1827509654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:24:23 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-bc088123-b656-415b-bbb8-faa6a5cef70c tempest-CreateVolumesFromSnapshotTest-1827509654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:24:23 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-bc088123-b656-415b-bbb8-faa6a5cef70c tempest-CreateVolumesFromSnapshotTest-1827509654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:24:23 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-bc088123-b656-415b-bbb8-faa6a5cef70c tempest-CreateVolumesFromSnapshotTest-1827509654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:24:23 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-bc088123-b656-415b-bbb8-faa6a5cef70c tempest-CreateVolumesFromSnapshotTest-1827509654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:24:23 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-bc088123-b656-415b-bbb8-faa6a5cef70c tempest-CreateVolumesFromSnapshotTest-1827509654 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:24:23 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-bc088123-b656-415b-bbb8-faa6a5cef70c tempest-CreateVolumesFromSnapshotTest-1827509654 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:24:23 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-bc088123-b656-415b-bbb8-faa6a5cef70c tempest-CreateVolumesFromSnapshotTest-1827509654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-50dd51d3-c1ee-4277-8230-ee259890f67c 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:24:23 devstack sudo[98379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-50dd51d3-c1ee-4277-8230-ee259890f67c 1073741824 Jul 22 03:24:23 devstack sudo[98379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:24:24 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-523985ac-2e46-446c-af0e-465c9937b70d tempest-CreateVolumesFromSnapshotTest-1827509654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:24:24 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-523985ac-2e46-446c-af0e-465c9937b70d tempest-CreateVolumesFromSnapshotTest-1827509654 None] Flow 'volume_create_manager' (29b9f0ec-ad80-4436-9034-c2d54627cb2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:24:24 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-523985ac-2e46-446c-af0e-465c9937b70d tempest-CreateVolumesFromSnapshotTest-1827509654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12eedb5e-7f4b-43f2-be05-20571a80bdf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:24:24 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-523985ac-2e46-446c-af0e-465c9937b70d tempest-CreateVolumesFromSnapshotTest-1827509654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12eedb5e-7f4b-43f2-be05-20571a80bdf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:24:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1893722105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c1b52e9-cc17-40d8-ae0b-059c73cce0f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0de5ce3a42af492c9bd3677a6070d6d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:24:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:24:24Z,use_quota=True,user_id='51c089d8598e47fe9415e1a8cce987ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:24:24 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-523985ac-2e46-446c-af0e-465c9937b70d tempest-CreateVolumesFromSnapshotTest-1827509654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dce45795-ffae-42b8-80b8-492f5177c4e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:24:24 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-523985ac-2e46-446c-af0e-465c9937b70d tempest-CreateVolumesFromSnapshotTest-1827509654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dce45795-ffae-42b8-80b8-492f5177c4e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:24:24 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-523985ac-2e46-446c-af0e-465c9937b70d tempest-CreateVolumesFromSnapshotTest-1827509654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cac913a3-e008-4380-80c6-ac5e2bdcbdfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:24:24 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-523985ac-2e46-446c-af0e-465c9937b70d tempest-CreateVolumesFromSnapshotTest-1827509654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cac913a3-e008-4380-80c6-ac5e2bdcbdfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c1b52e9-cc17-40d8-ae0b-059c73cce0f3', 'volume_name': 'volume-5c1b52e9-cc17-40d8-ae0b-059c73cce0f3', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:24:24 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-523985ac-2e46-446c-af0e-465c9937b70d tempest-CreateVolumesFromSnapshotTest-1827509654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7525ff4-9b3e-4832-9a49-4d739729848a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:24:24 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-523985ac-2e46-446c-af0e-465c9937b70d tempest-CreateVolumesFromSnapshotTest-1827509654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7525ff4-9b3e-4832-9a49-4d739729848a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:24:24 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-523985ac-2e46-446c-af0e-465c9937b70d tempest-CreateVolumesFromSnapshotTest-1827509654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bc87df6-b397-46d8-b89b-1c337f5ab412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:24:24 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-523985ac-2e46-446c-af0e-465c9937b70d tempest-CreateVolumesFromSnapshotTest-1827509654 None] Volume 5c1b52e9-cc17-40d8-ae0b-059c73cce0f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c1b52e9-cc17-40d8-ae0b-059c73cce0f3', 'volume_size': 1} Jul 22 03:24:24 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-523985ac-2e46-446c-af0e-465c9937b70d tempest-CreateVolumesFromSnapshotTest-1827509654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:24:24 devstack sudo[98379]: pam_unix(sudo:session): session closed for user root Jul 22 03:24:24 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-bc088123-b656-415b-bbb8-faa6a5cef70c tempest-CreateVolumesFromSnapshotTest-1827509654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-50dd51d3-c1ee-4277-8230-ee259890f67c 1073741824" returned: 0 in 0.856s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:24:24 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-bc088123-b656-415b-bbb8-faa6a5cef70c tempest-CreateVolumesFromSnapshotTest-1827509654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-50dd51d3-c1ee-4277-8230-ee259890f67c {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:24:24 devstack sudo[98385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-50dd51d3-c1ee-4277-8230-ee259890f67c Jul 22 03:24:24 devstack sudo[98385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:24:24 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b3ba580-52e7-47ac-a937-ad203761f69b tempest-CreateVolumesFromSnapshotTest-1827509654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:24:25 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-4b3ba580-52e7-47ac-a937-ad203761f69b tempest-CreateVolumesFromSnapshotTest-1827509654 None] Flow 'volume_create_manager' (d62e0fc4-078e-4d59-81c7-7a6ccb358c03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:24:25 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-4b3ba580-52e7-47ac-a937-ad203761f69b tempest-CreateVolumesFromSnapshotTest-1827509654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18bf21d2-7b80-41e9-9c4c-511bff0a1717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:24:25 devstack sudo[98385]: pam_unix(sudo:session): session closed for user root Jul 22 03:24:25 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-4b3ba580-52e7-47ac-a937-ad203761f69b tempest-CreateVolumesFromSnapshotTest-1827509654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18bf21d2-7b80-41e9-9c4c-511bff0a1717) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:24:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1407621790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad59d1f5-8970-47ae-af7a-591eed617315,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0de5ce3a42af492c9bd3677a6070d6d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:24:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:24:25Z,use_quota=True,user_id='51c089d8598e47fe9415e1a8cce987ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:24:25 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-4b3ba580-52e7-47ac-a937-ad203761f69b tempest-CreateVolumesFromSnapshotTest-1827509654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cf77ed3-fc75-46c9-b698-eddf8b47c44b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:24:25 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-4b3ba580-52e7-47ac-a937-ad203761f69b tempest-CreateVolumesFromSnapshotTest-1827509654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cf77ed3-fc75-46c9-b698-eddf8b47c44b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:24:25 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-4b3ba580-52e7-47ac-a937-ad203761f69b tempest-CreateVolumesFromSnapshotTest-1827509654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (225f788e-aa12-40d9-9e0f-55879a506ed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:24:25 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-4b3ba580-52e7-47ac-a937-ad203761f69b tempest-CreateVolumesFromSnapshotTest-1827509654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (225f788e-aa12-40d9-9e0f-55879a506ed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad59d1f5-8970-47ae-af7a-591eed617315', 'volume_name': 'volume-ad59d1f5-8970-47ae-af7a-591eed617315', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:24:25 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-4b3ba580-52e7-47ac-a937-ad203761f69b tempest-CreateVolumesFromSnapshotTest-1827509654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33f0eb8f-151b-44de-a111-5cc37914b4fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:24:25 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-4b3ba580-52e7-47ac-a937-ad203761f69b tempest-CreateVolumesFromSnapshotTest-1827509654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33f0eb8f-151b-44de-a111-5cc37914b4fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:24:25 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-4b3ba580-52e7-47ac-a937-ad203761f69b tempest-CreateVolumesFromSnapshotTest-1827509654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4346606c-c960-49ad-b4b2-2932b2d7112a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:24:25 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-4b3ba580-52e7-47ac-a937-ad203761f69b tempest-CreateVolumesFromSnapshotTest-1827509654 None] Volume ad59d1f5-8970-47ae-af7a-591eed617315: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad59d1f5-8970-47ae-af7a-591eed617315', 'volume_size': 1} Jul 22 03:24:25 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-4b3ba580-52e7-47ac-a937-ad203761f69b tempest-CreateVolumesFromSnapshotTest-1827509654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:24:25 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-bc088123-b656-415b-bbb8-faa6a5cef70c tempest-CreateVolumesFromSnapshotTest-1827509654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-50dd51d3-c1ee-4277-8230-ee259890f67c" returned: 0 in 0.460s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:24:25 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-bc088123-b656-415b-bbb8-faa6a5cef70c tempest-CreateVolumesFromSnapshotTest-1827509654 None] <== create_volume: return (1373ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:24:25 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-bc088123-b656-415b-bbb8-faa6a5cef70c tempest-CreateVolumesFromSnapshotTest-1827509654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.376s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:24:25 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-523985ac-2e46-446c-af0e-465c9937b70d tempest-CreateVolumesFromSnapshotTest-1827509654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.571s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:24:25 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-523985ac-2e46-446c-af0e-465c9937b70d tempest-CreateVolumesFromSnapshotTest-1827509654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:24:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1893722105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c1b52e9-cc17-40d8-ae0b-059c73cce0f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0de5ce3a42af492c9bd3677a6070d6d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:24:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:24:24Z,use_quota=True,user_id='51c089d8598e47fe9415e1a8cce987ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:24:25 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-523985ac-2e46-446c-af0e-465c9937b70d tempest-CreateVolumesFromSnapshotTest-1827509654 None] Creating volume 5c1b52e9-cc17-40d8-ae0b-059c73cce0f3 {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:24:25 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-523985ac-2e46-446c-af0e-465c9937b70d tempest-CreateVolumesFromSnapshotTest-1827509654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:24:25 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-523985ac-2e46-446c-af0e-465c9937b70d tempest-CreateVolumesFromSnapshotTest-1827509654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:24:25 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-523985ac-2e46-446c-af0e-465c9937b70d tempest-CreateVolumesFromSnapshotTest-1827509654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:24:25 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-523985ac-2e46-446c-af0e-465c9937b70d tempest-CreateVolumesFromSnapshotTest-1827509654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:24:25 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-523985ac-2e46-446c-af0e-465c9937b70d tempest-CreateVolumesFromSnapshotTest-1827509654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:24:25 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-523985ac-2e46-446c-af0e-465c9937b70d tempest-CreateVolumesFromSnapshotTest-1827509654 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:24:25 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-523985ac-2e46-446c-af0e-465c9937b70d tempest-CreateVolumesFromSnapshotTest-1827509654 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:24:25 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-523985ac-2e46-446c-af0e-465c9937b70d tempest-CreateVolumesFromSnapshotTest-1827509654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-5c1b52e9-cc17-40d8-ae0b-059c73cce0f3 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:24:25 devstack sudo[98388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-5c1b52e9-cc17-40d8-ae0b-059c73cce0f3 1073741824 Jul 22 03:24:25 devstack sudo[98388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:24:25 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-bc088123-b656-415b-bbb8-faa6a5cef70c tempest-CreateVolumesFromSnapshotTest-1827509654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (015c2442-ecce-487a-be92-85259c822a2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50dd51d3-c1ee-4277-8230-ee259890f67c', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:24:25 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-bc088123-b656-415b-bbb8-faa6a5cef70c tempest-CreateVolumesFromSnapshotTest-1827509654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1303abe-c3bf-4121-8a3c-958eeabae9e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:24:25 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-bc088123-b656-415b-bbb8-faa6a5cef70c tempest-CreateVolumesFromSnapshotTest-1827509654 None] Volume volume-50dd51d3-c1ee-4277-8230-ee259890f67c (50dd51d3-c1ee-4277-8230-ee259890f67c): created successfully Jul 22 03:24:25 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-bc088123-b656-415b-bbb8-faa6a5cef70c tempest-CreateVolumesFromSnapshotTest-1827509654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1303abe-c3bf-4121-8a3c-958eeabae9e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:24:25 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-bc088123-b656-415b-bbb8-faa6a5cef70c tempest-CreateVolumesFromSnapshotTest-1827509654 None] Flow 'volume_create_manager' (3fb821d7-284a-4bcd-b1cf-d584311e5ad5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:24:25 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-bc088123-b656-415b-bbb8-faa6a5cef70c tempest-CreateVolumesFromSnapshotTest-1827509654 None] Created volume successfully. Jul 22 03:24:25 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-51ef9cba-575d-40e4-b716-cb2ae7dc408e tempest-CreateVolumesFromSnapshotTest-1827509654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:24:25 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-51ef9cba-575d-40e4-b716-cb2ae7dc408e tempest-CreateVolumesFromSnapshotTest-1827509654 None] Flow 'volume_create_manager' (dd120b43-284f-4e4e-8933-aae1befdc61f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:24:25 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-51ef9cba-575d-40e4-b716-cb2ae7dc408e tempest-CreateVolumesFromSnapshotTest-1827509654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (017066e9-c618-4f67-a80f-d3b06ff57f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:24:25 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-51ef9cba-575d-40e4-b716-cb2ae7dc408e tempest-CreateVolumesFromSnapshotTest-1827509654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (017066e9-c618-4f67-a80f-d3b06ff57f65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:24:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-637120449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47e948af-35b3-4c21-a5da-933d41448ef3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0de5ce3a42af492c9bd3677a6070d6d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:24:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:24:25Z,use_quota=True,user_id='51c089d8598e47fe9415e1a8cce987ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:24:25 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-51ef9cba-575d-40e4-b716-cb2ae7dc408e tempest-CreateVolumesFromSnapshotTest-1827509654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddd7b08d-68eb-4efd-99a7-3edd7a4fd9b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:24:25 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-51ef9cba-575d-40e4-b716-cb2ae7dc408e tempest-CreateVolumesFromSnapshotTest-1827509654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddd7b08d-68eb-4efd-99a7-3edd7a4fd9b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:24:25 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-51ef9cba-575d-40e4-b716-cb2ae7dc408e tempest-CreateVolumesFromSnapshotTest-1827509654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8731bd2b-e2c8-40bd-8fa9-0a0a236c19d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:24:25 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-51ef9cba-575d-40e4-b716-cb2ae7dc408e tempest-CreateVolumesFromSnapshotTest-1827509654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8731bd2b-e2c8-40bd-8fa9-0a0a236c19d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47e948af-35b3-4c21-a5da-933d41448ef3', 'volume_name': 'volume-47e948af-35b3-4c21-a5da-933d41448ef3', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:24:25 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-51ef9cba-575d-40e4-b716-cb2ae7dc408e tempest-CreateVolumesFromSnapshotTest-1827509654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af9ec0eb-ff6e-4d05-9d09-21bd025fd5d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:24:25 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-51ef9cba-575d-40e4-b716-cb2ae7dc408e tempest-CreateVolumesFromSnapshotTest-1827509654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af9ec0eb-ff6e-4d05-9d09-21bd025fd5d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:24:25 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-51ef9cba-575d-40e4-b716-cb2ae7dc408e tempest-CreateVolumesFromSnapshotTest-1827509654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbc9eb14-3565-463c-b8c7-abc583765518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:24:25 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-51ef9cba-575d-40e4-b716-cb2ae7dc408e tempest-CreateVolumesFromSnapshotTest-1827509654 None] Volume 47e948af-35b3-4c21-a5da-933d41448ef3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47e948af-35b3-4c21-a5da-933d41448ef3', 'volume_size': 1} Jul 22 03:24:25 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-51ef9cba-575d-40e4-b716-cb2ae7dc408e tempest-CreateVolumesFromSnapshotTest-1827509654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:24:25 devstack sudo[98388]: pam_unix(sudo:session): session closed for user root Jul 22 03:24:25 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-523985ac-2e46-446c-af0e-465c9937b70d tempest-CreateVolumesFromSnapshotTest-1827509654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-5c1b52e9-cc17-40d8-ae0b-059c73cce0f3 1073741824" returned: 0 in 0.672s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:24:25 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-523985ac-2e46-446c-af0e-465c9937b70d tempest-CreateVolumesFromSnapshotTest-1827509654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-5c1b52e9-cc17-40d8-ae0b-059c73cce0f3 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:24:25 devstack sudo[98395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-5c1b52e9-cc17-40d8-ae0b-059c73cce0f3 Jul 22 03:24:25 devstack sudo[98395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:24:26 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-e661a4af-58e6-4af6-8c1a-6a7067b3603f tempest-CreateVolumesFromSnapshotTest-1827509654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:24:26 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-e661a4af-58e6-4af6-8c1a-6a7067b3603f tempest-CreateVolumesFromSnapshotTest-1827509654 None] Flow 'volume_create_manager' (48b84623-e1c8-41db-bd82-0dac0563369f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:24:26 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-e661a4af-58e6-4af6-8c1a-6a7067b3603f tempest-CreateVolumesFromSnapshotTest-1827509654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43d25acf-db44-46c2-b99b-29ea925355ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:24:26 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-e661a4af-58e6-4af6-8c1a-6a7067b3603f tempest-CreateVolumesFromSnapshotTest-1827509654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43d25acf-db44-46c2-b99b-29ea925355ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:24:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-699848824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28283323-446a-40fc-9060-e2ac97976d01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0de5ce3a42af492c9bd3677a6070d6d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:24:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:24:26Z,use_quota=True,user_id='51c089d8598e47fe9415e1a8cce987ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:24:26 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-e661a4af-58e6-4af6-8c1a-6a7067b3603f tempest-CreateVolumesFromSnapshotTest-1827509654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0459ba86-2be5-493f-89f8-1ef5c0b82501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:24:26 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-e661a4af-58e6-4af6-8c1a-6a7067b3603f tempest-CreateVolumesFromSnapshotTest-1827509654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0459ba86-2be5-493f-89f8-1ef5c0b82501) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:24:26 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-e661a4af-58e6-4af6-8c1a-6a7067b3603f tempest-CreateVolumesFromSnapshotTest-1827509654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9c1b444-4399-498b-90f7-1fbbb9f5bc2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:24:26 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-e661a4af-58e6-4af6-8c1a-6a7067b3603f tempest-CreateVolumesFromSnapshotTest-1827509654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9c1b444-4399-498b-90f7-1fbbb9f5bc2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28283323-446a-40fc-9060-e2ac97976d01', 'volume_name': 'volume-28283323-446a-40fc-9060-e2ac97976d01', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:24:26 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-e661a4af-58e6-4af6-8c1a-6a7067b3603f tempest-CreateVolumesFromSnapshotTest-1827509654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3cb7747-6f38-4893-9779-c1cee5486915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:24:26 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-e661a4af-58e6-4af6-8c1a-6a7067b3603f tempest-CreateVolumesFromSnapshotTest-1827509654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3cb7747-6f38-4893-9779-c1cee5486915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:24:26 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-e661a4af-58e6-4af6-8c1a-6a7067b3603f tempest-CreateVolumesFromSnapshotTest-1827509654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5053de8b-5e3b-4b2d-b8c8-f0dd461b325b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:24:26 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-e661a4af-58e6-4af6-8c1a-6a7067b3603f tempest-CreateVolumesFromSnapshotTest-1827509654 None] Volume 28283323-446a-40fc-9060-e2ac97976d01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28283323-446a-40fc-9060-e2ac97976d01', 'volume_size': 1} Jul 22 03:24:26 devstack sudo[98395]: pam_unix(sudo:session): session closed for user root Jul 22 03:24:26 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-e661a4af-58e6-4af6-8c1a-6a7067b3603f tempest-CreateVolumesFromSnapshotTest-1827509654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:24:26 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-523985ac-2e46-446c-af0e-465c9937b70d tempest-CreateVolumesFromSnapshotTest-1827509654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-5c1b52e9-cc17-40d8-ae0b-059c73cce0f3" returned: 0 in 0.339s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:24:26 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-523985ac-2e46-446c-af0e-465c9937b70d tempest-CreateVolumesFromSnapshotTest-1827509654 None] <== create_volume: return (1079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:24:26 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-523985ac-2e46-446c-af0e-465c9937b70d tempest-CreateVolumesFromSnapshotTest-1827509654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.083s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:24:26 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-4b3ba580-52e7-47ac-a937-ad203761f69b tempest-CreateVolumesFromSnapshotTest-1827509654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.102s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:24:26 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-4b3ba580-52e7-47ac-a937-ad203761f69b tempest-CreateVolumesFromSnapshotTest-1827509654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:24:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1407621790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad59d1f5-8970-47ae-af7a-591eed617315,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0de5ce3a42af492c9bd3677a6070d6d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:24:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:24:25Z,use_quota=True,user_id='51c089d8598e47fe9415e1a8cce987ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:24:26 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-4b3ba580-52e7-47ac-a937-ad203761f69b tempest-CreateVolumesFromSnapshotTest-1827509654 None] Creating volume ad59d1f5-8970-47ae-af7a-591eed617315 {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:24:26 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-4b3ba580-52e7-47ac-a937-ad203761f69b tempest-CreateVolumesFromSnapshotTest-1827509654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:24:26 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-4b3ba580-52e7-47ac-a937-ad203761f69b tempest-CreateVolumesFromSnapshotTest-1827509654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:24:26 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-4b3ba580-52e7-47ac-a937-ad203761f69b tempest-CreateVolumesFromSnapshotTest-1827509654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:24:26 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-4b3ba580-52e7-47ac-a937-ad203761f69b tempest-CreateVolumesFromSnapshotTest-1827509654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:24:26 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-4b3ba580-52e7-47ac-a937-ad203761f69b tempest-CreateVolumesFromSnapshotTest-1827509654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:24:26 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-4b3ba580-52e7-47ac-a937-ad203761f69b tempest-CreateVolumesFromSnapshotTest-1827509654 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:24:26 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-4b3ba580-52e7-47ac-a937-ad203761f69b tempest-CreateVolumesFromSnapshotTest-1827509654 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:24:26 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-4b3ba580-52e7-47ac-a937-ad203761f69b tempest-CreateVolumesFromSnapshotTest-1827509654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ad59d1f5-8970-47ae-af7a-591eed617315 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:24:26 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-523985ac-2e46-446c-af0e-465c9937b70d tempest-CreateVolumesFromSnapshotTest-1827509654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bc87df6-b397-46d8-b89b-1c337f5ab412) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c1b52e9-cc17-40d8-ae0b-059c73cce0f3', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:24:26 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-523985ac-2e46-446c-af0e-465c9937b70d tempest-CreateVolumesFromSnapshotTest-1827509654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33253008-5451-46e5-855d-0e8afb9fb84b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:24:26 devstack sudo[98398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ad59d1f5-8970-47ae-af7a-591eed617315 1073741824 Jul 22 03:24:26 devstack sudo[98398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:24:26 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-523985ac-2e46-446c-af0e-465c9937b70d tempest-CreateVolumesFromSnapshotTest-1827509654 None] Volume volume-5c1b52e9-cc17-40d8-ae0b-059c73cce0f3 (5c1b52e9-cc17-40d8-ae0b-059c73cce0f3): created successfully Jul 22 03:24:26 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-523985ac-2e46-446c-af0e-465c9937b70d tempest-CreateVolumesFromSnapshotTest-1827509654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33253008-5451-46e5-855d-0e8afb9fb84b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:24:26 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-523985ac-2e46-446c-af0e-465c9937b70d tempest-CreateVolumesFromSnapshotTest-1827509654 None] Flow 'volume_create_manager' (29b9f0ec-ad80-4436-9034-c2d54627cb2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:24:26 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-523985ac-2e46-446c-af0e-465c9937b70d tempest-CreateVolumesFromSnapshotTest-1827509654 None] Created volume successfully. Jul 22 03:24:26 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-241c669d-2289-4e68-836f-31360dfd7cc8 tempest-AttachVolumeNegativeTest-443471683 None] Acquiring lock "cinder-461c81bc-2379-4e12-b7a9-87409c537bea-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:24:26 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-241c669d-2289-4e68-836f-31360dfd7cc8 tempest-AttachVolumeNegativeTest-443471683 None] Lock "cinder-461c81bc-2379-4e12-b7a9-87409c537bea-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:24:26 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-241c669d-2289-4e68-836f-31360dfd7cc8 tempest-AttachVolumeNegativeTest-443471683 None] Acquiring lock "cinder-quobyte-461c81bc-2379-4e12-b7a9-87409c537bea" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:24:26 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-241c669d-2289-4e68-836f-31360dfd7cc8 tempest-AttachVolumeNegativeTest-443471683 None] Lock "cinder-quobyte-461c81bc-2379-4e12-b7a9-87409c537bea" acquired by "delete_volume" :: waited 0.022s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:24:26 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[229be39b-7920-4fd6-b499-9343005a1815]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:24:26 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-241c669d-2289-4e68-836f-31360dfd7cc8 tempest-AttachVolumeNegativeTest-443471683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-461c81bc-2379-4e12-b7a9-87409c537bea {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:24:26 devstack sudo[98400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-461c81bc-2379-4e12-b7a9-87409c537bea Jul 22 03:24:26 devstack sudo[98400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:24:26 devstack sudo[98398]: pam_unix(sudo:session): session closed for user root Jul 22 03:24:26 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-4b3ba580-52e7-47ac-a937-ad203761f69b tempest-CreateVolumesFromSnapshotTest-1827509654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ad59d1f5-8970-47ae-af7a-591eed617315 1073741824" returned: 0 in 0.532s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:24:26 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-4b3ba580-52e7-47ac-a937-ad203761f69b tempest-CreateVolumesFromSnapshotTest-1827509654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ad59d1f5-8970-47ae-af7a-591eed617315 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:24:26 devstack sudo[98405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ad59d1f5-8970-47ae-af7a-591eed617315 Jul 22 03:24:26 devstack sudo[98405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:24:26 devstack sudo[98400]: pam_unix(sudo:session): session closed for user root Jul 22 03:24:26 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-241c669d-2289-4e68-836f-31360dfd7cc8 tempest-AttachVolumeNegativeTest-443471683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-461c81bc-2379-4e12-b7a9-87409c537bea" returned: 0 in 0.412s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:24:26 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-241c669d-2289-4e68-836f-31360dfd7cc8 tempest-AttachVolumeNegativeTest-443471683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-461c81bc-2379-4e12-b7a9-87409c537bea {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:24:26 devstack sudo[98410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-461c81bc-2379-4e12-b7a9-87409c537bea Jul 22 03:24:26 devstack sudo[98410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:24:27 devstack sudo[98405]: pam_unix(sudo:session): session closed for user root Jul 22 03:24:27 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-4b3ba580-52e7-47ac-a937-ad203761f69b tempest-CreateVolumesFromSnapshotTest-1827509654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ad59d1f5-8970-47ae-af7a-591eed617315" returned: 0 in 0.303s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:24:27 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-4b3ba580-52e7-47ac-a937-ad203761f69b tempest-CreateVolumesFromSnapshotTest-1827509654 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:24:27 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-4b3ba580-52e7-47ac-a937-ad203761f69b tempest-CreateVolumesFromSnapshotTest-1827509654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:24:27 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-51ef9cba-575d-40e4-b716-cb2ae7dc408e tempest-CreateVolumesFromSnapshotTest-1827509654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.572s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:24:27 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-51ef9cba-575d-40e4-b716-cb2ae7dc408e tempest-CreateVolumesFromSnapshotTest-1827509654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:24:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-637120449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47e948af-35b3-4c21-a5da-933d41448ef3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0de5ce3a42af492c9bd3677a6070d6d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:24:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:24:25Z,use_quota=True,user_id='51c089d8598e47fe9415e1a8cce987ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:24:27 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-51ef9cba-575d-40e4-b716-cb2ae7dc408e tempest-CreateVolumesFromSnapshotTest-1827509654 None] Creating volume 47e948af-35b3-4c21-a5da-933d41448ef3 {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:24:27 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-51ef9cba-575d-40e4-b716-cb2ae7dc408e tempest-CreateVolumesFromSnapshotTest-1827509654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:24:27 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-51ef9cba-575d-40e4-b716-cb2ae7dc408e tempest-CreateVolumesFromSnapshotTest-1827509654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:24:27 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-51ef9cba-575d-40e4-b716-cb2ae7dc408e tempest-CreateVolumesFromSnapshotTest-1827509654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:24:27 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-51ef9cba-575d-40e4-b716-cb2ae7dc408e tempest-CreateVolumesFromSnapshotTest-1827509654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:24:27 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-51ef9cba-575d-40e4-b716-cb2ae7dc408e tempest-CreateVolumesFromSnapshotTest-1827509654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:24:27 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-51ef9cba-575d-40e4-b716-cb2ae7dc408e tempest-CreateVolumesFromSnapshotTest-1827509654 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:24:27 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-51ef9cba-575d-40e4-b716-cb2ae7dc408e tempest-CreateVolumesFromSnapshotTest-1827509654 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:24:27 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-51ef9cba-575d-40e4-b716-cb2ae7dc408e tempest-CreateVolumesFromSnapshotTest-1827509654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-47e948af-35b3-4c21-a5da-933d41448ef3 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:24:27 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-4b3ba580-52e7-47ac-a937-ad203761f69b tempest-CreateVolumesFromSnapshotTest-1827509654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4346606c-c960-49ad-b4b2-2932b2d7112a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad59d1f5-8970-47ae-af7a-591eed617315', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:24:27 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-4b3ba580-52e7-47ac-a937-ad203761f69b tempest-CreateVolumesFromSnapshotTest-1827509654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ac94920-3ae5-4181-92f0-589a805f675d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:24:27 devstack sudo[98414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-47e948af-35b3-4c21-a5da-933d41448ef3 1073741824 Jul 22 03:24:27 devstack sudo[98414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:24:27 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-4b3ba580-52e7-47ac-a937-ad203761f69b tempest-CreateVolumesFromSnapshotTest-1827509654 None] Volume volume-ad59d1f5-8970-47ae-af7a-591eed617315 (ad59d1f5-8970-47ae-af7a-591eed617315): created successfully Jul 22 03:24:27 devstack sudo[98410]: pam_unix(sudo:session): session closed for user root Jul 22 03:24:27 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-4b3ba580-52e7-47ac-a937-ad203761f69b tempest-CreateVolumesFromSnapshotTest-1827509654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ac94920-3ae5-4181-92f0-589a805f675d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:24:27 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-4b3ba580-52e7-47ac-a937-ad203761f69b tempest-CreateVolumesFromSnapshotTest-1827509654 None] Flow 'volume_create_manager' (d62e0fc4-078e-4d59-81c7-7a6ccb358c03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:24:27 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-241c669d-2289-4e68-836f-31360dfd7cc8 tempest-AttachVolumeNegativeTest-443471683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-461c81bc-2379-4e12-b7a9-87409c537bea" returned: 0 in 0.280s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:24:27 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-241c669d-2289-4e68-836f-31360dfd7cc8 tempest-AttachVolumeNegativeTest-443471683 None] Lock "cinder-quobyte-461c81bc-2379-4e12-b7a9-87409c537bea" released by "delete_volume" :: held 0.737s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:24:27 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-4b3ba580-52e7-47ac-a937-ad203761f69b tempest-CreateVolumesFromSnapshotTest-1827509654 None] Created volume successfully. Jul 22 03:24:27 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-241c669d-2289-4e68-836f-31360dfd7cc8 tempest-AttachVolumeNegativeTest-443471683 None] Created reservations ['b3fb29e1-f4ef-4475-b37c-65ca6ad24ea0', '01d6eab3-cd5a-4cc2-9ff1-1e00ee3375bc', '51106c47-16fe-42ea-8f2f-2a37a10d6a6b', '4ff98e73-2973-4f7a-a8f4-cd0ef93be988'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:24:27 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-241c669d-2289-4e68-836f-31360dfd7cc8 tempest-AttachVolumeNegativeTest-443471683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:24:27 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-241c669d-2289-4e68-836f-31360dfd7cc8 tempest-AttachVolumeNegativeTest-443471683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:24:27 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-241c669d-2289-4e68-836f-31360dfd7cc8 tempest-AttachVolumeNegativeTest-443471683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:24:27 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-241c669d-2289-4e68-836f-31360dfd7cc8 tempest-AttachVolumeNegativeTest-443471683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:24:27 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-241c669d-2289-4e68-836f-31360dfd7cc8 tempest-AttachVolumeNegativeTest-443471683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:24:27 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-241c669d-2289-4e68-836f-31360dfd7cc8 tempest-AttachVolumeNegativeTest-443471683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:24:27 devstack sudo[98419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:24:27 devstack sudo[98419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:24:27 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-87561de4-beee-411b-835d-a24eee30af76 tempest-AttachVolumeNegativeTest-443471683 None] Acquiring lock "cinder-1585bdc0-262f-4518-95c8-1be386dc16d0-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:24:27 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-87561de4-beee-411b-835d-a24eee30af76 tempest-AttachVolumeNegativeTest-443471683 None] Lock "cinder-1585bdc0-262f-4518-95c8-1be386dc16d0-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:24:27 devstack sudo[98414]: pam_unix(sudo:session): session closed for user root Jul 22 03:24:27 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-51ef9cba-575d-40e4-b716-cb2ae7dc408e tempest-CreateVolumesFromSnapshotTest-1827509654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-47e948af-35b3-4c21-a5da-933d41448ef3 1073741824" returned: 0 in 0.641s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:24:27 devstack sudo[98419]: pam_unix(sudo:session): session closed for user root Jul 22 03:24:27 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-241c669d-2289-4e68-836f-31360dfd7cc8 tempest-AttachVolumeNegativeTest-443471683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.375s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:24:27 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-241c669d-2289-4e68-836f-31360dfd7cc8 tempest-AttachVolumeNegativeTest-443471683 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:24:27 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-241c669d-2289-4e68-836f-31360dfd7cc8 tempest-AttachVolumeNegativeTest-443471683 None] Deleted volume successfully. Jul 22 03:24:27 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-87561de4-beee-411b-835d-a24eee30af76 tempest-AttachVolumeNegativeTest-443471683 None] Acquiring lock "cinder-quobyte-1585bdc0-262f-4518-95c8-1be386dc16d0" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:24:27 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-51ef9cba-575d-40e4-b716-cb2ae7dc408e tempest-CreateVolumesFromSnapshotTest-1827509654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-47e948af-35b3-4c21-a5da-933d41448ef3 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:24:27 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-87561de4-beee-411b-835d-a24eee30af76 tempest-AttachVolumeNegativeTest-443471683 None] Lock "cinder-quobyte-1585bdc0-262f-4518-95c8-1be386dc16d0" acquired by "delete_volume" :: waited 0.034s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:24:27 devstack sudo[98424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-47e948af-35b3-4c21-a5da-933d41448ef3 Jul 22 03:24:27 devstack sudo[98424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:24:27 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-241c669d-2289-4e68-836f-31360dfd7cc8 tempest-AttachVolumeNegativeTest-443471683 None] Lock "cinder-461c81bc-2379-4e12-b7a9-87409c537bea-delete_volume" released by "delete_volume" :: held 1.468s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:24:27 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[49a1cc67-f24d-4cba-9653-526756d7f699]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:24:27 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-87561de4-beee-411b-835d-a24eee30af76 tempest-AttachVolumeNegativeTest-443471683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1585bdc0-262f-4518-95c8-1be386dc16d0 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:24:28 devstack sudo[98426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1585bdc0-262f-4518-95c8-1be386dc16d0 Jul 22 03:24:28 devstack sudo[98426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:24:28 devstack sudo[98424]: pam_unix(sudo:session): session closed for user root Jul 22 03:24:28 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-51ef9cba-575d-40e4-b716-cb2ae7dc408e tempest-CreateVolumesFromSnapshotTest-1827509654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-47e948af-35b3-4c21-a5da-933d41448ef3" returned: 0 in 0.262s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:24:28 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-51ef9cba-575d-40e4-b716-cb2ae7dc408e tempest-CreateVolumesFromSnapshotTest-1827509654 None] <== create_volume: return (982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:24:28 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-51ef9cba-575d-40e4-b716-cb2ae7dc408e tempest-CreateVolumesFromSnapshotTest-1827509654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.987s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:24:28 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-e661a4af-58e6-4af6-8c1a-6a7067b3603f tempest-CreateVolumesFromSnapshotTest-1827509654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.915s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:24:28 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-e661a4af-58e6-4af6-8c1a-6a7067b3603f tempest-CreateVolumesFromSnapshotTest-1827509654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:24:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-699848824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28283323-446a-40fc-9060-e2ac97976d01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0de5ce3a42af492c9bd3677a6070d6d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:24:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:24:26Z,use_quota=True,user_id='51c089d8598e47fe9415e1a8cce987ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:24:28 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-e661a4af-58e6-4af6-8c1a-6a7067b3603f tempest-CreateVolumesFromSnapshotTest-1827509654 None] Creating volume 28283323-446a-40fc-9060-e2ac97976d01 {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:24:28 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-e661a4af-58e6-4af6-8c1a-6a7067b3603f tempest-CreateVolumesFromSnapshotTest-1827509654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:24:28 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-e661a4af-58e6-4af6-8c1a-6a7067b3603f tempest-CreateVolumesFromSnapshotTest-1827509654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:24:28 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-e661a4af-58e6-4af6-8c1a-6a7067b3603f tempest-CreateVolumesFromSnapshotTest-1827509654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:24:28 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-e661a4af-58e6-4af6-8c1a-6a7067b3603f tempest-CreateVolumesFromSnapshotTest-1827509654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:24:28 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-e661a4af-58e6-4af6-8c1a-6a7067b3603f tempest-CreateVolumesFromSnapshotTest-1827509654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:24:28 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-e661a4af-58e6-4af6-8c1a-6a7067b3603f tempest-CreateVolumesFromSnapshotTest-1827509654 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:24:28 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-e661a4af-58e6-4af6-8c1a-6a7067b3603f tempest-CreateVolumesFromSnapshotTest-1827509654 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:24:28 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-e661a4af-58e6-4af6-8c1a-6a7067b3603f tempest-CreateVolumesFromSnapshotTest-1827509654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-28283323-446a-40fc-9060-e2ac97976d01 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:24:28 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-51ef9cba-575d-40e4-b716-cb2ae7dc408e tempest-CreateVolumesFromSnapshotTest-1827509654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbc9eb14-3565-463c-b8c7-abc583765518) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47e948af-35b3-4c21-a5da-933d41448ef3', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:24:28 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-51ef9cba-575d-40e4-b716-cb2ae7dc408e tempest-CreateVolumesFromSnapshotTest-1827509654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e63ab9bb-ff07-4b9c-be84-c4bc657c4cb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:24:28 devstack sudo[98429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-28283323-446a-40fc-9060-e2ac97976d01 1073741824 Jul 22 03:24:28 devstack sudo[98429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:24:28 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-51ef9cba-575d-40e4-b716-cb2ae7dc408e tempest-CreateVolumesFromSnapshotTest-1827509654 None] Volume volume-47e948af-35b3-4c21-a5da-933d41448ef3 (47e948af-35b3-4c21-a5da-933d41448ef3): created successfully Jul 22 03:24:28 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-51ef9cba-575d-40e4-b716-cb2ae7dc408e tempest-CreateVolumesFromSnapshotTest-1827509654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e63ab9bb-ff07-4b9c-be84-c4bc657c4cb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:24:28 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-51ef9cba-575d-40e4-b716-cb2ae7dc408e tempest-CreateVolumesFromSnapshotTest-1827509654 None] Flow 'volume_create_manager' (dd120b43-284f-4e4e-8933-aae1befdc61f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:24:28 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-51ef9cba-575d-40e4-b716-cb2ae7dc408e tempest-CreateVolumesFromSnapshotTest-1827509654 None] Created volume successfully. Jul 22 03:24:28 devstack sudo[98426]: pam_unix(sudo:session): session closed for user root Jul 22 03:24:28 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-87561de4-beee-411b-835d-a24eee30af76 tempest-AttachVolumeNegativeTest-443471683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1585bdc0-262f-4518-95c8-1be386dc16d0" returned: 0 in 0.440s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:24:28 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-87561de4-beee-411b-835d-a24eee30af76 tempest-AttachVolumeNegativeTest-443471683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1585bdc0-262f-4518-95c8-1be386dc16d0 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:24:28 devstack sudo[98434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1585bdc0-262f-4518-95c8-1be386dc16d0 Jul 22 03:24:28 devstack sudo[98434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:24:28 devstack sudo[98434]: pam_unix(sudo:session): session closed for user root Jul 22 03:24:28 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-87561de4-beee-411b-835d-a24eee30af76 tempest-AttachVolumeNegativeTest-443471683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1585bdc0-262f-4518-95c8-1be386dc16d0" returned: 0 in 0.267s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:24:28 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-87561de4-beee-411b-835d-a24eee30af76 tempest-AttachVolumeNegativeTest-443471683 None] Lock "cinder-quobyte-1585bdc0-262f-4518-95c8-1be386dc16d0" released by "delete_volume" :: held 0.779s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:24:28 devstack sudo[98429]: pam_unix(sudo:session): session closed for user root Jul 22 03:24:28 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-e661a4af-58e6-4af6-8c1a-6a7067b3603f tempest-CreateVolumesFromSnapshotTest-1827509654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-28283323-446a-40fc-9060-e2ac97976d01 1073741824" returned: 0 in 0.529s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:24:28 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-e661a4af-58e6-4af6-8c1a-6a7067b3603f tempest-CreateVolumesFromSnapshotTest-1827509654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-28283323-446a-40fc-9060-e2ac97976d01 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:24:28 devstack sudo[98441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-28283323-446a-40fc-9060-e2ac97976d01 Jul 22 03:24:28 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-87561de4-beee-411b-835d-a24eee30af76 tempest-AttachVolumeNegativeTest-443471683 None] Created reservations ['7191d94b-ac6c-407f-bd8e-a8d7a977fbb1', 'a91b0557-04df-499b-9c25-8f6dc2664397', 'c2489b29-806d-400b-8523-2f78a033f51d', '6be355a8-e7de-45d6-a68b-c097a886730b'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:24:28 devstack sudo[98441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:24:28 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-87561de4-beee-411b-835d-a24eee30af76 tempest-AttachVolumeNegativeTest-443471683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:24:28 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-87561de4-beee-411b-835d-a24eee30af76 tempest-AttachVolumeNegativeTest-443471683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:24:28 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-87561de4-beee-411b-835d-a24eee30af76 tempest-AttachVolumeNegativeTest-443471683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:24:28 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-87561de4-beee-411b-835d-a24eee30af76 tempest-AttachVolumeNegativeTest-443471683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:24:28 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-87561de4-beee-411b-835d-a24eee30af76 tempest-AttachVolumeNegativeTest-443471683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:24:28 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-87561de4-beee-411b-835d-a24eee30af76 tempest-AttachVolumeNegativeTest-443471683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:24:28 devstack sudo[98443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:24:28 devstack sudo[98443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:24:29 devstack sudo[98441]: pam_unix(sudo:session): session closed for user root Jul 22 03:24:29 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-e661a4af-58e6-4af6-8c1a-6a7067b3603f tempest-CreateVolumesFromSnapshotTest-1827509654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-28283323-446a-40fc-9060-e2ac97976d01" returned: 0 in 0.280s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:24:29 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-e661a4af-58e6-4af6-8c1a-6a7067b3603f tempest-CreateVolumesFromSnapshotTest-1827509654 None] <== create_volume: return (862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:24:29 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-e661a4af-58e6-4af6-8c1a-6a7067b3603f tempest-CreateVolumesFromSnapshotTest-1827509654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.866s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:24:29 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-e661a4af-58e6-4af6-8c1a-6a7067b3603f tempest-CreateVolumesFromSnapshotTest-1827509654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5053de8b-5e3b-4b2d-b8c8-f0dd461b325b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28283323-446a-40fc-9060-e2ac97976d01', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:24:29 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-e661a4af-58e6-4af6-8c1a-6a7067b3603f tempest-CreateVolumesFromSnapshotTest-1827509654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (062cffeb-4c33-4152-b725-e2e1651d1e1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:24:29 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-e661a4af-58e6-4af6-8c1a-6a7067b3603f tempest-CreateVolumesFromSnapshotTest-1827509654 None] Volume volume-28283323-446a-40fc-9060-e2ac97976d01 (28283323-446a-40fc-9060-e2ac97976d01): created successfully Jul 22 03:24:29 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-e661a4af-58e6-4af6-8c1a-6a7067b3603f tempest-CreateVolumesFromSnapshotTest-1827509654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (062cffeb-4c33-4152-b725-e2e1651d1e1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:24:29 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-e661a4af-58e6-4af6-8c1a-6a7067b3603f tempest-CreateVolumesFromSnapshotTest-1827509654 None] Flow 'volume_create_manager' (48b84623-e1c8-41db-bd82-0dac0563369f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:24:29 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-e661a4af-58e6-4af6-8c1a-6a7067b3603f tempest-CreateVolumesFromSnapshotTest-1827509654 None] Created volume successfully. Jul 22 03:24:29 devstack sudo[98443]: pam_unix(sudo:session): session closed for user root Jul 22 03:24:29 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-87561de4-beee-411b-835d-a24eee30af76 tempest-AttachVolumeNegativeTest-443471683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.365s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:24:29 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-87561de4-beee-411b-835d-a24eee30af76 tempest-AttachVolumeNegativeTest-443471683 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:24:29 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-87561de4-beee-411b-835d-a24eee30af76 tempest-AttachVolumeNegativeTest-443471683 None] Deleted volume successfully. Jul 22 03:24:29 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-87561de4-beee-411b-835d-a24eee30af76 tempest-AttachVolumeNegativeTest-443471683 None] Lock "cinder-1585bdc0-262f-4518-95c8-1be386dc16d0-delete_volume" released by "delete_volume" :: held 1.447s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:24:29 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-4f360f4e-58ce-400f-b738-8592576cbc1b tempest-AttachVolumeNegativeTest-443471683 None] Acquiring lock "cinder-731543a0-29f4-4de9-9c28-aa80043cc188-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:24:29 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-4f360f4e-58ce-400f-b738-8592576cbc1b tempest-AttachVolumeNegativeTest-443471683 None] Lock "cinder-731543a0-29f4-4de9-9c28-aa80043cc188-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:24:29 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-4f360f4e-58ce-400f-b738-8592576cbc1b tempest-AttachVolumeNegativeTest-443471683 None] Acquiring lock "cinder-quobyte-731543a0-29f4-4de9-9c28-aa80043cc188" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:24:29 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-4f360f4e-58ce-400f-b738-8592576cbc1b tempest-AttachVolumeNegativeTest-443471683 None] Lock "cinder-quobyte-731543a0-29f4-4de9-9c28-aa80043cc188" acquired by "delete_volume" :: waited 0.017s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:24:29 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[11c9500f-8be7-4cf4-a09e-bae08616e401]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:24:29 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-4f360f4e-58ce-400f-b738-8592576cbc1b tempest-AttachVolumeNegativeTest-443471683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-731543a0-29f4-4de9-9c28-aa80043cc188 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:24:29 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-e6c154e9-b7df-45bd-acb8-a22986bb1aac tempest-CreateVolumesFromSnapshotTest-1827509654 None] Acquiring lock "cinder-28283323-446a-40fc-9060-e2ac97976d01-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:24:29 devstack sudo[98447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-731543a0-29f4-4de9-9c28-aa80043cc188 Jul 22 03:24:29 devstack sudo[98447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:24:29 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-e6c154e9-b7df-45bd-acb8-a22986bb1aac tempest-CreateVolumesFromSnapshotTest-1827509654 None] Lock "cinder-28283323-446a-40fc-9060-e2ac97976d01-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:24:29 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-e6c154e9-b7df-45bd-acb8-a22986bb1aac tempest-CreateVolumesFromSnapshotTest-1827509654 None] Acquiring lock "cinder-quobyte-28283323-446a-40fc-9060-e2ac97976d01" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:24:29 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-e6c154e9-b7df-45bd-acb8-a22986bb1aac tempest-CreateVolumesFromSnapshotTest-1827509654 None] Lock "cinder-quobyte-28283323-446a-40fc-9060-e2ac97976d01" acquired by "delete_volume" :: waited 0.022s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:24:29 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cfcb0a6-79ea-480c-837e-c3a4806c1c45]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:24:29 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-e6c154e9-b7df-45bd-acb8-a22986bb1aac tempest-CreateVolumesFromSnapshotTest-1827509654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-28283323-446a-40fc-9060-e2ac97976d01 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:24:29 devstack sudo[98449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-28283323-446a-40fc-9060-e2ac97976d01 Jul 22 03:24:29 devstack sudo[98449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:24:29 devstack sudo[98447]: pam_unix(sudo:session): session closed for user root Jul 22 03:24:29 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-4f360f4e-58ce-400f-b738-8592576cbc1b tempest-AttachVolumeNegativeTest-443471683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-731543a0-29f4-4de9-9c28-aa80043cc188" returned: 0 in 0.423s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:24:29 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-4f360f4e-58ce-400f-b738-8592576cbc1b tempest-AttachVolumeNegativeTest-443471683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-731543a0-29f4-4de9-9c28-aa80043cc188 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:24:29 devstack sudo[98454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-731543a0-29f4-4de9-9c28-aa80043cc188 Jul 22 03:24:29 devstack sudo[98454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:24:30 devstack sudo[98449]: pam_unix(sudo:session): session closed for user root Jul 22 03:24:30 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-e6c154e9-b7df-45bd-acb8-a22986bb1aac tempest-CreateVolumesFromSnapshotTest-1827509654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-28283323-446a-40fc-9060-e2ac97976d01" returned: 0 in 0.422s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:24:30 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-e6c154e9-b7df-45bd-acb8-a22986bb1aac tempest-CreateVolumesFromSnapshotTest-1827509654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-28283323-446a-40fc-9060-e2ac97976d01 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:24:30 devstack sudo[98460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-28283323-446a-40fc-9060-e2ac97976d01 Jul 22 03:24:30 devstack sudo[98460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:24:30 devstack sudo[98454]: pam_unix(sudo:session): session closed for user root Jul 22 03:24:30 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-4f360f4e-58ce-400f-b738-8592576cbc1b tempest-AttachVolumeNegativeTest-443471683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-731543a0-29f4-4de9-9c28-aa80043cc188" returned: 0 in 0.337s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:24:30 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-4f360f4e-58ce-400f-b738-8592576cbc1b tempest-AttachVolumeNegativeTest-443471683 None] Lock "cinder-quobyte-731543a0-29f4-4de9-9c28-aa80043cc188" released by "delete_volume" :: held 0.809s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:24:30 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-4f360f4e-58ce-400f-b738-8592576cbc1b tempest-AttachVolumeNegativeTest-443471683 None] Created reservations ['030c39ca-7a12-43d8-9aae-117b515d02db', 'c3bb81fb-f356-4377-a077-367a84db39bc', 'f3f27e21-7690-4acb-bcf3-ccc70ca40043', '147245ec-56ec-41dd-9956-e005ba0f6476'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:24:30 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-4f360f4e-58ce-400f-b738-8592576cbc1b tempest-AttachVolumeNegativeTest-443471683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:24:30 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-4f360f4e-58ce-400f-b738-8592576cbc1b tempest-AttachVolumeNegativeTest-443471683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:24:30 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-4f360f4e-58ce-400f-b738-8592576cbc1b tempest-AttachVolumeNegativeTest-443471683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:24:30 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-4f360f4e-58ce-400f-b738-8592576cbc1b tempest-AttachVolumeNegativeTest-443471683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:24:30 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-4f360f4e-58ce-400f-b738-8592576cbc1b tempest-AttachVolumeNegativeTest-443471683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:24:30 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-4f360f4e-58ce-400f-b738-8592576cbc1b tempest-AttachVolumeNegativeTest-443471683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:24:30 devstack sudo[98460]: pam_unix(sudo:session): session closed for user root Jul 22 03:24:30 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-e6c154e9-b7df-45bd-acb8-a22986bb1aac tempest-CreateVolumesFromSnapshotTest-1827509654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-28283323-446a-40fc-9060-e2ac97976d01" returned: 0 in 0.317s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:24:30 devstack sudo[98464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:24:30 devstack sudo[98464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:24:30 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-e6c154e9-b7df-45bd-acb8-a22986bb1aac tempest-CreateVolumesFromSnapshotTest-1827509654 None] Lock "cinder-quobyte-28283323-446a-40fc-9060-e2ac97976d01" released by "delete_volume" :: held 0.791s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:24:30 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-e6c154e9-b7df-45bd-acb8-a22986bb1aac tempest-CreateVolumesFromSnapshotTest-1827509654 None] Created reservations ['e186186d-03d9-4ec7-9d3b-68f2cde2460e', '38ce2387-5795-47cd-a764-592f4426e48c', '0e64cb33-0318-480d-bcbe-20a9b0fa70d3', '1aa88a13-f1c3-4af0-9cb4-04a8b332a25b'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:24:30 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-e6c154e9-b7df-45bd-acb8-a22986bb1aac tempest-CreateVolumesFromSnapshotTest-1827509654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:24:30 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-e6c154e9-b7df-45bd-acb8-a22986bb1aac tempest-CreateVolumesFromSnapshotTest-1827509654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:24:30 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-e6c154e9-b7df-45bd-acb8-a22986bb1aac tempest-CreateVolumesFromSnapshotTest-1827509654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:24:30 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-e6c154e9-b7df-45bd-acb8-a22986bb1aac tempest-CreateVolumesFromSnapshotTest-1827509654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:24:30 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-e6c154e9-b7df-45bd-acb8-a22986bb1aac tempest-CreateVolumesFromSnapshotTest-1827509654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:24:30 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-e6c154e9-b7df-45bd-acb8-a22986bb1aac tempest-CreateVolumesFromSnapshotTest-1827509654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:24:30 devstack sudo[98466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:24:30 devstack sudo[98466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:24:30 devstack sudo[98464]: pam_unix(sudo:session): session closed for user root Jul 22 03:24:30 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-4f360f4e-58ce-400f-b738-8592576cbc1b tempest-AttachVolumeNegativeTest-443471683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.328s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:24:30 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-4f360f4e-58ce-400f-b738-8592576cbc1b tempest-AttachVolumeNegativeTest-443471683 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:24:30 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-4f360f4e-58ce-400f-b738-8592576cbc1b tempest-AttachVolumeNegativeTest-443471683 None] Deleted volume successfully. Jul 22 03:24:30 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-4f360f4e-58ce-400f-b738-8592576cbc1b tempest-AttachVolumeNegativeTest-443471683 None] Lock "cinder-731543a0-29f4-4de9-9c28-aa80043cc188-delete_volume" released by "delete_volume" :: held 1.415s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:24:30 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-932b2b0d-49d2-4a76-afa7-d56e72cb4fac tempest-CreateVolumesFromSnapshotTest-1827509654 None] Acquiring lock "cinder-47e948af-35b3-4c21-a5da-933d41448ef3-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:24:30 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-932b2b0d-49d2-4a76-afa7-d56e72cb4fac tempest-CreateVolumesFromSnapshotTest-1827509654 None] Lock "cinder-47e948af-35b3-4c21-a5da-933d41448ef3-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:24:30 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-932b2b0d-49d2-4a76-afa7-d56e72cb4fac tempest-CreateVolumesFromSnapshotTest-1827509654 None] Acquiring lock "cinder-quobyte-47e948af-35b3-4c21-a5da-933d41448ef3" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:24:30 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-932b2b0d-49d2-4a76-afa7-d56e72cb4fac tempest-CreateVolumesFromSnapshotTest-1827509654 None] Lock "cinder-quobyte-47e948af-35b3-4c21-a5da-933d41448ef3" acquired by "delete_volume" :: waited 0.021s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:24:30 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c70cfd5-e1ea-46d2-b5b3-2c5d241f8d07]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:24:30 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-932b2b0d-49d2-4a76-afa7-d56e72cb4fac tempest-CreateVolumesFromSnapshotTest-1827509654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-47e948af-35b3-4c21-a5da-933d41448ef3 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:24:30 devstack sudo[98466]: pam_unix(sudo:session): session closed for user root Jul 22 03:24:30 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-e6c154e9-b7df-45bd-acb8-a22986bb1aac tempest-CreateVolumesFromSnapshotTest-1827509654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.364s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:24:30 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-e6c154e9-b7df-45bd-acb8-a22986bb1aac tempest-CreateVolumesFromSnapshotTest-1827509654 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:24:30 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-e6c154e9-b7df-45bd-acb8-a22986bb1aac tempest-CreateVolumesFromSnapshotTest-1827509654 None] Deleted volume successfully. Jul 22 03:24:30 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-e6c154e9-b7df-45bd-acb8-a22986bb1aac tempest-CreateVolumesFromSnapshotTest-1827509654 None] Lock "cinder-28283323-446a-40fc-9060-e2ac97976d01-delete_volume" released by "delete_volume" :: held 1.424s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:24:30 devstack sudo[98470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-47e948af-35b3-4c21-a5da-933d41448ef3 Jul 22 03:24:30 devstack sudo[98470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:24:31 devstack sudo[98470]: pam_unix(sudo:session): session closed for user root Jul 22 03:24:31 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-932b2b0d-49d2-4a76-afa7-d56e72cb4fac tempest-CreateVolumesFromSnapshotTest-1827509654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-47e948af-35b3-4c21-a5da-933d41448ef3" returned: 0 in 0.418s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:24:31 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-932b2b0d-49d2-4a76-afa7-d56e72cb4fac tempest-CreateVolumesFromSnapshotTest-1827509654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-47e948af-35b3-4c21-a5da-933d41448ef3 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:24:31 devstack sudo[98475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-47e948af-35b3-4c21-a5da-933d41448ef3 Jul 22 03:24:31 devstack sudo[98475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:24:31 devstack sudo[98475]: pam_unix(sudo:session): session closed for user root Jul 22 03:24:31 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-932b2b0d-49d2-4a76-afa7-d56e72cb4fac tempest-CreateVolumesFromSnapshotTest-1827509654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-47e948af-35b3-4c21-a5da-933d41448ef3" returned: 0 in 0.290s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:24:31 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-932b2b0d-49d2-4a76-afa7-d56e72cb4fac tempest-CreateVolumesFromSnapshotTest-1827509654 None] Lock "cinder-quobyte-47e948af-35b3-4c21-a5da-933d41448ef3" released by "delete_volume" :: held 0.767s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:24:31 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-932b2b0d-49d2-4a76-afa7-d56e72cb4fac tempest-CreateVolumesFromSnapshotTest-1827509654 None] Created reservations ['f13bcfe5-178d-4929-9df6-009fdaf5ad3c', '414acca1-cf70-4a67-8886-eba668b38001', '8b7056f7-2158-4eba-ab47-8a9ae31b6b92', '03deb840-8a22-4394-98b5-45b5eef6fa85'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:24:31 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-932b2b0d-49d2-4a76-afa7-d56e72cb4fac tempest-CreateVolumesFromSnapshotTest-1827509654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:24:31 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-932b2b0d-49d2-4a76-afa7-d56e72cb4fac tempest-CreateVolumesFromSnapshotTest-1827509654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:24:31 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-932b2b0d-49d2-4a76-afa7-d56e72cb4fac tempest-CreateVolumesFromSnapshotTest-1827509654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:24:31 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-932b2b0d-49d2-4a76-afa7-d56e72cb4fac tempest-CreateVolumesFromSnapshotTest-1827509654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:24:31 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-932b2b0d-49d2-4a76-afa7-d56e72cb4fac tempest-CreateVolumesFromSnapshotTest-1827509654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:24:31 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-932b2b0d-49d2-4a76-afa7-d56e72cb4fac tempest-CreateVolumesFromSnapshotTest-1827509654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:24:31 devstack sudo[98478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:24:31 devstack sudo[98478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:24:31 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-5924862e-3373-42c3-9645-2c5c245352fc tempest-CreateVolumesFromSnapshotTest-1827509654 None] Acquiring lock "cinder-ad59d1f5-8970-47ae-af7a-591eed617315-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:24:32 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-5924862e-3373-42c3-9645-2c5c245352fc tempest-CreateVolumesFromSnapshotTest-1827509654 None] Lock "cinder-ad59d1f5-8970-47ae-af7a-591eed617315-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:24:32 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-5924862e-3373-42c3-9645-2c5c245352fc tempest-CreateVolumesFromSnapshotTest-1827509654 None] Acquiring lock "cinder-quobyte-ad59d1f5-8970-47ae-af7a-591eed617315" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:24:32 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-5924862e-3373-42c3-9645-2c5c245352fc tempest-CreateVolumesFromSnapshotTest-1827509654 None] Lock "cinder-quobyte-ad59d1f5-8970-47ae-af7a-591eed617315" acquired by "delete_volume" :: waited 0.017s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:24:32 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd9a2da5-a69a-4ce9-841c-3c31b6263a7a]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:24:32 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5924862e-3373-42c3-9645-2c5c245352fc tempest-CreateVolumesFromSnapshotTest-1827509654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ad59d1f5-8970-47ae-af7a-591eed617315 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:24:32 devstack sudo[98478]: pam_unix(sudo:session): session closed for user root Jul 22 03:24:32 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-932b2b0d-49d2-4a76-afa7-d56e72cb4fac tempest-CreateVolumesFromSnapshotTest-1827509654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.350s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:24:32 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-932b2b0d-49d2-4a76-afa7-d56e72cb4fac tempest-CreateVolumesFromSnapshotTest-1827509654 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:24:32 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-932b2b0d-49d2-4a76-afa7-d56e72cb4fac tempest-CreateVolumesFromSnapshotTest-1827509654 None] Deleted volume successfully. Jul 22 03:24:32 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-932b2b0d-49d2-4a76-afa7-d56e72cb4fac tempest-CreateVolumesFromSnapshotTest-1827509654 None] Lock "cinder-47e948af-35b3-4c21-a5da-933d41448ef3-delete_volume" released by "delete_volume" :: held 1.439s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:24:32 devstack sudo[98481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ad59d1f5-8970-47ae-af7a-591eed617315 Jul 22 03:24:32 devstack sudo[98481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:24:32 devstack sudo[98481]: pam_unix(sudo:session): session closed for user root Jul 22 03:24:32 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5924862e-3373-42c3-9645-2c5c245352fc tempest-CreateVolumesFromSnapshotTest-1827509654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ad59d1f5-8970-47ae-af7a-591eed617315" returned: 0 in 0.471s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:24:32 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5924862e-3373-42c3-9645-2c5c245352fc tempest-CreateVolumesFromSnapshotTest-1827509654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ad59d1f5-8970-47ae-af7a-591eed617315 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:24:32 devstack sudo[98487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ad59d1f5-8970-47ae-af7a-591eed617315 Jul 22 03:24:32 devstack sudo[98487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:24:32 devstack sudo[98487]: pam_unix(sudo:session): session closed for user root Jul 22 03:24:32 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5924862e-3373-42c3-9645-2c5c245352fc tempest-CreateVolumesFromSnapshotTest-1827509654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ad59d1f5-8970-47ae-af7a-591eed617315" returned: 0 in 0.273s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:24:32 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-5924862e-3373-42c3-9645-2c5c245352fc tempest-CreateVolumesFromSnapshotTest-1827509654 None] Lock "cinder-quobyte-ad59d1f5-8970-47ae-af7a-591eed617315" released by "delete_volume" :: held 0.801s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:24:32 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-5924862e-3373-42c3-9645-2c5c245352fc tempest-CreateVolumesFromSnapshotTest-1827509654 None] Created reservations ['7f2a128d-08e0-4cf6-b9f1-494caa9110e3', 'b2567f27-4294-4729-aa10-9b1d4bb3bce0', '8f8f40c7-fc04-4c63-bf51-98030c0a3e95', '14dfb52b-f424-4c5c-9a9e-cd3c5b5a3a79'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:24:33 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-5924862e-3373-42c3-9645-2c5c245352fc tempest-CreateVolumesFromSnapshotTest-1827509654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:24:33 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-5924862e-3373-42c3-9645-2c5c245352fc tempest-CreateVolumesFromSnapshotTest-1827509654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:24:33 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-5924862e-3373-42c3-9645-2c5c245352fc tempest-CreateVolumesFromSnapshotTest-1827509654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:24:33 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-5924862e-3373-42c3-9645-2c5c245352fc tempest-CreateVolumesFromSnapshotTest-1827509654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:24:33 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-5924862e-3373-42c3-9645-2c5c245352fc tempest-CreateVolumesFromSnapshotTest-1827509654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:24:33 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5924862e-3373-42c3-9645-2c5c245352fc tempest-CreateVolumesFromSnapshotTest-1827509654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:24:33 devstack sudo[98491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:24:33 devstack sudo[98491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:24:33 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-01147bb6-7c91-4ea9-8da6-34722e8b9afd tempest-CreateVolumesFromSnapshotTest-1827509654 None] Acquiring lock "cinder-5c1b52e9-cc17-40d8-ae0b-059c73cce0f3-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:24:33 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-01147bb6-7c91-4ea9-8da6-34722e8b9afd tempest-CreateVolumesFromSnapshotTest-1827509654 None] Lock "cinder-5c1b52e9-cc17-40d8-ae0b-059c73cce0f3-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:24:33 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-01147bb6-7c91-4ea9-8da6-34722e8b9afd tempest-CreateVolumesFromSnapshotTest-1827509654 None] Acquiring lock "cinder-quobyte-5c1b52e9-cc17-40d8-ae0b-059c73cce0f3" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:24:33 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-01147bb6-7c91-4ea9-8da6-34722e8b9afd tempest-CreateVolumesFromSnapshotTest-1827509654 None] Lock "cinder-quobyte-5c1b52e9-cc17-40d8-ae0b-059c73cce0f3" acquired by "delete_volume" :: waited 0.025s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:24:33 devstack sudo[98491]: pam_unix(sudo:session): session closed for user root Jul 22 03:24:33 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5924862e-3373-42c3-9645-2c5c245352fc tempest-CreateVolumesFromSnapshotTest-1827509654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.403s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:24:33 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-5924862e-3373-42c3-9645-2c5c245352fc tempest-CreateVolumesFromSnapshotTest-1827509654 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:24:33 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-5924862e-3373-42c3-9645-2c5c245352fc tempest-CreateVolumesFromSnapshotTest-1827509654 None] Deleted volume successfully. Jul 22 03:24:33 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c775344-157f-4a12-89b7-85de496b2128]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:24:33 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-01147bb6-7c91-4ea9-8da6-34722e8b9afd tempest-CreateVolumesFromSnapshotTest-1827509654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-5c1b52e9-cc17-40d8-ae0b-059c73cce0f3 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:24:33 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-5924862e-3373-42c3-9645-2c5c245352fc tempest-CreateVolumesFromSnapshotTest-1827509654 None] Lock "cinder-ad59d1f5-8970-47ae-af7a-591eed617315-delete_volume" released by "delete_volume" :: held 1.482s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:24:33 devstack sudo[98528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-5c1b52e9-cc17-40d8-ae0b-059c73cce0f3 Jul 22 03:24:33 devstack sudo[98528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:24:34 devstack sudo[98528]: pam_unix(sudo:session): session closed for user root Jul 22 03:24:34 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-01147bb6-7c91-4ea9-8da6-34722e8b9afd tempest-CreateVolumesFromSnapshotTest-1827509654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-5c1b52e9-cc17-40d8-ae0b-059c73cce0f3" returned: 0 in 0.537s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:24:34 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-01147bb6-7c91-4ea9-8da6-34722e8b9afd tempest-CreateVolumesFromSnapshotTest-1827509654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-5c1b52e9-cc17-40d8-ae0b-059c73cce0f3 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:24:34 devstack sudo[98535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-5c1b52e9-cc17-40d8-ae0b-059c73cce0f3 Jul 22 03:24:34 devstack sudo[98535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:24:34 devstack sudo[98535]: pam_unix(sudo:session): session closed for user root Jul 22 03:24:34 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-01147bb6-7c91-4ea9-8da6-34722e8b9afd tempest-CreateVolumesFromSnapshotTest-1827509654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-5c1b52e9-cc17-40d8-ae0b-059c73cce0f3" returned: 0 in 0.386s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:24:34 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-01147bb6-7c91-4ea9-8da6-34722e8b9afd tempest-CreateVolumesFromSnapshotTest-1827509654 None] Lock "cinder-quobyte-5c1b52e9-cc17-40d8-ae0b-059c73cce0f3" released by "delete_volume" :: held 1.009s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:24:34 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-01147bb6-7c91-4ea9-8da6-34722e8b9afd tempest-CreateVolumesFromSnapshotTest-1827509654 None] Created reservations ['a97c1396-9305-48f8-8932-c4bb3b14220a', '54e2980e-c145-434b-8131-5c620f2240a8', '0a14b7e9-176d-4fb3-a1f0-df58c2292dc5', '6d36e11a-0059-43cb-aacc-c4babbb633df'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:24:34 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-01147bb6-7c91-4ea9-8da6-34722e8b9afd tempest-CreateVolumesFromSnapshotTest-1827509654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:24:34 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-01147bb6-7c91-4ea9-8da6-34722e8b9afd tempest-CreateVolumesFromSnapshotTest-1827509654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:24:34 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-01147bb6-7c91-4ea9-8da6-34722e8b9afd tempest-CreateVolumesFromSnapshotTest-1827509654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:24:34 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-01147bb6-7c91-4ea9-8da6-34722e8b9afd tempest-CreateVolumesFromSnapshotTest-1827509654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:24:34 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-01147bb6-7c91-4ea9-8da6-34722e8b9afd tempest-CreateVolumesFromSnapshotTest-1827509654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:24:34 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-01147bb6-7c91-4ea9-8da6-34722e8b9afd tempest-CreateVolumesFromSnapshotTest-1827509654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:24:34 devstack sudo[98539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:24:34 devstack sudo[98539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:24:34 devstack sudo[98539]: pam_unix(sudo:session): session closed for user root Jul 22 03:24:34 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-01147bb6-7c91-4ea9-8da6-34722e8b9afd tempest-CreateVolumesFromSnapshotTest-1827509654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.325s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:24:34 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-01147bb6-7c91-4ea9-8da6-34722e8b9afd tempest-CreateVolumesFromSnapshotTest-1827509654 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:24:34 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-01147bb6-7c91-4ea9-8da6-34722e8b9afd tempest-CreateVolumesFromSnapshotTest-1827509654 None] Deleted volume successfully. Jul 22 03:24:34 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-01147bb6-7c91-4ea9-8da6-34722e8b9afd tempest-CreateVolumesFromSnapshotTest-1827509654 None] Lock "cinder-5c1b52e9-cc17-40d8-ae0b-059c73cce0f3-delete_volume" released by "delete_volume" :: held 1.676s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:24:35 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-934fce98-7410-4bbd-a9e1-221ed42a8ad8 tempest-CreateVolumesFromSnapshotTest-1827509654 None] Acquiring lock "cinder-50dd51d3-c1ee-4277-8230-ee259890f67c-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:24:35 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-934fce98-7410-4bbd-a9e1-221ed42a8ad8 tempest-CreateVolumesFromSnapshotTest-1827509654 None] Lock "cinder-50dd51d3-c1ee-4277-8230-ee259890f67c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:24:35 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-934fce98-7410-4bbd-a9e1-221ed42a8ad8 tempest-CreateVolumesFromSnapshotTest-1827509654 None] Acquiring lock "cinder-quobyte-50dd51d3-c1ee-4277-8230-ee259890f67c" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:24:35 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-934fce98-7410-4bbd-a9e1-221ed42a8ad8 tempest-CreateVolumesFromSnapshotTest-1827509654 None] Lock "cinder-quobyte-50dd51d3-c1ee-4277-8230-ee259890f67c" acquired by "delete_volume" :: waited 0.018s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:24:35 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[84546fcf-32c6-4c6a-87ab-431227b9abf5]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:24:35 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-934fce98-7410-4bbd-a9e1-221ed42a8ad8 tempest-CreateVolumesFromSnapshotTest-1827509654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-50dd51d3-c1ee-4277-8230-ee259890f67c {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:24:35 devstack sudo[98543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-50dd51d3-c1ee-4277-8230-ee259890f67c Jul 22 03:24:35 devstack sudo[98543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:24:36 devstack sudo[98543]: pam_unix(sudo:session): session closed for user root Jul 22 03:24:36 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-934fce98-7410-4bbd-a9e1-221ed42a8ad8 tempest-CreateVolumesFromSnapshotTest-1827509654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-50dd51d3-c1ee-4277-8230-ee259890f67c" returned: 0 in 0.431s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:24:36 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-934fce98-7410-4bbd-a9e1-221ed42a8ad8 tempest-CreateVolumesFromSnapshotTest-1827509654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-50dd51d3-c1ee-4277-8230-ee259890f67c {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:24:36 devstack sudo[98549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-50dd51d3-c1ee-4277-8230-ee259890f67c Jul 22 03:24:36 devstack sudo[98549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:24:36 devstack sudo[98549]: pam_unix(sudo:session): session closed for user root Jul 22 03:24:36 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-934fce98-7410-4bbd-a9e1-221ed42a8ad8 tempest-CreateVolumesFromSnapshotTest-1827509654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-50dd51d3-c1ee-4277-8230-ee259890f67c" returned: 0 in 0.296s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:24:36 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-934fce98-7410-4bbd-a9e1-221ed42a8ad8 tempest-CreateVolumesFromSnapshotTest-1827509654 None] Lock "cinder-quobyte-50dd51d3-c1ee-4277-8230-ee259890f67c" released by "delete_volume" :: held 0.776s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:24:36 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-934fce98-7410-4bbd-a9e1-221ed42a8ad8 tempest-CreateVolumesFromSnapshotTest-1827509654 None] Created reservations ['a0f256af-9e4f-4119-8d5b-b205ba4c512b', '3e5595a1-461a-45d3-b2d9-14c15d029bac', '356cb092-b14f-4d8e-8198-4faf511e7cbd', '30f306c0-9b52-42dc-b715-5c038be53a4f'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:24:36 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-934fce98-7410-4bbd-a9e1-221ed42a8ad8 tempest-CreateVolumesFromSnapshotTest-1827509654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:24:36 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-934fce98-7410-4bbd-a9e1-221ed42a8ad8 tempest-CreateVolumesFromSnapshotTest-1827509654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:24:36 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-934fce98-7410-4bbd-a9e1-221ed42a8ad8 tempest-CreateVolumesFromSnapshotTest-1827509654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:24:36 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-934fce98-7410-4bbd-a9e1-221ed42a8ad8 tempest-CreateVolumesFromSnapshotTest-1827509654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:24:36 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-934fce98-7410-4bbd-a9e1-221ed42a8ad8 tempest-CreateVolumesFromSnapshotTest-1827509654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:24:36 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-934fce98-7410-4bbd-a9e1-221ed42a8ad8 tempest-CreateVolumesFromSnapshotTest-1827509654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:24:36 devstack sudo[98552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:24:36 devstack sudo[98552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:24:36 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-cd45c7a7-8f03-4f97-aeb8-a9359e3e80b4 tempest-CreateVolumesFromSnapshotTest-1827509654 None] Acquiring lock "cinder-c3bc32a0-4bf1-4946-867d-1c4e34ae621c-delete_snapshot" by "delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:24:36 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-cd45c7a7-8f03-4f97-aeb8-a9359e3e80b4 tempest-CreateVolumesFromSnapshotTest-1827509654 None] Lock "cinder-c3bc32a0-4bf1-4946-867d-1c4e34ae621c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:24:36 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-cd45c7a7-8f03-4f97-aeb8-a9359e3e80b4 tempest-CreateVolumesFromSnapshotTest-1827509654 None] Acquiring lock "cinder-quobyte-eecb6bad-b49e-4a8a-978b-5ab22790092e" by "delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:24:36 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-cd45c7a7-8f03-4f97-aeb8-a9359e3e80b4 tempest-CreateVolumesFromSnapshotTest-1827509654 None] Lock "cinder-quobyte-eecb6bad-b49e-4a8a-978b-5ab22790092e" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:24:36 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-cd45c7a7-8f03-4f97-aeb8-a9359e3e80b4 tempest-CreateVolumesFromSnapshotTest-1827509654 None] Acquiring lock "cinder-quobyte-c3bc32a0-4bf1-4946-867d-1c4e34ae621c" by "_delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:24:36 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-cd45c7a7-8f03-4f97-aeb8-a9359e3e80b4 tempest-CreateVolumesFromSnapshotTest-1827509654 None] Lock "cinder-quobyte-c3bc32a0-4bf1-4946-867d-1c4e34ae621c" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:24:36 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-cd45c7a7-8f03-4f97-aeb8-a9359e3e80b4 tempest-CreateVolumesFromSnapshotTest-1827509654 None] Deleting offline snapshot c3bc32a0-4bf1-4946-867d-1c4e34ae621c of volume eecb6bad-b49e-4a8a-978b-5ab22790092e {{(pid=87747) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 03:24:36 devstack sudo[98552]: pam_unix(sudo:session): session closed for user root Jul 22 03:24:36 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-cd45c7a7-8f03-4f97-aeb8-a9359e3e80b4 tempest-CreateVolumesFromSnapshotTest-1827509654 None] snapshot_file for this snap is: volume-eecb6bad-b49e-4a8a-978b-5ab22790092e.c3bc32a0-4bf1-4946-867d-1c4e34ae621c {{(pid=87747) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 03:24:36 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-934fce98-7410-4bbd-a9e1-221ed42a8ad8 tempest-CreateVolumesFromSnapshotTest-1827509654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.308s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:24:36 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-934fce98-7410-4bbd-a9e1-221ed42a8ad8 tempest-CreateVolumesFromSnapshotTest-1827509654 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:24:36 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-934fce98-7410-4bbd-a9e1-221ed42a8ad8 tempest-CreateVolumesFromSnapshotTest-1827509654 None] Deleted volume successfully. Jul 22 03:24:36 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd227c58-9ab1-4e81-b159-daed98df457e]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:24:36 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-cd45c7a7-8f03-4f97-aeb8-a9359e3e80b4 tempest-CreateVolumesFromSnapshotTest-1827509654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-eecb6bad-b49e-4a8a-978b-5ab22790092e.c3bc32a0-4bf1-4946-867d-1c4e34ae621c {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:24:36 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-934fce98-7410-4bbd-a9e1-221ed42a8ad8 tempest-CreateVolumesFromSnapshotTest-1827509654 None] Lock "cinder-50dd51d3-c1ee-4277-8230-ee259890f67c-delete_volume" released by "delete_volume" :: held 1.340s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:24:36 devstack sudo[98555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-eecb6bad-b49e-4a8a-978b-5ab22790092e.c3bc32a0-4bf1-4946-867d-1c4e34ae621c Jul 22 03:24:36 devstack sudo[98555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:24:37 devstack sudo[98555]: pam_unix(sudo:session): session closed for user root Jul 22 03:24:37 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-cd45c7a7-8f03-4f97-aeb8-a9359e3e80b4 tempest-CreateVolumesFromSnapshotTest-1827509654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-eecb6bad-b49e-4a8a-978b-5ab22790092e.c3bc32a0-4bf1-4946-867d-1c4e34ae621c" returned: 0 in 0.445s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:24:37 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-cd45c7a7-8f03-4f97-aeb8-a9359e3e80b4 tempest-CreateVolumesFromSnapshotTest-1827509654 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eecb6bad-b49e-4a8a-978b-5ab22790092e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87747) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 03:24:37 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[3536aa16-8ede-4c13-8e8f-8ca70927fc42]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:24:37 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-cd45c7a7-8f03-4f97-aeb8-a9359e3e80b4 tempest-CreateVolumesFromSnapshotTest-1827509654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-eecb6bad-b49e-4a8a-978b-5ab22790092e {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:24:37 devstack sudo[98563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-eecb6bad-b49e-4a8a-978b-5ab22790092e Jul 22 03:24:37 devstack sudo[98563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:24:37 devstack sudo[98563]: pam_unix(sudo:session): session closed for user root Jul 22 03:24:37 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-cd45c7a7-8f03-4f97-aeb8-a9359e3e80b4 tempest-CreateVolumesFromSnapshotTest-1827509654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-eecb6bad-b49e-4a8a-978b-5ab22790092e" returned: 0 in 0.409s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:24:37 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-cd45c7a7-8f03-4f97-aeb8-a9359e3e80b4 tempest-CreateVolumesFromSnapshotTest-1827509654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-eecb6bad-b49e-4a8a-978b-5ab22790092e.c3bc32a0-4bf1-4946-867d-1c4e34ae621c {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:24:37 devstack sudo[98569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-eecb6bad-b49e-4a8a-978b-5ab22790092e.c3bc32a0-4bf1-4946-867d-1c4e34ae621c Jul 22 03:24:37 devstack sudo[98569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:24:38 devstack sudo[98569]: pam_unix(sudo:session): session closed for user root Jul 22 03:24:38 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-cd45c7a7-8f03-4f97-aeb8-a9359e3e80b4 tempest-CreateVolumesFromSnapshotTest-1827509654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-eecb6bad-b49e-4a8a-978b-5ab22790092e.c3bc32a0-4bf1-4946-867d-1c4e34ae621c" returned: 0 in 0.404s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:24:38 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-cd45c7a7-8f03-4f97-aeb8-a9359e3e80b4 tempest-CreateVolumesFromSnapshotTest-1827509654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-eecb6bad-b49e-4a8a-978b-5ab22790092e.c3bc32a0-4bf1-4946-867d-1c4e34ae621c {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:24:38 devstack sudo[98574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-eecb6bad-b49e-4a8a-978b-5ab22790092e.c3bc32a0-4bf1-4946-867d-1c4e34ae621c Jul 22 03:24:38 devstack sudo[98574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:24:38 devstack sudo[98574]: pam_unix(sudo:session): session closed for user root Jul 22 03:24:38 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-cd45c7a7-8f03-4f97-aeb8-a9359e3e80b4 tempest-CreateVolumesFromSnapshotTest-1827509654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-eecb6bad-b49e-4a8a-978b-5ab22790092e.c3bc32a0-4bf1-4946-867d-1c4e34ae621c" returned: 0 in 0.339s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:24:38 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-cd45c7a7-8f03-4f97-aeb8-a9359e3e80b4 tempest-CreateVolumesFromSnapshotTest-1827509654 None] Lock "cinder-quobyte-c3bc32a0-4bf1-4946-867d-1c4e34ae621c" released by "_delete_snapshot" :: held 1.755s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:24:38 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-cd45c7a7-8f03-4f97-aeb8-a9359e3e80b4 tempest-CreateVolumesFromSnapshotTest-1827509654 None] Lock "cinder-quobyte-eecb6bad-b49e-4a8a-978b-5ab22790092e" released by "delete_snapshot" :: held 1.793s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:24:38 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-cd45c7a7-8f03-4f97-aeb8-a9359e3e80b4 tempest-CreateVolumesFromSnapshotTest-1827509654 None] Created reservations ['b55e2d9a-6bf6-4b3d-a84f-25c56c810adc', '02ce9203-c117-470b-9485-d2270ec1510b', '7dcf5e84-f71e-4e12-bb8d-6dfcb7fb4a55', 'ea61b41d-24c1-410d-819e-6e94687ad001'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:24:38 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-cd45c7a7-8f03-4f97-aeb8-a9359e3e80b4 tempest-CreateVolumesFromSnapshotTest-1827509654 None] Delete snapshot completed successfully. Jul 22 03:24:38 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-cd45c7a7-8f03-4f97-aeb8-a9359e3e80b4 tempest-CreateVolumesFromSnapshotTest-1827509654 None] Lock "cinder-c3bc32a0-4bf1-4946-867d-1c4e34ae621c-delete_snapshot" released by "delete_snapshot" :: held 1.956s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:24:38 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-cf7d6a0e-be73-4d3e-95d2-f83cdbb276b0 tempest-GroupSnapshotsTest-172189020 None] Group tempest-GroupSnapshotsTest-Group-1811851119: creating Jul 22 03:24:38 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-cf7d6a0e-be73-4d3e-95d2-f83cdbb276b0 tempest-GroupSnapshotsTest-172189020 None] Group tempest-GroupSnapshotsTest-Group-1811851119: created successfully Jul 22 03:24:38 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-cf7d6a0e-be73-4d3e-95d2-f83cdbb276b0 tempest-GroupSnapshotsTest-172189020 None] Create group completed successfully. Jul 22 03:24:38 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-2d5871fb-6739-4711-9883-7b0f488b6ab5 tempest-CreateVolumesFromSnapshotTest-1827509654 None] Acquiring lock "cinder-eecb6bad-b49e-4a8a-978b-5ab22790092e-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:24:38 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-2d5871fb-6739-4711-9883-7b0f488b6ab5 tempest-CreateVolumesFromSnapshotTest-1827509654 None] Lock "cinder-eecb6bad-b49e-4a8a-978b-5ab22790092e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:24:38 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-2d5871fb-6739-4711-9883-7b0f488b6ab5 tempest-CreateVolumesFromSnapshotTest-1827509654 None] Acquiring lock "cinder-quobyte-eecb6bad-b49e-4a8a-978b-5ab22790092e" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:24:38 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-2d5871fb-6739-4711-9883-7b0f488b6ab5 tempest-CreateVolumesFromSnapshotTest-1827509654 None] Lock "cinder-quobyte-eecb6bad-b49e-4a8a-978b-5ab22790092e" acquired by "delete_volume" :: waited 0.021s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:24:39 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[5767c72d-c82a-4ef4-b705-638452bf3b45]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:24:39 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2d5871fb-6739-4711-9883-7b0f488b6ab5 tempest-CreateVolumesFromSnapshotTest-1827509654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-eecb6bad-b49e-4a8a-978b-5ab22790092e {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:24:39 devstack sudo[98577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-eecb6bad-b49e-4a8a-978b-5ab22790092e Jul 22 03:24:39 devstack sudo[98577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:24:39 devstack sudo[98577]: pam_unix(sudo:session): session closed for user root Jul 22 03:24:39 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2d5871fb-6739-4711-9883-7b0f488b6ab5 tempest-CreateVolumesFromSnapshotTest-1827509654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-eecb6bad-b49e-4a8a-978b-5ab22790092e" returned: 0 in 0.420s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:24:39 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2d5871fb-6739-4711-9883-7b0f488b6ab5 tempest-CreateVolumesFromSnapshotTest-1827509654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-eecb6bad-b49e-4a8a-978b-5ab22790092e {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:24:39 devstack sudo[98582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-eecb6bad-b49e-4a8a-978b-5ab22790092e Jul 22 03:24:39 devstack sudo[98582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:24:39 devstack sudo[98582]: pam_unix(sudo:session): session closed for user root Jul 22 03:24:39 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2d5871fb-6739-4711-9883-7b0f488b6ab5 tempest-CreateVolumesFromSnapshotTest-1827509654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-eecb6bad-b49e-4a8a-978b-5ab22790092e" returned: 0 in 0.324s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:24:39 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-2d5871fb-6739-4711-9883-7b0f488b6ab5 tempest-CreateVolumesFromSnapshotTest-1827509654 None] Lock "cinder-quobyte-eecb6bad-b49e-4a8a-978b-5ab22790092e" released by "delete_volume" :: held 0.843s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:24:39 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-2d5871fb-6739-4711-9883-7b0f488b6ab5 tempest-CreateVolumesFromSnapshotTest-1827509654 None] Created reservations ['e9231f3d-2c13-4f68-837d-89f1ea55fcef', '30659029-62f2-4a7d-ba0a-9cdbf14069c3', '84b97332-01e2-431e-a9bb-0d4e6a927bd4', '1b701434-01b2-45b7-873a-07bba6a50e1c'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:24:39 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-2d5871fb-6739-4711-9883-7b0f488b6ab5 tempest-CreateVolumesFromSnapshotTest-1827509654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:24:39 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-2d5871fb-6739-4711-9883-7b0f488b6ab5 tempest-CreateVolumesFromSnapshotTest-1827509654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:24:39 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-2d5871fb-6739-4711-9883-7b0f488b6ab5 tempest-CreateVolumesFromSnapshotTest-1827509654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:24:39 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-2d5871fb-6739-4711-9883-7b0f488b6ab5 tempest-CreateVolumesFromSnapshotTest-1827509654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:24:39 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-2d5871fb-6739-4711-9883-7b0f488b6ab5 tempest-CreateVolumesFromSnapshotTest-1827509654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:24:39 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2d5871fb-6739-4711-9883-7b0f488b6ab5 tempest-CreateVolumesFromSnapshotTest-1827509654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:24:39 devstack sudo[98586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:24:39 devstack sudo[98586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:24:40 devstack sudo[98586]: pam_unix(sudo:session): session closed for user root Jul 22 03:24:40 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2d5871fb-6739-4711-9883-7b0f488b6ab5 tempest-CreateVolumesFromSnapshotTest-1827509654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.357s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:24:40 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-2d5871fb-6739-4711-9883-7b0f488b6ab5 tempest-CreateVolumesFromSnapshotTest-1827509654 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:24:40 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-2d5871fb-6739-4711-9883-7b0f488b6ab5 tempest-CreateVolumesFromSnapshotTest-1827509654 None] Deleted volume successfully. Jul 22 03:24:40 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-2d5871fb-6739-4711-9883-7b0f488b6ab5 tempest-CreateVolumesFromSnapshotTest-1827509654 None] Lock "cinder-eecb6bad-b49e-4a8a-978b-5ab22790092e-delete_volume" released by "delete_volume" :: held 1.458s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:24:40 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a4cbdce-ea3f-438b-a78d-ff7ca67737f3 tempest-GroupSnapshotsTest-172189020 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:24:40 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-5a4cbdce-ea3f-438b-a78d-ff7ca67737f3 tempest-GroupSnapshotsTest-172189020 None] Flow 'volume_create_manager' (97dd6a85-3523-4182-9d95-29658ac1ce6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:24:40 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-5a4cbdce-ea3f-438b-a78d-ff7ca67737f3 tempest-GroupSnapshotsTest-172189020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6cf65bc-a612-4bff-9957-71b848183c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:24:40 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-5a4cbdce-ea3f-438b-a78d-ff7ca67737f3 tempest-GroupSnapshotsTest-172189020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6cf65bc-a612-4bff-9957-71b848183c74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:24:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1182070808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=83ebe8e3-65d1-45ba-bb42-57bfc95f9e71,host='devstack@QuobyteHD#QuobyteHD',id=9d8b2d63-1a4b-4b61-b5ff-3abd68277210,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a058032650974a56a4f1348c499a4293',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:24:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:24:41Z,use_quota=True,user_id='8b50bd7a480f42ac8ba487a2cd387e87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7314201e-9682-46c6-bf8a-831e6183091a),volume_type_id=7314201e-9682-46c6-bf8a-831e6183091a)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:24:40 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-5a4cbdce-ea3f-438b-a78d-ff7ca67737f3 tempest-GroupSnapshotsTest-172189020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bda11110-f3bb-4777-9fe4-4d09e9c810c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:24:40 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-5a4cbdce-ea3f-438b-a78d-ff7ca67737f3 tempest-GroupSnapshotsTest-172189020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bda11110-f3bb-4777-9fe4-4d09e9c810c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:24:40 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-5a4cbdce-ea3f-438b-a78d-ff7ca67737f3 tempest-GroupSnapshotsTest-172189020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb917823-af01-40dc-8178-3aa139022743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:24:40 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-5a4cbdce-ea3f-438b-a78d-ff7ca67737f3 tempest-GroupSnapshotsTest-172189020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb917823-af01-40dc-8178-3aa139022743) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d8b2d63-1a4b-4b61-b5ff-3abd68277210', 'volume_name': 'volume-9d8b2d63-1a4b-4b61-b5ff-3abd68277210', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:24:40 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-5a4cbdce-ea3f-438b-a78d-ff7ca67737f3 tempest-GroupSnapshotsTest-172189020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62b7db08-95d4-4362-a0df-937c31d7e676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:24:40 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-5a4cbdce-ea3f-438b-a78d-ff7ca67737f3 tempest-GroupSnapshotsTest-172189020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62b7db08-95d4-4362-a0df-937c31d7e676) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:24:40 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-5a4cbdce-ea3f-438b-a78d-ff7ca67737f3 tempest-GroupSnapshotsTest-172189020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7258af0f-8288-4c74-8c48-0a0c092c9c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:24:40 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-5a4cbdce-ea3f-438b-a78d-ff7ca67737f3 tempest-GroupSnapshotsTest-172189020 None] Volume 9d8b2d63-1a4b-4b61-b5ff-3abd68277210: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d8b2d63-1a4b-4b61-b5ff-3abd68277210', 'volume_size': 1} Jul 22 03:24:40 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-5a4cbdce-ea3f-438b-a78d-ff7ca67737f3 tempest-GroupSnapshotsTest-172189020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:24:40 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-5a4cbdce-ea3f-438b-a78d-ff7ca67737f3 tempest-GroupSnapshotsTest-172189020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:24:40 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-5a4cbdce-ea3f-438b-a78d-ff7ca67737f3 tempest-GroupSnapshotsTest-172189020 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=83ebe8e3-65d1-45ba-bb42-57bfc95f9e71,created_at=2026-07-22T01:24:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1182070808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=83ebe8e3-65d1-45ba-bb42-57bfc95f9e71,host='devstack@QuobyteHD#QuobyteHD',id=9d8b2d63-1a4b-4b61-b5ff-3abd68277210,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a058032650974a56a4f1348c499a4293',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:24:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:24:41Z,use_quota=True,user_id='8b50bd7a480f42ac8ba487a2cd387e87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7314201e-9682-46c6-bf8a-831e6183091a),volume_type_id=7314201e-9682-46c6-bf8a-831e6183091a)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:24:40 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-5a4cbdce-ea3f-438b-a78d-ff7ca67737f3 tempest-GroupSnapshotsTest-172189020 None] Creating volume 9d8b2d63-1a4b-4b61-b5ff-3abd68277210 {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:24:40 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-5a4cbdce-ea3f-438b-a78d-ff7ca67737f3 tempest-GroupSnapshotsTest-172189020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:24:40 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-5a4cbdce-ea3f-438b-a78d-ff7ca67737f3 tempest-GroupSnapshotsTest-172189020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:24:40 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-5a4cbdce-ea3f-438b-a78d-ff7ca67737f3 tempest-GroupSnapshotsTest-172189020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:24:40 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-5a4cbdce-ea3f-438b-a78d-ff7ca67737f3 tempest-GroupSnapshotsTest-172189020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:24:40 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-5a4cbdce-ea3f-438b-a78d-ff7ca67737f3 tempest-GroupSnapshotsTest-172189020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:24:40 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-5a4cbdce-ea3f-438b-a78d-ff7ca67737f3 tempest-GroupSnapshotsTest-172189020 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:24:40 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-5a4cbdce-ea3f-438b-a78d-ff7ca67737f3 tempest-GroupSnapshotsTest-172189020 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:24:40 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5a4cbdce-ea3f-438b-a78d-ff7ca67737f3 tempest-GroupSnapshotsTest-172189020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9d8b2d63-1a4b-4b61-b5ff-3abd68277210 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:24:40 devstack sudo[98589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9d8b2d63-1a4b-4b61-b5ff-3abd68277210 1073741824 Jul 22 03:24:40 devstack sudo[98589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:24:41 devstack sudo[98589]: pam_unix(sudo:session): session closed for user root Jul 22 03:24:41 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5a4cbdce-ea3f-438b-a78d-ff7ca67737f3 tempest-GroupSnapshotsTest-172189020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9d8b2d63-1a4b-4b61-b5ff-3abd68277210 1073741824" returned: 0 in 0.508s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:24:41 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5a4cbdce-ea3f-438b-a78d-ff7ca67737f3 tempest-GroupSnapshotsTest-172189020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9d8b2d63-1a4b-4b61-b5ff-3abd68277210 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:24:41 devstack sudo[98595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9d8b2d63-1a4b-4b61-b5ff-3abd68277210 Jul 22 03:24:41 devstack sudo[98595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:24:41 devstack sudo[98595]: pam_unix(sudo:session): session closed for user root Jul 22 03:24:41 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5a4cbdce-ea3f-438b-a78d-ff7ca67737f3 tempest-GroupSnapshotsTest-172189020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9d8b2d63-1a4b-4b61-b5ff-3abd68277210" returned: 0 in 0.262s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:24:41 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-5a4cbdce-ea3f-438b-a78d-ff7ca67737f3 tempest-GroupSnapshotsTest-172189020 None] <== create_volume: return (816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:24:41 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-5a4cbdce-ea3f-438b-a78d-ff7ca67737f3 tempest-GroupSnapshotsTest-172189020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.818s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:24:41 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-5a4cbdce-ea3f-438b-a78d-ff7ca67737f3 tempest-GroupSnapshotsTest-172189020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7258af0f-8288-4c74-8c48-0a0c092c9c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d8b2d63-1a4b-4b61-b5ff-3abd68277210', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:24:41 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-5a4cbdce-ea3f-438b-a78d-ff7ca67737f3 tempest-GroupSnapshotsTest-172189020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd43cb3e-dd3f-4002-af19-79a8efc5f27f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:24:41 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-5a4cbdce-ea3f-438b-a78d-ff7ca67737f3 tempest-GroupSnapshotsTest-172189020 None] Volume volume-9d8b2d63-1a4b-4b61-b5ff-3abd68277210 (9d8b2d63-1a4b-4b61-b5ff-3abd68277210): created successfully Jul 22 03:24:41 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-5a4cbdce-ea3f-438b-a78d-ff7ca67737f3 tempest-GroupSnapshotsTest-172189020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd43cb3e-dd3f-4002-af19-79a8efc5f27f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:24:41 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-5a4cbdce-ea3f-438b-a78d-ff7ca67737f3 tempest-GroupSnapshotsTest-172189020 None] Flow 'volume_create_manager' (97dd6a85-3523-4182-9d95-29658ac1ce6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:24:41 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-5a4cbdce-ea3f-438b-a78d-ff7ca67737f3 tempest-GroupSnapshotsTest-172189020 None] Created volume successfully. Jul 22 03:24:42 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-d78ce6f5-1a76-4712-89be-840c9e343a75 tempest-GroupSnapshotsTest-172189020 None] GroupSnapshot bddd988e-f84f-41d0-a6a5-9f03c92691a3: creating. Jul 22 03:24:42 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-d78ce6f5-1a76-4712-89be-840c9e343a75 tempest-GroupSnapshotsTest-172189020 None] Group snapshot bddd988e-f84f-41d0-a6a5-9f03c92691a3: creating. {{(pid=87747) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 22 03:24:42 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-d78ce6f5-1a76-4712-89be-840c9e343a75 tempest-GroupSnapshotsTest-172189020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:24:42 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-d78ce6f5-1a76-4712-89be-840c9e343a75 tempest-GroupSnapshotsTest-172189020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:24:42 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-d78ce6f5-1a76-4712-89be-840c9e343a75 tempest-GroupSnapshotsTest-172189020 None] Creating offline snapshot 3f966ad0-9b7b-4f0a-982d-8b14da66c73f of volume 9d8b2d63-1a4b-4b61-b5ff-3abd68277210 {{(pid=87747) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 03:24:42 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[d715bee6-255b-4924-b3d0-9a42a2d02713]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:24:42 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d78ce6f5-1a76-4712-89be-840c9e343a75 tempest-GroupSnapshotsTest-172189020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9d8b2d63-1a4b-4b61-b5ff-3abd68277210 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:24:42 devstack sudo[98598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9d8b2d63-1a4b-4b61-b5ff-3abd68277210 Jul 22 03:24:42 devstack sudo[98598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:24:42 devstack sudo[98598]: pam_unix(sudo:session): session closed for user root Jul 22 03:24:42 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d78ce6f5-1a76-4712-89be-840c9e343a75 tempest-GroupSnapshotsTest-172189020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9d8b2d63-1a4b-4b61-b5ff-3abd68277210" returned: 0 in 0.494s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:24:42 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d78ce6f5-1a76-4712-89be-840c9e343a75 tempest-GroupSnapshotsTest-172189020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9d8b2d63-1a4b-4b61-b5ff-3abd68277210,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9d8b2d63-1a4b-4b61-b5ff-3abd68277210.3f966ad0-9b7b-4f0a-982d-8b14da66c73f 1G {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:24:42 devstack sudo[98603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9d8b2d63-1a4b-4b61-b5ff-3abd68277210,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9d8b2d63-1a4b-4b61-b5ff-3abd68277210.3f966ad0-9b7b-4f0a-982d-8b14da66c73f 1G Jul 22 03:24:42 devstack sudo[98603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:24:43 devstack sudo[98603]: pam_unix(sudo:session): session closed for user root Jul 22 03:24:43 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d78ce6f5-1a76-4712-89be-840c9e343a75 tempest-GroupSnapshotsTest-172189020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9d8b2d63-1a4b-4b61-b5ff-3abd68277210,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9d8b2d63-1a4b-4b61-b5ff-3abd68277210.3f966ad0-9b7b-4f0a-982d-8b14da66c73f 1G" returned: 0 in 0.492s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:24:43 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d78ce6f5-1a76-4712-89be-840c9e343a75 tempest-GroupSnapshotsTest-172189020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d8b2d63-1a4b-4b61-b5ff-3abd68277210 -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9d8b2d63-1a4b-4b61-b5ff-3abd68277210.3f966ad0-9b7b-4f0a-982d-8b14da66c73f {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:24:43 devstack sudo[98609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d8b2d63-1a4b-4b61-b5ff-3abd68277210 -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9d8b2d63-1a4b-4b61-b5ff-3abd68277210.3f966ad0-9b7b-4f0a-982d-8b14da66c73f Jul 22 03:24:43 devstack sudo[98609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:24:43 devstack sudo[98609]: pam_unix(sudo:session): session closed for user root Jul 22 03:24:43 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d78ce6f5-1a76-4712-89be-840c9e343a75 tempest-GroupSnapshotsTest-172189020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d8b2d63-1a4b-4b61-b5ff-3abd68277210 -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9d8b2d63-1a4b-4b61-b5ff-3abd68277210.3f966ad0-9b7b-4f0a-982d-8b14da66c73f" returned: 0 in 0.317s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:24:43 devstack cinder-volume[87747]: WARNING cinder.volume.drivers.remotefs [None req-d78ce6f5-1a76-4712-89be-840c9e343a75 tempest-GroupSnapshotsTest-172189020 None] /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9d8b2d63-1a4b-4b61-b5ff-3abd68277210.3f966ad0-9b7b-4f0a-982d-8b14da66c73f is being set with open permissions: ugo+rw: NotImplementedError Jul 22 03:24:43 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d78ce6f5-1a76-4712-89be-840c9e343a75 tempest-GroupSnapshotsTest-172189020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9d8b2d63-1a4b-4b61-b5ff-3abd68277210.3f966ad0-9b7b-4f0a-982d-8b14da66c73f {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:24:43 devstack sudo[98614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9d8b2d63-1a4b-4b61-b5ff-3abd68277210.3f966ad0-9b7b-4f0a-982d-8b14da66c73f Jul 22 03:24:43 devstack sudo[98614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:24:43 devstack sudo[98614]: pam_unix(sudo:session): session closed for user root Jul 22 03:24:43 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d78ce6f5-1a76-4712-89be-840c9e343a75 tempest-GroupSnapshotsTest-172189020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9d8b2d63-1a4b-4b61-b5ff-3abd68277210.3f966ad0-9b7b-4f0a-982d-8b14da66c73f" returned: 0 in 0.275s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:24:43 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d78ce6f5-1a76-4712-89be-840c9e343a75 tempest-GroupSnapshotsTest-172189020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9d8b2d63-1a4b-4b61-b5ff-3abd68277210.info {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:24:44 devstack sudo[98617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9d8b2d63-1a4b-4b61-b5ff-3abd68277210.info Jul 22 03:24:44 devstack sudo[98617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:24:44 devstack sudo[98617]: pam_unix(sudo:session): session closed for user root Jul 22 03:24:44 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d78ce6f5-1a76-4712-89be-840c9e343a75 tempest-GroupSnapshotsTest-172189020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9d8b2d63-1a4b-4b61-b5ff-3abd68277210.info" returned: 0 in 0.304s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:24:44 devstack cinder-volume[87747]: WARNING cinder.volume.drivers.remotefs [None req-d78ce6f5-1a76-4712-89be-840c9e343a75 tempest-GroupSnapshotsTest-172189020 None] /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9d8b2d63-1a4b-4b61-b5ff-3abd68277210.info is being set with open permissions: ugo+rw: NotImplementedError Jul 22 03:24:44 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d78ce6f5-1a76-4712-89be-840c9e343a75 tempest-GroupSnapshotsTest-172189020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9d8b2d63-1a4b-4b61-b5ff-3abd68277210.info {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:24:44 devstack sudo[98620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9d8b2d63-1a4b-4b61-b5ff-3abd68277210.info Jul 22 03:24:44 devstack sudo[98620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:24:44 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d97b258-1181-4bf7-9efd-ae82d4ee0bef tempest-VolumeDependencyTests-325487065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:24:44 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-4d97b258-1181-4bf7-9efd-ae82d4ee0bef tempest-VolumeDependencyTests-325487065 None] Flow 'volume_create_manager' (886f083f-be54-419c-a1aa-3e44b8ad7bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:24:44 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-4d97b258-1181-4bf7-9efd-ae82d4ee0bef tempest-VolumeDependencyTests-325487065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b16a9507-1592-4c40-baf9-17d73fbb1095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:24:44 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-4d97b258-1181-4bf7-9efd-ae82d4ee0bef tempest-VolumeDependencyTests-325487065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b16a9507-1592-4c40-baf9-17d73fbb1095) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:24:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-590499142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33ac0c8a-d0c6-4d2e-bad9-fd8a9e43ee0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='205c4ddc28874d5b8b1b539704d4e0ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:24:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:24:44Z,use_quota=True,user_id='2bfeeb6e59c347a391750eae848d8892',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:24:44 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-4d97b258-1181-4bf7-9efd-ae82d4ee0bef tempest-VolumeDependencyTests-325487065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ab43d97-40b7-4742-9315-fa0085fc847c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:24:44 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-4d97b258-1181-4bf7-9efd-ae82d4ee0bef tempest-VolumeDependencyTests-325487065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ab43d97-40b7-4742-9315-fa0085fc847c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:24:44 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-4d97b258-1181-4bf7-9efd-ae82d4ee0bef tempest-VolumeDependencyTests-325487065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c293ed7-fe65-4c2c-ad5a-e734cf6fd4d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:24:44 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-4d97b258-1181-4bf7-9efd-ae82d4ee0bef tempest-VolumeDependencyTests-325487065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c293ed7-fe65-4c2c-ad5a-e734cf6fd4d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33ac0c8a-d0c6-4d2e-bad9-fd8a9e43ee0d', 'volume_name': 'volume-33ac0c8a-d0c6-4d2e-bad9-fd8a9e43ee0d', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:24:44 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-4d97b258-1181-4bf7-9efd-ae82d4ee0bef tempest-VolumeDependencyTests-325487065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (505fadbf-3a88-4ff8-a87c-6ff615e30d0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:24:44 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-4d97b258-1181-4bf7-9efd-ae82d4ee0bef tempest-VolumeDependencyTests-325487065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (505fadbf-3a88-4ff8-a87c-6ff615e30d0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:24:44 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-4d97b258-1181-4bf7-9efd-ae82d4ee0bef tempest-VolumeDependencyTests-325487065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9623a4cd-26b4-4bbd-8887-aaf62e0e3a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:24:44 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-4d97b258-1181-4bf7-9efd-ae82d4ee0bef tempest-VolumeDependencyTests-325487065 None] Volume 33ac0c8a-d0c6-4d2e-bad9-fd8a9e43ee0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33ac0c8a-d0c6-4d2e-bad9-fd8a9e43ee0d', 'volume_size': 1} Jul 22 03:24:44 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-4d97b258-1181-4bf7-9efd-ae82d4ee0bef tempest-VolumeDependencyTests-325487065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:24:44 devstack sudo[98620]: pam_unix(sudo:session): session closed for user root Jul 22 03:24:44 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d78ce6f5-1a76-4712-89be-840c9e343a75 tempest-GroupSnapshotsTest-172189020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9d8b2d63-1a4b-4b61-b5ff-3abd68277210.info" returned: 0 in 0.322s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:24:44 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-d78ce6f5-1a76-4712-89be-840c9e343a75 tempest-GroupSnapshotsTest-172189020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.293s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:24:44 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-4d97b258-1181-4bf7-9efd-ae82d4ee0bef tempest-VolumeDependencyTests-325487065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.185s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:24:44 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-4d97b258-1181-4bf7-9efd-ae82d4ee0bef tempest-VolumeDependencyTests-325487065 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:24:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-590499142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33ac0c8a-d0c6-4d2e-bad9-fd8a9e43ee0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='205c4ddc28874d5b8b1b539704d4e0ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:24:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:24:44Z,use_quota=True,user_id='2bfeeb6e59c347a391750eae848d8892',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:24:44 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-4d97b258-1181-4bf7-9efd-ae82d4ee0bef tempest-VolumeDependencyTests-325487065 None] Creating volume 33ac0c8a-d0c6-4d2e-bad9-fd8a9e43ee0d {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:24:44 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-4d97b258-1181-4bf7-9efd-ae82d4ee0bef tempest-VolumeDependencyTests-325487065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:24:44 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-4d97b258-1181-4bf7-9efd-ae82d4ee0bef tempest-VolumeDependencyTests-325487065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:24:44 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-4d97b258-1181-4bf7-9efd-ae82d4ee0bef tempest-VolumeDependencyTests-325487065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:24:44 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-4d97b258-1181-4bf7-9efd-ae82d4ee0bef tempest-VolumeDependencyTests-325487065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:24:44 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-4d97b258-1181-4bf7-9efd-ae82d4ee0bef tempest-VolumeDependencyTests-325487065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:24:44 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-4d97b258-1181-4bf7-9efd-ae82d4ee0bef tempest-VolumeDependencyTests-325487065 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:24:44 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-4d97b258-1181-4bf7-9efd-ae82d4ee0bef tempest-VolumeDependencyTests-325487065 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:24:44 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-4d97b258-1181-4bf7-9efd-ae82d4ee0bef tempest-VolumeDependencyTests-325487065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-33ac0c8a-d0c6-4d2e-bad9-fd8a9e43ee0d 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:24:44 devstack sudo[98629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-33ac0c8a-d0c6-4d2e-bad9-fd8a9e43ee0d 1073741824 Jul 22 03:24:44 devstack sudo[98629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:24:44 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-d78ce6f5-1a76-4712-89be-840c9e343a75 tempest-GroupSnapshotsTest-172189020 None] group_snapshot bddd988e-f84f-41d0-a6a5-9f03c92691a3: created successfully Jul 22 03:24:45 devstack sudo[98629]: pam_unix(sudo:session): session closed for user root Jul 22 03:24:45 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-4d97b258-1181-4bf7-9efd-ae82d4ee0bef tempest-VolumeDependencyTests-325487065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-33ac0c8a-d0c6-4d2e-bad9-fd8a9e43ee0d 1073741824" returned: 0 in 0.437s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:24:45 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-4d97b258-1181-4bf7-9efd-ae82d4ee0bef tempest-VolumeDependencyTests-325487065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-33ac0c8a-d0c6-4d2e-bad9-fd8a9e43ee0d {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:24:45 devstack sudo[98635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-33ac0c8a-d0c6-4d2e-bad9-fd8a9e43ee0d Jul 22 03:24:45 devstack sudo[98635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:24:45 devstack sudo[98635]: pam_unix(sudo:session): session closed for user root Jul 22 03:24:45 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-4d97b258-1181-4bf7-9efd-ae82d4ee0bef tempest-VolumeDependencyTests-325487065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-33ac0c8a-d0c6-4d2e-bad9-fd8a9e43ee0d" returned: 0 in 0.257s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:24:45 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-4d97b258-1181-4bf7-9efd-ae82d4ee0bef tempest-VolumeDependencyTests-325487065 None] <== create_volume: return (734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:24:45 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-4d97b258-1181-4bf7-9efd-ae82d4ee0bef tempest-VolumeDependencyTests-325487065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.737s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:24:45 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-4d97b258-1181-4bf7-9efd-ae82d4ee0bef tempest-VolumeDependencyTests-325487065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9623a4cd-26b4-4bbd-8887-aaf62e0e3a92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33ac0c8a-d0c6-4d2e-bad9-fd8a9e43ee0d', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:24:45 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-4d97b258-1181-4bf7-9efd-ae82d4ee0bef tempest-VolumeDependencyTests-325487065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5230ef07-64e4-412d-ae0f-004cffce78da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:24:45 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-4d97b258-1181-4bf7-9efd-ae82d4ee0bef tempest-VolumeDependencyTests-325487065 None] Volume volume-33ac0c8a-d0c6-4d2e-bad9-fd8a9e43ee0d (33ac0c8a-d0c6-4d2e-bad9-fd8a9e43ee0d): created successfully Jul 22 03:24:45 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-4d97b258-1181-4bf7-9efd-ae82d4ee0bef tempest-VolumeDependencyTests-325487065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5230ef07-64e4-412d-ae0f-004cffce78da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:24:45 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-4d97b258-1181-4bf7-9efd-ae82d4ee0bef tempest-VolumeDependencyTests-325487065 None] Flow 'volume_create_manager' (886f083f-be54-419c-a1aa-3e44b8ad7bb8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:24:45 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-4d97b258-1181-4bf7-9efd-ae82d4ee0bef tempest-VolumeDependencyTests-325487065 None] Created volume successfully. Jul 22 03:24:46 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b2c281b7-21d6-442f-9223-49ca93902708 tempest-GroupSnapshotsTest-172189020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:24:46 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b2c281b7-21d6-442f-9223-49ca93902708 tempest-GroupSnapshotsTest-172189020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:24:46 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-b2c281b7-21d6-442f-9223-49ca93902708 tempest-GroupSnapshotsTest-172189020 None] Acquiring lock "cinder-quobyte-3f966ad0-9b7b-4f0a-982d-8b14da66c73f-7a6fd8d4-fea9-4576-bfa2-3dea1e6ee8c8" by "_create_volume_from_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:24:46 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-b2c281b7-21d6-442f-9223-49ca93902708 tempest-GroupSnapshotsTest-172189020 None] Lock "cinder-quobyte-3f966ad0-9b7b-4f0a-982d-8b14da66c73f-7a6fd8d4-fea9-4576-bfa2-3dea1e6ee8c8" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:24:46 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-b2c281b7-21d6-442f-9223-49ca93902708 tempest-GroupSnapshotsTest-172189020 None] Creating volume 7a6fd8d4-fea9-4576-bfa2-3dea1e6ee8c8 from snapshot 3f966ad0-9b7b-4f0a-982d-8b14da66c73f {{(pid=87747) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 22 03:24:46 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b2c281b7-21d6-442f-9223-49ca93902708 tempest-GroupSnapshotsTest-172189020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:24:46 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b2c281b7-21d6-442f-9223-49ca93902708 tempest-GroupSnapshotsTest-172189020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:24:46 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-b2c281b7-21d6-442f-9223-49ca93902708 tempest-GroupSnapshotsTest-172189020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:24:46 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-b2c281b7-21d6-442f-9223-49ca93902708 tempest-GroupSnapshotsTest-172189020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:24:46 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b2c281b7-21d6-442f-9223-49ca93902708 tempest-GroupSnapshotsTest-172189020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:24:46 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-b2c281b7-21d6-442f-9223-49ca93902708 tempest-GroupSnapshotsTest-172189020 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:24:46 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-b2c281b7-21d6-442f-9223-49ca93902708 tempest-GroupSnapshotsTest-172189020 None] Acquiring lock "cinder-quobyte-7a6fd8d4-fea9-4576-bfa2-3dea1e6ee8c8" by "_copy_volume_from_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:24:46 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-b2c281b7-21d6-442f-9223-49ca93902708 tempest-GroupSnapshotsTest-172189020 None] Lock "cinder-quobyte-7a6fd8d4-fea9-4576-bfa2-3dea1e6ee8c8" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:24:46 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-b2c281b7-21d6-442f-9223-49ca93902708 tempest-GroupSnapshotsTest-172189020 None] snapshot: 3f966ad0-9b7b-4f0a-982d-8b14da66c73f, volume: 7a6fd8d4-fea9-4576-bfa2-3dea1e6ee8c8, {{(pid=87747) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 22 03:24:46 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b2c281b7-21d6-442f-9223-49ca93902708 tempest-GroupSnapshotsTest-172189020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:24:46 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b2c281b7-21d6-442f-9223-49ca93902708 tempest-GroupSnapshotsTest-172189020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:24:46 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-b2c281b7-21d6-442f-9223-49ca93902708 tempest-GroupSnapshotsTest-172189020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:24:46 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-b2c281b7-21d6-442f-9223-49ca93902708 tempest-GroupSnapshotsTest-172189020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:24:46 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b2c281b7-21d6-442f-9223-49ca93902708 tempest-GroupSnapshotsTest-172189020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:24:46 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[de27f9bf-c846-4bc0-93b5-e50d0cf3be5c]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:24:46 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b2c281b7-21d6-442f-9223-49ca93902708 tempest-GroupSnapshotsTest-172189020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9d8b2d63-1a4b-4b61-b5ff-3abd68277210.3f966ad0-9b7b-4f0a-982d-8b14da66c73f {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:24:46 devstack sudo[98638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9d8b2d63-1a4b-4b61-b5ff-3abd68277210.3f966ad0-9b7b-4f0a-982d-8b14da66c73f Jul 22 03:24:46 devstack sudo[98638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:24:46 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-63f8fc1b-e5c3-4709-ace8-967e84dd8f0e tempest-VolumeDependencyTests-325487065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:24:46 devstack sudo[98638]: pam_unix(sudo:session): session closed for user root Jul 22 03:24:46 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b2c281b7-21d6-442f-9223-49ca93902708 tempest-GroupSnapshotsTest-172189020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9d8b2d63-1a4b-4b61-b5ff-3abd68277210.3f966ad0-9b7b-4f0a-982d-8b14da66c73f" returned: 0 in 0.509s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:24:46 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-b2c281b7-21d6-442f-9223-49ca93902708 tempest-GroupSnapshotsTest-172189020 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d8b2d63-1a4b-4b61-b5ff-3abd68277210(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87747) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 03:24:46 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-b2c281b7-21d6-442f-9223-49ca93902708 tempest-GroupSnapshotsTest-172189020 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9d8b2d63-1a4b-4b61-b5ff-3abd68277210 {{(pid=87747) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 22 03:24:46 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-b2c281b7-21d6-442f-9223-49ca93902708 tempest-GroupSnapshotsTest-172189020 None] Creating direct copy from snapshot {{(pid=87747) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 22 03:24:46 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[5908b26e-0fc2-4468-8b86-b1254228386c]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:24:46 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b2c281b7-21d6-442f-9223-49ca93902708 tempest-GroupSnapshotsTest-172189020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9d8b2d63-1a4b-4b61-b5ff-3abd68277210 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:24:46 devstack sudo[98643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9d8b2d63-1a4b-4b61-b5ff-3abd68277210 Jul 22 03:24:46 devstack sudo[98643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:24:47 devstack sudo[98643]: pam_unix(sudo:session): session closed for user root Jul 22 03:24:47 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b2c281b7-21d6-442f-9223-49ca93902708 tempest-GroupSnapshotsTest-172189020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9d8b2d63-1a4b-4b61-b5ff-3abd68277210" returned: 0 in 0.378s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:24:47 devstack cinder-volume[87747]: DEBUG cinder.utils [None req-b2c281b7-21d6-442f-9223-49ca93902708 tempest-GroupSnapshotsTest-172189020 None] Path /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-7a6fd8d4-fea9-4576-bfa2-3dea1e6ee8c8 not found in is_blk_device check {{(pid=87747) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 22 03:24:47 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b2c281b7-21d6-442f-9223-49ca93902708 tempest-GroupSnapshotsTest-172189020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9d8b2d63-1a4b-4b61-b5ff-3abd68277210 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-7a6fd8d4-fea9-4576-bfa2-3dea1e6ee8c8 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:24:47 devstack sudo[98648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9d8b2d63-1a4b-4b61-b5ff-3abd68277210 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-7a6fd8d4-fea9-4576-bfa2-3dea1e6ee8c8 Jul 22 03:24:47 devstack sudo[98648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:24:52 devstack sudo[98648]: pam_unix(sudo:session): session closed for user root Jul 22 03:24:52 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b2c281b7-21d6-442f-9223-49ca93902708 tempest-GroupSnapshotsTest-172189020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9d8b2d63-1a4b-4b61-b5ff-3abd68277210 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-7a6fd8d4-fea9-4576-bfa2-3dea1e6ee8c8" returned: 0 in 5.206s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:24:52 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[89961c96-8de4-478c-9ca4-5a7ca50b64d7]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:24:52 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b2c281b7-21d6-442f-9223-49ca93902708 tempest-GroupSnapshotsTest-172189020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9d8b2d63-1a4b-4b61-b5ff-3abd68277210 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:24:52 devstack sudo[98661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9d8b2d63-1a4b-4b61-b5ff-3abd68277210 Jul 22 03:24:52 devstack sudo[98661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:24:52 devstack sudo[98661]: pam_unix(sudo:session): session closed for user root Jul 22 03:24:52 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b2c281b7-21d6-442f-9223-49ca93902708 tempest-GroupSnapshotsTest-172189020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9d8b2d63-1a4b-4b61-b5ff-3abd68277210" returned: 0 in 0.604s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:24:52 devstack cinder-volume[87747]: DEBUG cinder.image.image_utils [None req-b2c281b7-21d6-442f-9223-49ca93902708 tempest-GroupSnapshotsTest-172189020 None] Image conversion details: src /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9d8b2d63-1a4b-4b61-b5ff-3abd68277210, size 1024.00 MB, duration 5.21 sec, destination /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-7a6fd8d4-fea9-4576-bfa2-3dea1e6ee8c8 {{(pid=87747) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 22 03:24:52 devstack cinder-volume[87747]: INFO cinder.image.image_utils [None req-b2c281b7-21d6-442f-9223-49ca93902708 tempest-GroupSnapshotsTest-172189020 None] Converted 1024.00 MB image at 196.64 MB/s Jul 22 03:24:52 devstack cinder-volume[87747]: WARNING cinder.volume.drivers.remotefs [None req-b2c281b7-21d6-442f-9223-49ca93902708 tempest-GroupSnapshotsTest-172189020 None] /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-7a6fd8d4-fea9-4576-bfa2-3dea1e6ee8c8 is being set with open permissions: ugo+rw: NotImplementedError Jul 22 03:24:52 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b2c281b7-21d6-442f-9223-49ca93902708 tempest-GroupSnapshotsTest-172189020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-7a6fd8d4-fea9-4576-bfa2-3dea1e6ee8c8 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:24:52 devstack sudo[98666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-7a6fd8d4-fea9-4576-bfa2-3dea1e6ee8c8 Jul 22 03:24:52 devstack sudo[98666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:24:53 devstack sudo[98666]: pam_unix(sudo:session): session closed for user root Jul 22 03:24:53 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b2c281b7-21d6-442f-9223-49ca93902708 tempest-GroupSnapshotsTest-172189020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-7a6fd8d4-fea9-4576-bfa2-3dea1e6ee8c8" returned: 0 in 0.261s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:24:53 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-b2c281b7-21d6-442f-9223-49ca93902708 tempest-GroupSnapshotsTest-172189020 None] Lock "cinder-quobyte-7a6fd8d4-fea9-4576-bfa2-3dea1e6ee8c8" released by "_copy_volume_from_snapshot" :: held 7.058s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:24:53 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-b2c281b7-21d6-442f-9223-49ca93902708 tempest-GroupSnapshotsTest-172189020 None] Lock "cinder-quobyte-3f966ad0-9b7b-4f0a-982d-8b14da66c73f-7a6fd8d4-fea9-4576-bfa2-3dea1e6ee8c8" released by "_create_volume_from_snapshot" :: held 7.096s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:24:53 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b2c281b7-21d6-442f-9223-49ca93902708 tempest-GroupSnapshotsTest-172189020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.115s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:24:53 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-63f8fc1b-e5c3-4709-ace8-967e84dd8f0e tempest-VolumeDependencyTests-325487065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.552s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:24:53 devstack cinder-volume[87747]: DEBUG dbcounter [-] [87747] Writing DB stats cinder:SELECT=144,cinder:UPDATE=167,cinder:DELETE=13,cinder:INSERT=45 {{(pid=87747) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 03:24:53 devstack cinder-volume[87747]: DEBUG dbcounter [-] [87747] Writing DB stats cinder:SELECT=156,cinder:UPDATE=170,cinder:INSERT=43,cinder:DELETE=14 {{(pid=87747) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 03:24:53 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-63f8fc1b-e5c3-4709-ace8-967e84dd8f0e tempest-VolumeDependencyTests-325487065 None] Creating offline snapshot 3009672a-6d71-4f90-b4ca-34e547782728 of volume 33ac0c8a-d0c6-4d2e-bad9-fd8a9e43ee0d {{(pid=87747) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 03:24:53 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[af9607f9-13b1-40fc-aa90-b4e28eebca4f]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:24:53 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-63f8fc1b-e5c3-4709-ace8-967e84dd8f0e tempest-VolumeDependencyTests-325487065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-33ac0c8a-d0c6-4d2e-bad9-fd8a9e43ee0d {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:24:53 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-b2c281b7-21d6-442f-9223-49ca93902708 tempest-GroupSnapshotsTest-172189020 None] Create group from source-snapshot-bddd988e-f84f-41d0-a6a5-9f03c92691a3 completed successfully. Jul 22 03:24:53 devstack sudo[98670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-33ac0c8a-d0c6-4d2e-bad9-fd8a9e43ee0d Jul 22 03:24:53 devstack sudo[98670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:24:53 devstack sudo[98670]: pam_unix(sudo:session): session closed for user root Jul 22 03:24:53 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-63f8fc1b-e5c3-4709-ace8-967e84dd8f0e tempest-VolumeDependencyTests-325487065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-33ac0c8a-d0c6-4d2e-bad9-fd8a9e43ee0d" returned: 0 in 0.473s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:24:53 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-63f8fc1b-e5c3-4709-ace8-967e84dd8f0e tempest-VolumeDependencyTests-325487065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-33ac0c8a-d0c6-4d2e-bad9-fd8a9e43ee0d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-33ac0c8a-d0c6-4d2e-bad9-fd8a9e43ee0d.3009672a-6d71-4f90-b4ca-34e547782728 1G {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:24:53 devstack sudo[98676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-33ac0c8a-d0c6-4d2e-bad9-fd8a9e43ee0d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-33ac0c8a-d0c6-4d2e-bad9-fd8a9e43ee0d.3009672a-6d71-4f90-b4ca-34e547782728 1G Jul 22 03:24:53 devstack sudo[98676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:24:54 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-371f2e51-242c-4601-9303-1f1c9347c313 tempest-GroupSnapshotsTest-172189020 None] Acquiring lock "cinder-quobyte-7a6fd8d4-fea9-4576-bfa2-3dea1e6ee8c8" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:24:54 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-371f2e51-242c-4601-9303-1f1c9347c313 tempest-GroupSnapshotsTest-172189020 None] Lock "cinder-quobyte-7a6fd8d4-fea9-4576-bfa2-3dea1e6ee8c8" acquired by "delete_volume" :: waited 0.030s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:24:54 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[776e713f-07e2-477b-ac08-71b224dd9ddc]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:24:54 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-371f2e51-242c-4601-9303-1f1c9347c313 tempest-GroupSnapshotsTest-172189020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-7a6fd8d4-fea9-4576-bfa2-3dea1e6ee8c8 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:24:54 devstack sudo[98681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-7a6fd8d4-fea9-4576-bfa2-3dea1e6ee8c8 Jul 22 03:24:54 devstack sudo[98681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:24:54 devstack sudo[98676]: pam_unix(sudo:session): session closed for user root Jul 22 03:24:54 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-63f8fc1b-e5c3-4709-ace8-967e84dd8f0e tempest-VolumeDependencyTests-325487065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-33ac0c8a-d0c6-4d2e-bad9-fd8a9e43ee0d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-33ac0c8a-d0c6-4d2e-bad9-fd8a9e43ee0d.3009672a-6d71-4f90-b4ca-34e547782728 1G" returned: 0 in 0.599s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:24:54 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-63f8fc1b-e5c3-4709-ace8-967e84dd8f0e tempest-VolumeDependencyTests-325487065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33ac0c8a-d0c6-4d2e-bad9-fd8a9e43ee0d -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-33ac0c8a-d0c6-4d2e-bad9-fd8a9e43ee0d.3009672a-6d71-4f90-b4ca-34e547782728 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:24:54 devstack sudo[98683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33ac0c8a-d0c6-4d2e-bad9-fd8a9e43ee0d -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-33ac0c8a-d0c6-4d2e-bad9-fd8a9e43ee0d.3009672a-6d71-4f90-b4ca-34e547782728 Jul 22 03:24:54 devstack sudo[98683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:24:54 devstack sudo[98681]: pam_unix(sudo:session): session closed for user root Jul 22 03:24:54 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-371f2e51-242c-4601-9303-1f1c9347c313 tempest-GroupSnapshotsTest-172189020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-7a6fd8d4-fea9-4576-bfa2-3dea1e6ee8c8" returned: 0 in 0.455s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:24:54 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-371f2e51-242c-4601-9303-1f1c9347c313 tempest-GroupSnapshotsTest-172189020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-7a6fd8d4-fea9-4576-bfa2-3dea1e6ee8c8 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:24:54 devstack sudo[98689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-7a6fd8d4-fea9-4576-bfa2-3dea1e6ee8c8 Jul 22 03:24:54 devstack sudo[98689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:24:54 devstack sudo[98683]: pam_unix(sudo:session): session closed for user root Jul 22 03:24:54 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-63f8fc1b-e5c3-4709-ace8-967e84dd8f0e tempest-VolumeDependencyTests-325487065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33ac0c8a-d0c6-4d2e-bad9-fd8a9e43ee0d -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-33ac0c8a-d0c6-4d2e-bad9-fd8a9e43ee0d.3009672a-6d71-4f90-b4ca-34e547782728" returned: 0 in 0.323s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:24:54 devstack cinder-volume[87747]: WARNING cinder.volume.drivers.remotefs [None req-63f8fc1b-e5c3-4709-ace8-967e84dd8f0e tempest-VolumeDependencyTests-325487065 None] /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-33ac0c8a-d0c6-4d2e-bad9-fd8a9e43ee0d.3009672a-6d71-4f90-b4ca-34e547782728 is being set with open permissions: ugo+rw Jul 22 03:24:54 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-63f8fc1b-e5c3-4709-ace8-967e84dd8f0e tempest-VolumeDependencyTests-325487065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-33ac0c8a-d0c6-4d2e-bad9-fd8a9e43ee0d.3009672a-6d71-4f90-b4ca-34e547782728 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:24:54 devstack sudo[98694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-33ac0c8a-d0c6-4d2e-bad9-fd8a9e43ee0d.3009672a-6d71-4f90-b4ca-34e547782728 Jul 22 03:24:54 devstack sudo[98694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:24:54 devstack sudo[98689]: pam_unix(sudo:session): session closed for user root Jul 22 03:24:54 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-371f2e51-242c-4601-9303-1f1c9347c313 tempest-GroupSnapshotsTest-172189020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-7a6fd8d4-fea9-4576-bfa2-3dea1e6ee8c8" returned: 0 in 0.287s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:24:54 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-371f2e51-242c-4601-9303-1f1c9347c313 tempest-GroupSnapshotsTest-172189020 None] Lock "cinder-quobyte-7a6fd8d4-fea9-4576-bfa2-3dea1e6ee8c8" released by "delete_volume" :: held 0.796s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:24:54 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-371f2e51-242c-4601-9303-1f1c9347c313 tempest-GroupSnapshotsTest-172189020 None] Created reservations ['a70ff638-2706-465b-86cf-429bf70b098d'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:24:54 devstack sudo[98694]: pam_unix(sudo:session): session closed for user root Jul 22 03:24:54 devstack cinder-volume[87747]: WARNING cinder.quota [None req-371f2e51-242c-4601-9303-1f1c9347c313 tempest-GroupSnapshotsTest-172189020 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1798860600 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1798860600, it is now deprecated. Please use the default quota class for default quota. Jul 22 03:24:54 devstack cinder-volume[87747]: WARNING cinder.quota [None req-371f2e51-242c-4601-9303-1f1c9347c313 tempest-GroupSnapshotsTest-172189020 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1798860600 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1798860600, it is now deprecated. Please use the default quota class for default quota. Jul 22 03:24:55 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-63f8fc1b-e5c3-4709-ace8-967e84dd8f0e tempest-VolumeDependencyTests-325487065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-33ac0c8a-d0c6-4d2e-bad9-fd8a9e43ee0d.3009672a-6d71-4f90-b4ca-34e547782728" returned: 0 in 0.304s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:24:55 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-371f2e51-242c-4601-9303-1f1c9347c313 tempest-GroupSnapshotsTest-172189020 None] Created reservations ['eb01e7e3-47fa-4f50-a511-acb33ac6e5ef', '0214a2ab-9819-4458-a424-a40aa8469e34', '0ac29344-8ced-4d80-9b66-3d620a19cd3f', '17f7ef7d-16bc-464e-b832-5f17e360442c'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:24:55 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-63f8fc1b-e5c3-4709-ace8-967e84dd8f0e tempest-VolumeDependencyTests-325487065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-33ac0c8a-d0c6-4d2e-bad9-fd8a9e43ee0d.info {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:24:55 devstack sudo[98698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-33ac0c8a-d0c6-4d2e-bad9-fd8a9e43ee0d.info Jul 22 03:24:55 devstack sudo[98698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:24:55 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-371f2e51-242c-4601-9303-1f1c9347c313 tempest-GroupSnapshotsTest-172189020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:24:55 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-371f2e51-242c-4601-9303-1f1c9347c313 tempest-GroupSnapshotsTest-172189020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:24:55 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-371f2e51-242c-4601-9303-1f1c9347c313 tempest-GroupSnapshotsTest-172189020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:24:55 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-371f2e51-242c-4601-9303-1f1c9347c313 tempest-GroupSnapshotsTest-172189020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:24:55 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-371f2e51-242c-4601-9303-1f1c9347c313 tempest-GroupSnapshotsTest-172189020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:24:55 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-371f2e51-242c-4601-9303-1f1c9347c313 tempest-GroupSnapshotsTest-172189020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:24:55 devstack sudo[98700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:24:55 devstack sudo[98700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:24:55 devstack sudo[98698]: pam_unix(sudo:session): session closed for user root Jul 22 03:24:55 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-63f8fc1b-e5c3-4709-ace8-967e84dd8f0e tempest-VolumeDependencyTests-325487065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-33ac0c8a-d0c6-4d2e-bad9-fd8a9e43ee0d.info" returned: 0 in 0.338s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:24:55 devstack cinder-volume[87747]: WARNING cinder.volume.drivers.remotefs [None req-63f8fc1b-e5c3-4709-ace8-967e84dd8f0e tempest-VolumeDependencyTests-325487065 None] /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-33ac0c8a-d0c6-4d2e-bad9-fd8a9e43ee0d.info is being set with open permissions: ugo+rw Jul 22 03:24:55 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-63f8fc1b-e5c3-4709-ace8-967e84dd8f0e tempest-VolumeDependencyTests-325487065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-33ac0c8a-d0c6-4d2e-bad9-fd8a9e43ee0d.info {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:24:55 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-f63e7bf4-0700-4b6e-9d7f-543a4a4b1402 tempest-GroupSnapshotsTest-172189020 None] group_snapshot bddd988e-f84f-41d0-a6a5-9f03c92691a3: deleting Jul 22 03:24:55 devstack sudo[98703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-33ac0c8a-d0c6-4d2e-bad9-fd8a9e43ee0d.info Jul 22 03:24:55 devstack sudo[98703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:24:55 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f63e7bf4-0700-4b6e-9d7f-543a4a4b1402 tempest-GroupSnapshotsTest-172189020 None] group_snapshot bddd988e-f84f-41d0-a6a5-9f03c92691a3: deleting {{(pid=87747) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 22 03:24:55 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-f63e7bf4-0700-4b6e-9d7f-543a4a4b1402 tempest-GroupSnapshotsTest-172189020 None] Acquiring lock "cinder-quobyte-9d8b2d63-1a4b-4b61-b5ff-3abd68277210" by "delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:24:55 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-f63e7bf4-0700-4b6e-9d7f-543a4a4b1402 tempest-GroupSnapshotsTest-172189020 None] Lock "cinder-quobyte-9d8b2d63-1a4b-4b61-b5ff-3abd68277210" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:24:55 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-f63e7bf4-0700-4b6e-9d7f-543a4a4b1402 tempest-GroupSnapshotsTest-172189020 None] Acquiring lock "cinder-quobyte-3f966ad0-9b7b-4f0a-982d-8b14da66c73f" by "_delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:24:55 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-f63e7bf4-0700-4b6e-9d7f-543a4a4b1402 tempest-GroupSnapshotsTest-172189020 None] Lock "cinder-quobyte-3f966ad0-9b7b-4f0a-982d-8b14da66c73f" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:24:55 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-f63e7bf4-0700-4b6e-9d7f-543a4a4b1402 tempest-GroupSnapshotsTest-172189020 None] Deleting offline snapshot 3f966ad0-9b7b-4f0a-982d-8b14da66c73f of volume 9d8b2d63-1a4b-4b61-b5ff-3abd68277210 {{(pid=87747) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 03:24:55 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-f63e7bf4-0700-4b6e-9d7f-543a4a4b1402 tempest-GroupSnapshotsTest-172189020 None] snapshot_file for this snap is: volume-9d8b2d63-1a4b-4b61-b5ff-3abd68277210.3f966ad0-9b7b-4f0a-982d-8b14da66c73f {{(pid=87747) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 03:24:55 devstack sudo[98700]: pam_unix(sudo:session): session closed for user root Jul 22 03:24:55 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-371f2e51-242c-4601-9303-1f1c9347c313 tempest-GroupSnapshotsTest-172189020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.425s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:24:55 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-371f2e51-242c-4601-9303-1f1c9347c313 tempest-GroupSnapshotsTest-172189020 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:24:55 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-371f2e51-242c-4601-9303-1f1c9347c313 tempest-GroupSnapshotsTest-172189020 None] Delete group completed successfully. Jul 22 03:24:55 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1e295e7-6e38-4187-a22f-4e430c8ace74]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:24:55 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f63e7bf4-0700-4b6e-9d7f-543a4a4b1402 tempest-GroupSnapshotsTest-172189020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9d8b2d63-1a4b-4b61-b5ff-3abd68277210.3f966ad0-9b7b-4f0a-982d-8b14da66c73f {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:24:55 devstack sudo[98706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9d8b2d63-1a4b-4b61-b5ff-3abd68277210.3f966ad0-9b7b-4f0a-982d-8b14da66c73f Jul 22 03:24:55 devstack sudo[98706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:24:55 devstack sudo[98703]: pam_unix(sudo:session): session closed for user root Jul 22 03:24:55 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-63f8fc1b-e5c3-4709-ace8-967e84dd8f0e tempest-VolumeDependencyTests-325487065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-33ac0c8a-d0c6-4d2e-bad9-fd8a9e43ee0d.info" returned: 0 in 0.361s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:24:55 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-63f8fc1b-e5c3-4709-ace8-967e84dd8f0e tempest-VolumeDependencyTests-325487065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.539s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:24:55 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-63f8fc1b-e5c3-4709-ace8-967e84dd8f0e tempest-VolumeDependencyTests-325487065 None] Create snapshot completed successfully Jul 22 03:24:55 devstack sudo[98706]: pam_unix(sudo:session): session closed for user root Jul 22 03:24:55 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f63e7bf4-0700-4b6e-9d7f-543a4a4b1402 tempest-GroupSnapshotsTest-172189020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9d8b2d63-1a4b-4b61-b5ff-3abd68277210.3f966ad0-9b7b-4f0a-982d-8b14da66c73f" returned: 0 in 0.378s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:24:55 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-f63e7bf4-0700-4b6e-9d7f-543a4a4b1402 tempest-GroupSnapshotsTest-172189020 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d8b2d63-1a4b-4b61-b5ff-3abd68277210(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87747) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 03:24:56 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[773386bf-4862-46dd-9301-d0a6f4058e34]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:24:56 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f63e7bf4-0700-4b6e-9d7f-543a4a4b1402 tempest-GroupSnapshotsTest-172189020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9d8b2d63-1a4b-4b61-b5ff-3abd68277210 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:24:56 devstack sudo[98713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9d8b2d63-1a4b-4b61-b5ff-3abd68277210 Jul 22 03:24:56 devstack sudo[98713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:24:56 devstack sudo[98713]: pam_unix(sudo:session): session closed for user root Jul 22 03:24:56 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f63e7bf4-0700-4b6e-9d7f-543a4a4b1402 tempest-GroupSnapshotsTest-172189020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9d8b2d63-1a4b-4b61-b5ff-3abd68277210" returned: 0 in 0.399s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:24:56 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f63e7bf4-0700-4b6e-9d7f-543a4a4b1402 tempest-GroupSnapshotsTest-172189020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9d8b2d63-1a4b-4b61-b5ff-3abd68277210.3f966ad0-9b7b-4f0a-982d-8b14da66c73f {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:24:56 devstack sudo[98718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9d8b2d63-1a4b-4b61-b5ff-3abd68277210.3f966ad0-9b7b-4f0a-982d-8b14da66c73f Jul 22 03:24:56 devstack sudo[98718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:24:56 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d8e2d5a-f030-4c9b-8494-81c76874db44 tempest-VolumeDependencyTests-325487065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:24:56 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-1d8e2d5a-f030-4c9b-8494-81c76874db44 tempest-VolumeDependencyTests-325487065 None] Flow 'volume_create_manager' (43c23405-8c14-41f6-ae56-6631f91570a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:24:56 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-1d8e2d5a-f030-4c9b-8494-81c76874db44 tempest-VolumeDependencyTests-325487065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dfb3489-4e26-4d13-94fd-c7c8ce0fd9cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:24:56 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-1d8e2d5a-f030-4c9b-8494-81c76874db44 tempest-VolumeDependencyTests-325487065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dfb3489-4e26-4d13-94fd-c7c8ce0fd9cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:24:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-441110699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c28f4c9f-3068-4c70-9e29-4d97a6f48dd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='205c4ddc28874d5b8b1b539704d4e0ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:24:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3009672a-6d71-4f90-b4ca-34e547782728,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:24:57Z,use_quota=True,user_id='2bfeeb6e59c347a391750eae848d8892',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:24:56 devstack sudo[98718]: pam_unix(sudo:session): session closed for user root Jul 22 03:24:56 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-1d8e2d5a-f030-4c9b-8494-81c76874db44 tempest-VolumeDependencyTests-325487065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13cd8ca8-b215-487f-b91a-993fbf4aa2b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:24:56 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-1d8e2d5a-f030-4c9b-8494-81c76874db44 tempest-VolumeDependencyTests-325487065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13cd8ca8-b215-487f-b91a-993fbf4aa2b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:24:56 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-1d8e2d5a-f030-4c9b-8494-81c76874db44 tempest-VolumeDependencyTests-325487065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f901013b-ddd5-4d51-91b6-c78256ea6914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:24:56 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-1d8e2d5a-f030-4c9b-8494-81c76874db44 tempest-VolumeDependencyTests-325487065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f901013b-ddd5-4d51-91b6-c78256ea6914) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c28f4c9f-3068-4c70-9e29-4d97a6f48dd7', 'volume_name': 'volume-c28f4c9f-3068-4c70-9e29-4d97a6f48dd7', 'volume_size': 1, 'snapshot_id': '3009672a-6d71-4f90-b4ca-34e547782728'}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:24:56 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-1d8e2d5a-f030-4c9b-8494-81c76874db44 tempest-VolumeDependencyTests-325487065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ca21ce3-adc9-4413-bafa-3a1d96bd3eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:24:56 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-1d8e2d5a-f030-4c9b-8494-81c76874db44 tempest-VolumeDependencyTests-325487065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ca21ce3-adc9-4413-bafa-3a1d96bd3eb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:24:56 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-1d8e2d5a-f030-4c9b-8494-81c76874db44 tempest-VolumeDependencyTests-325487065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c08bc4e6-ef39-49f4-8cce-dc5c3de61b08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:24:56 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-1d8e2d5a-f030-4c9b-8494-81c76874db44 tempest-VolumeDependencyTests-325487065 None] Volume c28f4c9f-3068-4c70-9e29-4d97a6f48dd7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c28f4c9f-3068-4c70-9e29-4d97a6f48dd7', 'volume_size': 1, 'snapshot_id': '3009672a-6d71-4f90-b4ca-34e547782728'} Jul 22 03:24:56 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f63e7bf4-0700-4b6e-9d7f-543a4a4b1402 tempest-GroupSnapshotsTest-172189020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9d8b2d63-1a4b-4b61-b5ff-3abd68277210.3f966ad0-9b7b-4f0a-982d-8b14da66c73f" returned: 0 in 0.462s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:24:56 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f63e7bf4-0700-4b6e-9d7f-543a4a4b1402 tempest-GroupSnapshotsTest-172189020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9d8b2d63-1a4b-4b61-b5ff-3abd68277210.3f966ad0-9b7b-4f0a-982d-8b14da66c73f {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:24:56 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-1d8e2d5a-f030-4c9b-8494-81c76874db44 tempest-VolumeDependencyTests-325487065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:24:56 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-1d8e2d5a-f030-4c9b-8494-81c76874db44 tempest-VolumeDependencyTests-325487065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:24:56 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-1d8e2d5a-f030-4c9b-8494-81c76874db44 tempest-VolumeDependencyTests-325487065 None] Acquiring lock "cinder-quobyte-3009672a-6d71-4f90-b4ca-34e547782728-c28f4c9f-3068-4c70-9e29-4d97a6f48dd7" by "_create_volume_from_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:24:56 devstack sudo[98724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9d8b2d63-1a4b-4b61-b5ff-3abd68277210.3f966ad0-9b7b-4f0a-982d-8b14da66c73f Jul 22 03:24:56 devstack sudo[98724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:24:56 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-1d8e2d5a-f030-4c9b-8494-81c76874db44 tempest-VolumeDependencyTests-325487065 None] Lock "cinder-quobyte-3009672a-6d71-4f90-b4ca-34e547782728-c28f4c9f-3068-4c70-9e29-4d97a6f48dd7" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:24:56 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-1d8e2d5a-f030-4c9b-8494-81c76874db44 tempest-VolumeDependencyTests-325487065 None] Creating volume c28f4c9f-3068-4c70-9e29-4d97a6f48dd7 from snapshot 3009672a-6d71-4f90-b4ca-34e547782728 {{(pid=87747) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 22 03:24:56 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-1d8e2d5a-f030-4c9b-8494-81c76874db44 tempest-VolumeDependencyTests-325487065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:24:56 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-1d8e2d5a-f030-4c9b-8494-81c76874db44 tempest-VolumeDependencyTests-325487065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:24:56 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-1d8e2d5a-f030-4c9b-8494-81c76874db44 tempest-VolumeDependencyTests-325487065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:24:56 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-1d8e2d5a-f030-4c9b-8494-81c76874db44 tempest-VolumeDependencyTests-325487065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:24:56 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-1d8e2d5a-f030-4c9b-8494-81c76874db44 tempest-VolumeDependencyTests-325487065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:24:56 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-1d8e2d5a-f030-4c9b-8494-81c76874db44 tempest-VolumeDependencyTests-325487065 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:24:56 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-1d8e2d5a-f030-4c9b-8494-81c76874db44 tempest-VolumeDependencyTests-325487065 None] Acquiring lock "cinder-quobyte-c28f4c9f-3068-4c70-9e29-4d97a6f48dd7" by "_copy_volume_from_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:24:56 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-1d8e2d5a-f030-4c9b-8494-81c76874db44 tempest-VolumeDependencyTests-325487065 None] Lock "cinder-quobyte-c28f4c9f-3068-4c70-9e29-4d97a6f48dd7" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:24:56 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-1d8e2d5a-f030-4c9b-8494-81c76874db44 tempest-VolumeDependencyTests-325487065 None] snapshot: 3009672a-6d71-4f90-b4ca-34e547782728, volume: c28f4c9f-3068-4c70-9e29-4d97a6f48dd7, {{(pid=87747) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 22 03:24:56 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-1d8e2d5a-f030-4c9b-8494-81c76874db44 tempest-VolumeDependencyTests-325487065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:24:56 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-1d8e2d5a-f030-4c9b-8494-81c76874db44 tempest-VolumeDependencyTests-325487065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:24:56 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-1d8e2d5a-f030-4c9b-8494-81c76874db44 tempest-VolumeDependencyTests-325487065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:24:56 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-1d8e2d5a-f030-4c9b-8494-81c76874db44 tempest-VolumeDependencyTests-325487065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:24:56 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-1d8e2d5a-f030-4c9b-8494-81c76874db44 tempest-VolumeDependencyTests-325487065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:24:57 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8051c3c-7fb9-4f25-99d0-f1e5f9d65a5d]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:24:57 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-1d8e2d5a-f030-4c9b-8494-81c76874db44 tempest-VolumeDependencyTests-325487065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-33ac0c8a-d0c6-4d2e-bad9-fd8a9e43ee0d.3009672a-6d71-4f90-b4ca-34e547782728 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:24:57 devstack sudo[98726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-33ac0c8a-d0c6-4d2e-bad9-fd8a9e43ee0d.3009672a-6d71-4f90-b4ca-34e547782728 Jul 22 03:24:57 devstack sudo[98726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:24:57 devstack sudo[98724]: pam_unix(sudo:session): session closed for user root Jul 22 03:24:57 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f63e7bf4-0700-4b6e-9d7f-543a4a4b1402 tempest-GroupSnapshotsTest-172189020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9d8b2d63-1a4b-4b61-b5ff-3abd68277210.3f966ad0-9b7b-4f0a-982d-8b14da66c73f" returned: 0 in 0.275s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:24:57 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-f63e7bf4-0700-4b6e-9d7f-543a4a4b1402 tempest-GroupSnapshotsTest-172189020 None] Lock "cinder-quobyte-3f966ad0-9b7b-4f0a-982d-8b14da66c73f" released by "_delete_snapshot" :: held 1.650s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:24:57 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-f63e7bf4-0700-4b6e-9d7f-543a4a4b1402 tempest-GroupSnapshotsTest-172189020 None] Lock "cinder-quobyte-9d8b2d63-1a4b-4b61-b5ff-3abd68277210" released by "delete_snapshot" :: held 1.684s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:24:57 devstack cinder-volume[87747]: WARNING cinder.quota [None req-f63e7bf4-0700-4b6e-9d7f-543a4a4b1402 tempest-GroupSnapshotsTest-172189020 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1798860600 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1798860600, it is now deprecated. Please use the default quota class for default quota. Jul 22 03:24:57 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-f63e7bf4-0700-4b6e-9d7f-543a4a4b1402 tempest-GroupSnapshotsTest-172189020 None] Created reservations ['dd54bd7d-ebae-4ef5-bcef-d4999fc9dd0b', '274af548-9812-490f-b268-38121d51c520', '54c21217-69c9-4079-a266-34b5b40a1728', '116c7932-0a6b-4a52-9c55-1167de6d588e'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:24:57 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-f63e7bf4-0700-4b6e-9d7f-543a4a4b1402 tempest-GroupSnapshotsTest-172189020 None] group_snapshot bddd988e-f84f-41d0-a6a5-9f03c92691a3: deleted successfully Jul 22 03:24:57 devstack sudo[98726]: pam_unix(sudo:session): session closed for user root Jul 22 03:24:57 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-1d8e2d5a-f030-4c9b-8494-81c76874db44 tempest-VolumeDependencyTests-325487065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-33ac0c8a-d0c6-4d2e-bad9-fd8a9e43ee0d.3009672a-6d71-4f90-b4ca-34e547782728" returned: 0 in 0.393s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:24:57 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-1d8e2d5a-f030-4c9b-8494-81c76874db44 tempest-VolumeDependencyTests-325487065 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-33ac0c8a-d0c6-4d2e-bad9-fd8a9e43ee0d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87747) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 03:24:57 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-1d8e2d5a-f030-4c9b-8494-81c76874db44 tempest-VolumeDependencyTests-325487065 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-33ac0c8a-d0c6-4d2e-bad9-fd8a9e43ee0d {{(pid=87747) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 22 03:24:57 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-1d8e2d5a-f030-4c9b-8494-81c76874db44 tempest-VolumeDependencyTests-325487065 None] Creating direct copy from snapshot {{(pid=87747) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 22 03:24:57 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ead61ba-cce7-40ea-9d5e-66a006984bb6]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:24:57 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-1d8e2d5a-f030-4c9b-8494-81c76874db44 tempest-VolumeDependencyTests-325487065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-33ac0c8a-d0c6-4d2e-bad9-fd8a9e43ee0d {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:24:57 devstack sudo[98732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-33ac0c8a-d0c6-4d2e-bad9-fd8a9e43ee0d Jul 22 03:24:57 devstack sudo[98732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:24:57 devstack sudo[98732]: pam_unix(sudo:session): session closed for user root Jul 22 03:24:57 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-1d8e2d5a-f030-4c9b-8494-81c76874db44 tempest-VolumeDependencyTests-325487065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-33ac0c8a-d0c6-4d2e-bad9-fd8a9e43ee0d" returned: 0 in 0.372s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:24:57 devstack cinder-volume[87747]: DEBUG cinder.utils [None req-1d8e2d5a-f030-4c9b-8494-81c76874db44 tempest-VolumeDependencyTests-325487065 None] Path /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c28f4c9f-3068-4c70-9e29-4d97a6f48dd7 not found in is_blk_device check {{(pid=87747) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 22 03:24:57 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-1d8e2d5a-f030-4c9b-8494-81c76874db44 tempest-VolumeDependencyTests-325487065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-33ac0c8a-d0c6-4d2e-bad9-fd8a9e43ee0d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c28f4c9f-3068-4c70-9e29-4d97a6f48dd7 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:24:57 devstack sudo[98740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-33ac0c8a-d0c6-4d2e-bad9-fd8a9e43ee0d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c28f4c9f-3068-4c70-9e29-4d97a6f48dd7 Jul 22 03:24:57 devstack sudo[98740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:24:58 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-b63c60b0-b237-472b-9e80-fe64bc636c2f tempest-GroupSnapshotsTest-172189020 None] Acquiring lock "cinder-quobyte-9d8b2d63-1a4b-4b61-b5ff-3abd68277210" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:24:58 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-b63c60b0-b237-472b-9e80-fe64bc636c2f tempest-GroupSnapshotsTest-172189020 None] Lock "cinder-quobyte-9d8b2d63-1a4b-4b61-b5ff-3abd68277210" acquired by "delete_volume" :: waited 0.020s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:24:58 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[78dcc1d6-ecda-4910-9d65-aad63c24ebe4]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:24:58 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b63c60b0-b237-472b-9e80-fe64bc636c2f tempest-GroupSnapshotsTest-172189020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9d8b2d63-1a4b-4b61-b5ff-3abd68277210 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:24:58 devstack sudo[98745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9d8b2d63-1a4b-4b61-b5ff-3abd68277210 Jul 22 03:24:58 devstack sudo[98745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:24:59 devstack sudo[98745]: pam_unix(sudo:session): session closed for user root Jul 22 03:24:59 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b63c60b0-b237-472b-9e80-fe64bc636c2f tempest-GroupSnapshotsTest-172189020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9d8b2d63-1a4b-4b61-b5ff-3abd68277210" returned: 0 in 0.928s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:24:59 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b63c60b0-b237-472b-9e80-fe64bc636c2f tempest-GroupSnapshotsTest-172189020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9d8b2d63-1a4b-4b61-b5ff-3abd68277210 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:24:59 devstack sudo[98760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9d8b2d63-1a4b-4b61-b5ff-3abd68277210 Jul 22 03:24:59 devstack sudo[98760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:24:59 devstack sudo[98760]: pam_unix(sudo:session): session closed for user root Jul 22 03:24:59 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b63c60b0-b237-472b-9e80-fe64bc636c2f tempest-GroupSnapshotsTest-172189020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9d8b2d63-1a4b-4b61-b5ff-3abd68277210" returned: 0 in 0.650s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:24:59 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-b63c60b0-b237-472b-9e80-fe64bc636c2f tempest-GroupSnapshotsTest-172189020 None] Lock "cinder-quobyte-9d8b2d63-1a4b-4b61-b5ff-3abd68277210" released by "delete_volume" :: held 1.664s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:24:59 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-b63c60b0-b237-472b-9e80-fe64bc636c2f tempest-GroupSnapshotsTest-172189020 None] Created reservations ['a5d53018-c861-4cbb-94e6-b77bba1cc63b'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:25:00 devstack cinder-volume[87747]: WARNING cinder.db.api [None req-b63c60b0-b237-472b-9e80-fe64bc636c2f tempest-GroupSnapshotsTest-172189020 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1798860600'] Jul 22 03:25:00 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-b63c60b0-b237-472b-9e80-fe64bc636c2f tempest-GroupSnapshotsTest-172189020 None] Created reservations ['2a2858f7-5960-46ad-a5d6-d3b4b5b0dc7f', 'c74e88a0-599c-49bc-907e-27f6c16746df', '5d9adfee-f5a5-496b-9346-710c10918149', '481870e5-793d-4357-a2ba-94fb13c6a3c9'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:25:00 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b63c60b0-b237-472b-9e80-fe64bc636c2f tempest-GroupSnapshotsTest-172189020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:25:00 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b63c60b0-b237-472b-9e80-fe64bc636c2f tempest-GroupSnapshotsTest-172189020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:25:00 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-b63c60b0-b237-472b-9e80-fe64bc636c2f tempest-GroupSnapshotsTest-172189020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:25:00 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-b63c60b0-b237-472b-9e80-fe64bc636c2f tempest-GroupSnapshotsTest-172189020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:25:00 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b63c60b0-b237-472b-9e80-fe64bc636c2f tempest-GroupSnapshotsTest-172189020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:25:00 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b63c60b0-b237-472b-9e80-fe64bc636c2f tempest-GroupSnapshotsTest-172189020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:25:00 devstack sudo[98766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:25:00 devstack sudo[98766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:25:01 devstack sudo[98766]: pam_unix(sudo:session): session closed for user root Jul 22 03:25:01 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b63c60b0-b237-472b-9e80-fe64bc636c2f tempest-GroupSnapshotsTest-172189020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.689s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:25:01 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-b63c60b0-b237-472b-9e80-fe64bc636c2f tempest-GroupSnapshotsTest-172189020 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:25:01 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-b63c60b0-b237-472b-9e80-fe64bc636c2f tempest-GroupSnapshotsTest-172189020 None] Delete group completed successfully. Jul 22 03:25:01 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-8b653118-766b-4607-885d-a40d0a2d1f15 tempest-GroupSnapshotsTest-172189020 None] Group tempest-GroupSnapshotsTest-Group-1736082799: creating Jul 22 03:25:02 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-8b653118-766b-4607-885d-a40d0a2d1f15 tempest-GroupSnapshotsTest-172189020 None] Group tempest-GroupSnapshotsTest-Group-1736082799: created successfully Jul 22 03:25:02 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-8b653118-766b-4607-885d-a40d0a2d1f15 tempest-GroupSnapshotsTest-172189020 None] Create group completed successfully. Jul 22 03:25:03 devstack sudo[98740]: pam_unix(sudo:session): session closed for user root Jul 22 03:25:03 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-1d8e2d5a-f030-4c9b-8494-81c76874db44 tempest-VolumeDependencyTests-325487065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-33ac0c8a-d0c6-4d2e-bad9-fd8a9e43ee0d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c28f4c9f-3068-4c70-9e29-4d97a6f48dd7" returned: 0 in 6.015s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:25:03 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[e42a0640-17c5-41fe-8dbb-f344144846cc]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:25:03 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-1d8e2d5a-f030-4c9b-8494-81c76874db44 tempest-VolumeDependencyTests-325487065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-33ac0c8a-d0c6-4d2e-bad9-fd8a9e43ee0d {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:25:03 devstack sudo[99114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-33ac0c8a-d0c6-4d2e-bad9-fd8a9e43ee0d Jul 22 03:25:03 devstack sudo[99114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:25:04 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-b974e096-d471-4320-a98d-a3f5dc0493d3 tempest-GroupSnapshotsTest-172189020 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:25:04 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b974e096-d471-4320-a98d-a3f5dc0493d3 tempest-GroupSnapshotsTest-172189020 None] Flow 'volume_create_manager' (ac99e3d5-131e-42a7-8796-b8c47a6728be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:25:04 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b974e096-d471-4320-a98d-a3f5dc0493d3 tempest-GroupSnapshotsTest-172189020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1425e65c-bae1-4d58-b4a7-8e7d98b5a880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:25:04 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b974e096-d471-4320-a98d-a3f5dc0493d3 tempest-GroupSnapshotsTest-172189020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1425e65c-bae1-4d58-b4a7-8e7d98b5a880) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:25:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1861851320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=73f72f2d-21b1-4d57-9857-dd856371acdf,host='devstack@QuobyteHD#QuobyteHD',id=a69b0920-fdd0-4c2a-8463-2fc415c144f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a058032650974a56a4f1348c499a4293',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:25:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:25:04Z,use_quota=True,user_id='8b50bd7a480f42ac8ba487a2cd387e87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90d59d6a-b49b-4057-ad29-6728c0ee6d92),volume_type_id=90d59d6a-b49b-4057-ad29-6728c0ee6d92)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:25:04 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b974e096-d471-4320-a98d-a3f5dc0493d3 tempest-GroupSnapshotsTest-172189020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15ef9f09-72f3-4bea-8882-ae3ab209df07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:25:04 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b974e096-d471-4320-a98d-a3f5dc0493d3 tempest-GroupSnapshotsTest-172189020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15ef9f09-72f3-4bea-8882-ae3ab209df07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:25:04 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b974e096-d471-4320-a98d-a3f5dc0493d3 tempest-GroupSnapshotsTest-172189020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cb57a5d-0527-4c47-bbcd-a3fcb508ef93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:25:04 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b974e096-d471-4320-a98d-a3f5dc0493d3 tempest-GroupSnapshotsTest-172189020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cb57a5d-0527-4c47-bbcd-a3fcb508ef93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a69b0920-fdd0-4c2a-8463-2fc415c144f1', 'volume_name': 'volume-a69b0920-fdd0-4c2a-8463-2fc415c144f1', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:25:04 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b974e096-d471-4320-a98d-a3f5dc0493d3 tempest-GroupSnapshotsTest-172189020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (094bd5c3-3a09-4bec-af3c-194deb599551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:25:04 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b974e096-d471-4320-a98d-a3f5dc0493d3 tempest-GroupSnapshotsTest-172189020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (094bd5c3-3a09-4bec-af3c-194deb599551) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:25:04 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b974e096-d471-4320-a98d-a3f5dc0493d3 tempest-GroupSnapshotsTest-172189020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3348eff8-8077-4684-852d-e0ba0bf86510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:25:04 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-b974e096-d471-4320-a98d-a3f5dc0493d3 tempest-GroupSnapshotsTest-172189020 None] Volume a69b0920-fdd0-4c2a-8463-2fc415c144f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a69b0920-fdd0-4c2a-8463-2fc415c144f1', 'volume_size': 1} Jul 22 03:25:04 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b974e096-d471-4320-a98d-a3f5dc0493d3 tempest-GroupSnapshotsTest-172189020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:25:04 devstack sudo[99114]: pam_unix(sudo:session): session closed for user root Jul 22 03:25:04 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-1d8e2d5a-f030-4c9b-8494-81c76874db44 tempest-VolumeDependencyTests-325487065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-33ac0c8a-d0c6-4d2e-bad9-fd8a9e43ee0d" returned: 0 in 0.621s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:25:04 devstack cinder-volume[87747]: DEBUG cinder.image.image_utils [None req-1d8e2d5a-f030-4c9b-8494-81c76874db44 tempest-VolumeDependencyTests-325487065 None] Image conversion details: src /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-33ac0c8a-d0c6-4d2e-bad9-fd8a9e43ee0d, size 1024.00 MB, duration 6.02 sec, destination /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c28f4c9f-3068-4c70-9e29-4d97a6f48dd7 {{(pid=87747) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 22 03:25:04 devstack cinder-volume[87747]: INFO cinder.image.image_utils [None req-1d8e2d5a-f030-4c9b-8494-81c76874db44 tempest-VolumeDependencyTests-325487065 None] Converted 1024.00 MB image at 170.22 MB/s Jul 22 03:25:04 devstack cinder-volume[87747]: WARNING cinder.volume.drivers.remotefs [None req-1d8e2d5a-f030-4c9b-8494-81c76874db44 tempest-VolumeDependencyTests-325487065 None] /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c28f4c9f-3068-4c70-9e29-4d97a6f48dd7 is being set with open permissions: ugo+rw Jul 22 03:25:04 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-1d8e2d5a-f030-4c9b-8494-81c76874db44 tempest-VolumeDependencyTests-325487065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c28f4c9f-3068-4c70-9e29-4d97a6f48dd7 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:25:04 devstack sudo[99119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c28f4c9f-3068-4c70-9e29-4d97a6f48dd7 Jul 22 03:25:04 devstack sudo[99119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:25:04 devstack sudo[99119]: pam_unix(sudo:session): session closed for user root Jul 22 03:25:04 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-1d8e2d5a-f030-4c9b-8494-81c76874db44 tempest-VolumeDependencyTests-325487065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c28f4c9f-3068-4c70-9e29-4d97a6f48dd7" returned: 0 in 0.283s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:25:04 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-1d8e2d5a-f030-4c9b-8494-81c76874db44 tempest-VolumeDependencyTests-325487065 None] Lock "cinder-quobyte-c28f4c9f-3068-4c70-9e29-4d97a6f48dd7" released by "_copy_volume_from_snapshot" :: held 7.788s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:25:04 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-1d8e2d5a-f030-4c9b-8494-81c76874db44 tempest-VolumeDependencyTests-325487065 None] Lock "cinder-quobyte-3009672a-6d71-4f90-b4ca-34e547782728-c28f4c9f-3068-4c70-9e29-4d97a6f48dd7" released by "_create_volume_from_snapshot" :: held 7.823s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:25:04 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-1d8e2d5a-f030-4c9b-8494-81c76874db44 tempest-VolumeDependencyTests-325487065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.842s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:25:04 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b974e096-d471-4320-a98d-a3f5dc0493d3 tempest-GroupSnapshotsTest-172189020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.568s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:25:04 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-b974e096-d471-4320-a98d-a3f5dc0493d3 tempest-GroupSnapshotsTest-172189020 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=73f72f2d-21b1-4d57-9857-dd856371acdf,created_at=2026-07-22T01:25:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1861851320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=73f72f2d-21b1-4d57-9857-dd856371acdf,host='devstack@QuobyteHD#QuobyteHD',id=a69b0920-fdd0-4c2a-8463-2fc415c144f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a058032650974a56a4f1348c499a4293',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:25:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:25:04Z,use_quota=True,user_id='8b50bd7a480f42ac8ba487a2cd387e87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90d59d6a-b49b-4057-ad29-6728c0ee6d92),volume_type_id=90d59d6a-b49b-4057-ad29-6728c0ee6d92)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:25:04 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-b974e096-d471-4320-a98d-a3f5dc0493d3 tempest-GroupSnapshotsTest-172189020 None] Creating volume a69b0920-fdd0-4c2a-8463-2fc415c144f1 {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:25:04 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b974e096-d471-4320-a98d-a3f5dc0493d3 tempest-GroupSnapshotsTest-172189020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:25:04 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b974e096-d471-4320-a98d-a3f5dc0493d3 tempest-GroupSnapshotsTest-172189020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:25:04 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-b974e096-d471-4320-a98d-a3f5dc0493d3 tempest-GroupSnapshotsTest-172189020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:25:04 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-b974e096-d471-4320-a98d-a3f5dc0493d3 tempest-GroupSnapshotsTest-172189020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:25:04 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b974e096-d471-4320-a98d-a3f5dc0493d3 tempest-GroupSnapshotsTest-172189020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:25:04 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-b974e096-d471-4320-a98d-a3f5dc0493d3 tempest-GroupSnapshotsTest-172189020 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:25:04 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-b974e096-d471-4320-a98d-a3f5dc0493d3 tempest-GroupSnapshotsTest-172189020 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:25:04 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b974e096-d471-4320-a98d-a3f5dc0493d3 tempest-GroupSnapshotsTest-172189020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a69b0920-fdd0-4c2a-8463-2fc415c144f1 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:25:04 devstack sudo[99123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a69b0920-fdd0-4c2a-8463-2fc415c144f1 1073741824 Jul 22 03:25:04 devstack sudo[99123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:25:04 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-1d8e2d5a-f030-4c9b-8494-81c76874db44 tempest-VolumeDependencyTests-325487065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c08bc4e6-ef39-49f4-8cce-dc5c3de61b08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c28f4c9f-3068-4c70-9e29-4d97a6f48dd7', 'volume_size': 1, 'snapshot_id': '3009672a-6d71-4f90-b4ca-34e547782728'}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:25:04 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-1d8e2d5a-f030-4c9b-8494-81c76874db44 tempest-VolumeDependencyTests-325487065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6f91110-8452-464f-9c6e-60f71d639532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:25:04 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-1d8e2d5a-f030-4c9b-8494-81c76874db44 tempest-VolumeDependencyTests-325487065 None] Volume volume-c28f4c9f-3068-4c70-9e29-4d97a6f48dd7 (c28f4c9f-3068-4c70-9e29-4d97a6f48dd7): created successfully Jul 22 03:25:04 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-1d8e2d5a-f030-4c9b-8494-81c76874db44 tempest-VolumeDependencyTests-325487065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6f91110-8452-464f-9c6e-60f71d639532) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:25:04 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-1d8e2d5a-f030-4c9b-8494-81c76874db44 tempest-VolumeDependencyTests-325487065 None] Flow 'volume_create_manager' (43c23405-8c14-41f6-ae56-6631f91570a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:25:04 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-1d8e2d5a-f030-4c9b-8494-81c76874db44 tempest-VolumeDependencyTests-325487065 None] Created volume successfully. Jul 22 03:25:05 devstack sudo[99123]: pam_unix(sudo:session): session closed for user root Jul 22 03:25:05 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b974e096-d471-4320-a98d-a3f5dc0493d3 tempest-GroupSnapshotsTest-172189020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a69b0920-fdd0-4c2a-8463-2fc415c144f1 1073741824" returned: 0 in 0.597s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:25:05 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b974e096-d471-4320-a98d-a3f5dc0493d3 tempest-GroupSnapshotsTest-172189020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a69b0920-fdd0-4c2a-8463-2fc415c144f1 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:25:05 devstack sudo[99145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a69b0920-fdd0-4c2a-8463-2fc415c144f1 Jul 22 03:25:05 devstack sudo[99145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:25:05 devstack sudo[99145]: pam_unix(sudo:session): session closed for user root Jul 22 03:25:05 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b974e096-d471-4320-a98d-a3f5dc0493d3 tempest-GroupSnapshotsTest-172189020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a69b0920-fdd0-4c2a-8463-2fc415c144f1" returned: 0 in 0.395s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:25:05 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-b974e096-d471-4320-a98d-a3f5dc0493d3 tempest-GroupSnapshotsTest-172189020 None] <== create_volume: return (1053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:25:05 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b974e096-d471-4320-a98d-a3f5dc0493d3 tempest-GroupSnapshotsTest-172189020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.059s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:25:05 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b974e096-d471-4320-a98d-a3f5dc0493d3 tempest-GroupSnapshotsTest-172189020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3348eff8-8077-4684-852d-e0ba0bf86510) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a69b0920-fdd0-4c2a-8463-2fc415c144f1', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:25:05 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b974e096-d471-4320-a98d-a3f5dc0493d3 tempest-GroupSnapshotsTest-172189020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b355d55-1f51-4af3-96bd-ec12f7477fe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:25:05 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-522bb7b1-5424-410b-92a2-49b29164f1cf tempest-VolumeDependencyTests-325487065 None] Acquiring lock "cinder-3009672a-6d71-4f90-b4ca-34e547782728-delete_snapshot" by "delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:25:05 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-b974e096-d471-4320-a98d-a3f5dc0493d3 tempest-GroupSnapshotsTest-172189020 None] Volume volume-a69b0920-fdd0-4c2a-8463-2fc415c144f1 (a69b0920-fdd0-4c2a-8463-2fc415c144f1): created successfully Jul 22 03:25:05 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b974e096-d471-4320-a98d-a3f5dc0493d3 tempest-GroupSnapshotsTest-172189020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b355d55-1f51-4af3-96bd-ec12f7477fe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:25:05 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b974e096-d471-4320-a98d-a3f5dc0493d3 tempest-GroupSnapshotsTest-172189020 None] Flow 'volume_create_manager' (ac99e3d5-131e-42a7-8796-b8c47a6728be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:25:05 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-522bb7b1-5424-410b-92a2-49b29164f1cf tempest-VolumeDependencyTests-325487065 None] Lock "cinder-3009672a-6d71-4f90-b4ca-34e547782728-delete_snapshot" acquired by "delete_snapshot" :: waited 0.057s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:25:05 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-522bb7b1-5424-410b-92a2-49b29164f1cf tempest-VolumeDependencyTests-325487065 None] Acquiring lock "cinder-quobyte-33ac0c8a-d0c6-4d2e-bad9-fd8a9e43ee0d" by "delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:25:05 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-b974e096-d471-4320-a98d-a3f5dc0493d3 tempest-GroupSnapshotsTest-172189020 None] Created volume successfully. Jul 22 03:25:05 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-522bb7b1-5424-410b-92a2-49b29164f1cf tempest-VolumeDependencyTests-325487065 None] Lock "cinder-quobyte-33ac0c8a-d0c6-4d2e-bad9-fd8a9e43ee0d" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:25:05 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-522bb7b1-5424-410b-92a2-49b29164f1cf tempest-VolumeDependencyTests-325487065 None] Acquiring lock "cinder-quobyte-3009672a-6d71-4f90-b4ca-34e547782728" by "_delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:25:06 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-522bb7b1-5424-410b-92a2-49b29164f1cf tempest-VolumeDependencyTests-325487065 None] Lock "cinder-quobyte-3009672a-6d71-4f90-b4ca-34e547782728" acquired by "_delete_snapshot" :: waited 0.045s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:25:06 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-522bb7b1-5424-410b-92a2-49b29164f1cf tempest-VolumeDependencyTests-325487065 None] Deleting offline snapshot 3009672a-6d71-4f90-b4ca-34e547782728 of volume 33ac0c8a-d0c6-4d2e-bad9-fd8a9e43ee0d {{(pid=87747) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 03:25:06 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-522bb7b1-5424-410b-92a2-49b29164f1cf tempest-VolumeDependencyTests-325487065 None] snapshot_file for this snap is: volume-33ac0c8a-d0c6-4d2e-bad9-fd8a9e43ee0d.3009672a-6d71-4f90-b4ca-34e547782728 {{(pid=87747) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 03:25:06 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[19a2776a-deb4-4b1c-adcc-e35c21c9078b]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:25:06 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-522bb7b1-5424-410b-92a2-49b29164f1cf tempest-VolumeDependencyTests-325487065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-33ac0c8a-d0c6-4d2e-bad9-fd8a9e43ee0d.3009672a-6d71-4f90-b4ca-34e547782728 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:25:06 devstack sudo[99193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-33ac0c8a-d0c6-4d2e-bad9-fd8a9e43ee0d.3009672a-6d71-4f90-b4ca-34e547782728 Jul 22 03:25:06 devstack sudo[99193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:25:06 devstack sudo[99193]: pam_unix(sudo:session): session closed for user root Jul 22 03:25:06 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-522bb7b1-5424-410b-92a2-49b29164f1cf tempest-VolumeDependencyTests-325487065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-33ac0c8a-d0c6-4d2e-bad9-fd8a9e43ee0d.3009672a-6d71-4f90-b4ca-34e547782728" returned: 0 in 0.513s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:25:06 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-522bb7b1-5424-410b-92a2-49b29164f1cf tempest-VolumeDependencyTests-325487065 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-33ac0c8a-d0c6-4d2e-bad9-fd8a9e43ee0d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87747) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 03:25:06 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb3356c5-475c-4a40-a0f5-c09a243ae25f]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:25:06 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-522bb7b1-5424-410b-92a2-49b29164f1cf tempest-VolumeDependencyTests-325487065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-33ac0c8a-d0c6-4d2e-bad9-fd8a9e43ee0d {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:25:06 devstack sudo[99203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-33ac0c8a-d0c6-4d2e-bad9-fd8a9e43ee0d Jul 22 03:25:06 devstack sudo[99203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:25:07 devstack sudo[99203]: pam_unix(sudo:session): session closed for user root Jul 22 03:25:07 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-522bb7b1-5424-410b-92a2-49b29164f1cf tempest-VolumeDependencyTests-325487065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-33ac0c8a-d0c6-4d2e-bad9-fd8a9e43ee0d" returned: 0 in 0.546s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:25:07 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-522bb7b1-5424-410b-92a2-49b29164f1cf tempest-VolumeDependencyTests-325487065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-33ac0c8a-d0c6-4d2e-bad9-fd8a9e43ee0d.3009672a-6d71-4f90-b4ca-34e547782728 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:25:07 devstack sudo[99210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-33ac0c8a-d0c6-4d2e-bad9-fd8a9e43ee0d.3009672a-6d71-4f90-b4ca-34e547782728 Jul 22 03:25:07 devstack sudo[99210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:25:07 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-e29b2e07-1a26-42c9-96c0-6f2f18765532 tempest-GroupSnapshotsTest-172189020 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:25:07 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-e29b2e07-1a26-42c9-96c0-6f2f18765532 tempest-GroupSnapshotsTest-172189020 None] Flow 'volume_create_manager' (df51bc5c-71f2-492e-a6ac-a7773ff58273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:25:07 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-e29b2e07-1a26-42c9-96c0-6f2f18765532 tempest-GroupSnapshotsTest-172189020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec86212d-c76f-4e89-8c08-f5c3dc7f4480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:25:07 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-e29b2e07-1a26-42c9-96c0-6f2f18765532 tempest-GroupSnapshotsTest-172189020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec86212d-c76f-4e89-8c08-f5c3dc7f4480) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:25:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-476122697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=73f72f2d-21b1-4d57-9857-dd856371acdf,host='devstack@QuobyteHD#QuobyteHD',id=27766e11-001e-4ea6-be54-82fc3f88c5ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a058032650974a56a4f1348c499a4293',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:25:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:25:07Z,use_quota=True,user_id='8b50bd7a480f42ac8ba487a2cd387e87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90d59d6a-b49b-4057-ad29-6728c0ee6d92),volume_type_id=90d59d6a-b49b-4057-ad29-6728c0ee6d92)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:25:07 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-e29b2e07-1a26-42c9-96c0-6f2f18765532 tempest-GroupSnapshotsTest-172189020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ec56d95-86f7-40d6-9ea9-c379913ed50c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:25:07 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-e29b2e07-1a26-42c9-96c0-6f2f18765532 tempest-GroupSnapshotsTest-172189020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ec56d95-86f7-40d6-9ea9-c379913ed50c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:25:07 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-e29b2e07-1a26-42c9-96c0-6f2f18765532 tempest-GroupSnapshotsTest-172189020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b304f98d-6120-42e4-8508-e094a56a7ab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:25:07 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-e29b2e07-1a26-42c9-96c0-6f2f18765532 tempest-GroupSnapshotsTest-172189020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b304f98d-6120-42e4-8508-e094a56a7ab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27766e11-001e-4ea6-be54-82fc3f88c5ad', 'volume_name': 'volume-27766e11-001e-4ea6-be54-82fc3f88c5ad', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:25:07 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-e29b2e07-1a26-42c9-96c0-6f2f18765532 tempest-GroupSnapshotsTest-172189020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c267173-a4c3-4305-a87c-fd644c95f137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:25:07 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-e29b2e07-1a26-42c9-96c0-6f2f18765532 tempest-GroupSnapshotsTest-172189020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c267173-a4c3-4305-a87c-fd644c95f137) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:25:07 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-e29b2e07-1a26-42c9-96c0-6f2f18765532 tempest-GroupSnapshotsTest-172189020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8104d08-d27b-4a10-8925-83495e1d3db8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:25:07 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-e29b2e07-1a26-42c9-96c0-6f2f18765532 tempest-GroupSnapshotsTest-172189020 None] Volume 27766e11-001e-4ea6-be54-82fc3f88c5ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27766e11-001e-4ea6-be54-82fc3f88c5ad', 'volume_size': 1} Jul 22 03:25:07 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-e29b2e07-1a26-42c9-96c0-6f2f18765532 tempest-GroupSnapshotsTest-172189020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:25:07 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-e29b2e07-1a26-42c9-96c0-6f2f18765532 tempest-GroupSnapshotsTest-172189020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:25:07 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-e29b2e07-1a26-42c9-96c0-6f2f18765532 tempest-GroupSnapshotsTest-172189020 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=73f72f2d-21b1-4d57-9857-dd856371acdf,created_at=2026-07-22T01:25:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-476122697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=73f72f2d-21b1-4d57-9857-dd856371acdf,host='devstack@QuobyteHD#QuobyteHD',id=27766e11-001e-4ea6-be54-82fc3f88c5ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a058032650974a56a4f1348c499a4293',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:25:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:25:07Z,use_quota=True,user_id='8b50bd7a480f42ac8ba487a2cd387e87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90d59d6a-b49b-4057-ad29-6728c0ee6d92),volume_type_id=90d59d6a-b49b-4057-ad29-6728c0ee6d92)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:25:07 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-e29b2e07-1a26-42c9-96c0-6f2f18765532 tempest-GroupSnapshotsTest-172189020 None] Creating volume 27766e11-001e-4ea6-be54-82fc3f88c5ad {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:25:07 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-e29b2e07-1a26-42c9-96c0-6f2f18765532 tempest-GroupSnapshotsTest-172189020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:25:07 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-e29b2e07-1a26-42c9-96c0-6f2f18765532 tempest-GroupSnapshotsTest-172189020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:25:07 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-e29b2e07-1a26-42c9-96c0-6f2f18765532 tempest-GroupSnapshotsTest-172189020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:25:07 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-e29b2e07-1a26-42c9-96c0-6f2f18765532 tempest-GroupSnapshotsTest-172189020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:25:07 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-e29b2e07-1a26-42c9-96c0-6f2f18765532 tempest-GroupSnapshotsTest-172189020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:25:07 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-e29b2e07-1a26-42c9-96c0-6f2f18765532 tempest-GroupSnapshotsTest-172189020 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:25:07 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-e29b2e07-1a26-42c9-96c0-6f2f18765532 tempest-GroupSnapshotsTest-172189020 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:25:07 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-e29b2e07-1a26-42c9-96c0-6f2f18765532 tempest-GroupSnapshotsTest-172189020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-27766e11-001e-4ea6-be54-82fc3f88c5ad 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:25:07 devstack sudo[99213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-27766e11-001e-4ea6-be54-82fc3f88c5ad 1073741824 Jul 22 03:25:07 devstack sudo[99213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:25:07 devstack sudo[99210]: pam_unix(sudo:session): session closed for user root Jul 22 03:25:07 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-522bb7b1-5424-410b-92a2-49b29164f1cf tempest-VolumeDependencyTests-325487065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-33ac0c8a-d0c6-4d2e-bad9-fd8a9e43ee0d.3009672a-6d71-4f90-b4ca-34e547782728" returned: 0 in 0.549s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:25:07 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-522bb7b1-5424-410b-92a2-49b29164f1cf tempest-VolumeDependencyTests-325487065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-33ac0c8a-d0c6-4d2e-bad9-fd8a9e43ee0d.3009672a-6d71-4f90-b4ca-34e547782728 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:25:07 devstack sudo[99218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-33ac0c8a-d0c6-4d2e-bad9-fd8a9e43ee0d.3009672a-6d71-4f90-b4ca-34e547782728 Jul 22 03:25:07 devstack sudo[99218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:25:08 devstack sudo[99218]: pam_unix(sudo:session): session closed for user root Jul 22 03:25:08 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-522bb7b1-5424-410b-92a2-49b29164f1cf tempest-VolumeDependencyTests-325487065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-33ac0c8a-d0c6-4d2e-bad9-fd8a9e43ee0d.3009672a-6d71-4f90-b4ca-34e547782728" returned: 0 in 0.322s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:25:08 devstack sudo[99213]: pam_unix(sudo:session): session closed for user root Jul 22 03:25:08 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-e29b2e07-1a26-42c9-96c0-6f2f18765532 tempest-GroupSnapshotsTest-172189020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-27766e11-001e-4ea6-be54-82fc3f88c5ad 1073741824" returned: 0 in 0.564s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:25:08 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-522bb7b1-5424-410b-92a2-49b29164f1cf tempest-VolumeDependencyTests-325487065 None] Lock "cinder-quobyte-3009672a-6d71-4f90-b4ca-34e547782728" released by "_delete_snapshot" :: held 2.090s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:25:08 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-522bb7b1-5424-410b-92a2-49b29164f1cf tempest-VolumeDependencyTests-325487065 None] Lock "cinder-quobyte-33ac0c8a-d0c6-4d2e-bad9-fd8a9e43ee0d" released by "delete_snapshot" :: held 2.154s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:25:08 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-e29b2e07-1a26-42c9-96c0-6f2f18765532 tempest-GroupSnapshotsTest-172189020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-27766e11-001e-4ea6-be54-82fc3f88c5ad {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:25:08 devstack sudo[99225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-27766e11-001e-4ea6-be54-82fc3f88c5ad Jul 22 03:25:08 devstack sudo[99225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:25:08 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-522bb7b1-5424-410b-92a2-49b29164f1cf tempest-VolumeDependencyTests-325487065 None] Created reservations ['760f9a8b-f660-4544-8e2a-27a8b86c9e00', '9e3ba5b0-3d71-4a6d-a9a8-545c3741928f', '6074446c-968f-4c75-a548-a5fabd41d211', '22f1ffde-c306-481b-aac3-ac7c14c29e78'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:25:08 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-522bb7b1-5424-410b-92a2-49b29164f1cf tempest-VolumeDependencyTests-325487065 None] Delete snapshot completed successfully. Jul 22 03:25:08 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-522bb7b1-5424-410b-92a2-49b29164f1cf tempest-VolumeDependencyTests-325487065 None] Lock "cinder-3009672a-6d71-4f90-b4ca-34e547782728-delete_snapshot" released by "delete_snapshot" :: held 2.389s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:25:08 devstack sudo[99225]: pam_unix(sudo:session): session closed for user root Jul 22 03:25:08 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-e29b2e07-1a26-42c9-96c0-6f2f18765532 tempest-GroupSnapshotsTest-172189020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-27766e11-001e-4ea6-be54-82fc3f88c5ad" returned: 0 in 0.294s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:25:08 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-e29b2e07-1a26-42c9-96c0-6f2f18765532 tempest-GroupSnapshotsTest-172189020 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:25:08 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-e29b2e07-1a26-42c9-96c0-6f2f18765532 tempest-GroupSnapshotsTest-172189020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:25:08 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-e29b2e07-1a26-42c9-96c0-6f2f18765532 tempest-GroupSnapshotsTest-172189020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8104d08-d27b-4a10-8925-83495e1d3db8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27766e11-001e-4ea6-be54-82fc3f88c5ad', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:25:08 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-e29b2e07-1a26-42c9-96c0-6f2f18765532 tempest-GroupSnapshotsTest-172189020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58352693-91e3-459a-848d-fb7e1c6ec2c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:25:08 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-e29b2e07-1a26-42c9-96c0-6f2f18765532 tempest-GroupSnapshotsTest-172189020 None] Volume volume-27766e11-001e-4ea6-be54-82fc3f88c5ad (27766e11-001e-4ea6-be54-82fc3f88c5ad): created successfully Jul 22 03:25:08 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-e29b2e07-1a26-42c9-96c0-6f2f18765532 tempest-GroupSnapshotsTest-172189020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58352693-91e3-459a-848d-fb7e1c6ec2c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:25:08 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-e29b2e07-1a26-42c9-96c0-6f2f18765532 tempest-GroupSnapshotsTest-172189020 None] Flow 'volume_create_manager' (df51bc5c-71f2-492e-a6ac-a7773ff58273) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:25:08 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-e29b2e07-1a26-42c9-96c0-6f2f18765532 tempest-GroupSnapshotsTest-172189020 None] Created volume successfully. Jul 22 03:25:09 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-5e747c7a-0b74-4891-8ff3-3236354f7344 tempest-VolumeDependencyTests-325487065 None] Acquiring lock "cinder-33ac0c8a-d0c6-4d2e-bad9-fd8a9e43ee0d-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:25:09 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-5e747c7a-0b74-4891-8ff3-3236354f7344 tempest-VolumeDependencyTests-325487065 None] Lock "cinder-33ac0c8a-d0c6-4d2e-bad9-fd8a9e43ee0d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:25:09 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-5e747c7a-0b74-4891-8ff3-3236354f7344 tempest-VolumeDependencyTests-325487065 None] Acquiring lock "cinder-quobyte-33ac0c8a-d0c6-4d2e-bad9-fd8a9e43ee0d" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:25:09 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-5e747c7a-0b74-4891-8ff3-3236354f7344 tempest-VolumeDependencyTests-325487065 None] Lock "cinder-quobyte-33ac0c8a-d0c6-4d2e-bad9-fd8a9e43ee0d" acquired by "delete_volume" :: waited 0.027s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:25:09 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2c69ca3-53cc-4c9f-8992-2745b5e71631]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:25:09 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5e747c7a-0b74-4891-8ff3-3236354f7344 tempest-VolumeDependencyTests-325487065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-33ac0c8a-d0c6-4d2e-bad9-fd8a9e43ee0d {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:25:09 devstack sudo[99230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-33ac0c8a-d0c6-4d2e-bad9-fd8a9e43ee0d Jul 22 03:25:09 devstack sudo[99230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:25:09 devstack sudo[99230]: pam_unix(sudo:session): session closed for user root Jul 22 03:25:09 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5e747c7a-0b74-4891-8ff3-3236354f7344 tempest-VolumeDependencyTests-325487065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-33ac0c8a-d0c6-4d2e-bad9-fd8a9e43ee0d" returned: 0 in 0.409s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:25:09 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5e747c7a-0b74-4891-8ff3-3236354f7344 tempest-VolumeDependencyTests-325487065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-33ac0c8a-d0c6-4d2e-bad9-fd8a9e43ee0d {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:25:09 devstack sudo[99235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-33ac0c8a-d0c6-4d2e-bad9-fd8a9e43ee0d Jul 22 03:25:09 devstack sudo[99235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:25:09 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-cf6430eb-4186-4b02-a8c1-e31b173f1619 tempest-GroupSnapshotsTest-172189020 None] Update group completed successfully. Jul 22 03:25:09 devstack sudo[99235]: pam_unix(sudo:session): session closed for user root Jul 22 03:25:09 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5e747c7a-0b74-4891-8ff3-3236354f7344 tempest-VolumeDependencyTests-325487065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-33ac0c8a-d0c6-4d2e-bad9-fd8a9e43ee0d" returned: 0 in 0.278s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:25:10 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-5e747c7a-0b74-4891-8ff3-3236354f7344 tempest-VolumeDependencyTests-325487065 None] Lock "cinder-quobyte-33ac0c8a-d0c6-4d2e-bad9-fd8a9e43ee0d" released by "delete_volume" :: held 0.766s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:25:10 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-5e747c7a-0b74-4891-8ff3-3236354f7344 tempest-VolumeDependencyTests-325487065 None] Created reservations ['27afe7b9-32b7-44a7-b5b7-106c8a627895', '334f0694-fcb1-4c9e-8808-812b5a89c91a', 'd88665c0-75c5-4355-9940-b4062addd827', '774a004d-baf2-4419-906e-00e73120b7fa'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:25:10 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-5e747c7a-0b74-4891-8ff3-3236354f7344 tempest-VolumeDependencyTests-325487065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:25:10 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-5e747c7a-0b74-4891-8ff3-3236354f7344 tempest-VolumeDependencyTests-325487065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:25:10 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-5e747c7a-0b74-4891-8ff3-3236354f7344 tempest-VolumeDependencyTests-325487065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:25:10 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-5e747c7a-0b74-4891-8ff3-3236354f7344 tempest-VolumeDependencyTests-325487065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:25:10 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-5e747c7a-0b74-4891-8ff3-3236354f7344 tempest-VolumeDependencyTests-325487065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:25:10 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5e747c7a-0b74-4891-8ff3-3236354f7344 tempest-VolumeDependencyTests-325487065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:25:10 devstack sudo[99238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:25:10 devstack sudo[99238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:25:10 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-5ba44a7d-c032-4434-bfe4-497391abb12e tempest-VolumeDependencyTests-325487065 None] Acquiring lock "cinder-c28f4c9f-3068-4c70-9e29-4d97a6f48dd7-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:25:10 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-5ba44a7d-c032-4434-bfe4-497391abb12e tempest-VolumeDependencyTests-325487065 None] Lock "cinder-c28f4c9f-3068-4c70-9e29-4d97a6f48dd7-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:25:10 devstack sudo[99238]: pam_unix(sudo:session): session closed for user root Jul 22 03:25:10 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5e747c7a-0b74-4891-8ff3-3236354f7344 tempest-VolumeDependencyTests-325487065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.278s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:25:10 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-5e747c7a-0b74-4891-8ff3-3236354f7344 tempest-VolumeDependencyTests-325487065 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:25:10 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-5e747c7a-0b74-4891-8ff3-3236354f7344 tempest-VolumeDependencyTests-325487065 None] Deleted volume successfully. Jul 22 03:25:10 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-5e747c7a-0b74-4891-8ff3-3236354f7344 tempest-VolumeDependencyTests-325487065 None] Lock "cinder-33ac0c8a-d0c6-4d2e-bad9-fd8a9e43ee0d-delete_volume" released by "delete_volume" :: held 1.255s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:25:10 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-5ba44a7d-c032-4434-bfe4-497391abb12e tempest-VolumeDependencyTests-325487065 None] Acquiring lock "cinder-quobyte-c28f4c9f-3068-4c70-9e29-4d97a6f48dd7" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:25:10 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-5ba44a7d-c032-4434-bfe4-497391abb12e tempest-VolumeDependencyTests-325487065 None] Lock "cinder-quobyte-c28f4c9f-3068-4c70-9e29-4d97a6f48dd7" acquired by "delete_volume" :: waited 0.022s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:25:10 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8aa9608-baf8-4ece-a41e-96f73f21b0e6]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:25:10 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5ba44a7d-c032-4434-bfe4-497391abb12e tempest-VolumeDependencyTests-325487065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c28f4c9f-3068-4c70-9e29-4d97a6f48dd7 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:25:10 devstack sudo[99241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c28f4c9f-3068-4c70-9e29-4d97a6f48dd7 Jul 22 03:25:10 devstack sudo[99241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:25:10 devstack sudo[99241]: pam_unix(sudo:session): session closed for user root Jul 22 03:25:10 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5ba44a7d-c032-4434-bfe4-497391abb12e tempest-VolumeDependencyTests-325487065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c28f4c9f-3068-4c70-9e29-4d97a6f48dd7" returned: 0 in 0.365s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:25:10 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5ba44a7d-c032-4434-bfe4-497391abb12e tempest-VolumeDependencyTests-325487065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c28f4c9f-3068-4c70-9e29-4d97a6f48dd7 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:25:10 devstack sudo[99332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c28f4c9f-3068-4c70-9e29-4d97a6f48dd7 Jul 22 03:25:10 devstack sudo[99332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:25:11 devstack sudo[99332]: pam_unix(sudo:session): session closed for user root Jul 22 03:25:11 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5ba44a7d-c032-4434-bfe4-497391abb12e tempest-VolumeDependencyTests-325487065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c28f4c9f-3068-4c70-9e29-4d97a6f48dd7" returned: 0 in 0.255s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:25:11 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-5ba44a7d-c032-4434-bfe4-497391abb12e tempest-VolumeDependencyTests-325487065 None] Lock "cinder-quobyte-c28f4c9f-3068-4c70-9e29-4d97a6f48dd7" released by "delete_volume" :: held 0.658s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:25:11 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-da763369-38fa-4117-a801-8a211f554d22 tempest-GroupSnapshotsTest-172189020 None] Update group completed successfully. Jul 22 03:25:11 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-5ba44a7d-c032-4434-bfe4-497391abb12e tempest-VolumeDependencyTests-325487065 None] Created reservations ['a22b0f3b-4916-4f13-979f-643b088cb24a', '290f65ce-029a-4119-b144-f710b91627ec', '1f1c20c9-9694-4215-8856-0c4492963315', '28e14f3e-348c-49fc-8571-c9cc053bc38d'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:25:11 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-5ba44a7d-c032-4434-bfe4-497391abb12e tempest-VolumeDependencyTests-325487065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:25:11 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-5ba44a7d-c032-4434-bfe4-497391abb12e tempest-VolumeDependencyTests-325487065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:25:11 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-5ba44a7d-c032-4434-bfe4-497391abb12e tempest-VolumeDependencyTests-325487065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:25:11 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-5ba44a7d-c032-4434-bfe4-497391abb12e tempest-VolumeDependencyTests-325487065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:25:11 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-5ba44a7d-c032-4434-bfe4-497391abb12e tempest-VolumeDependencyTests-325487065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:25:11 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5ba44a7d-c032-4434-bfe4-497391abb12e tempest-VolumeDependencyTests-325487065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:25:11 devstack sudo[99335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:25:11 devstack sudo[99335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:25:11 devstack sudo[99335]: pam_unix(sudo:session): session closed for user root Jul 22 03:25:11 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5ba44a7d-c032-4434-bfe4-497391abb12e tempest-VolumeDependencyTests-325487065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.248s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:25:11 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-5ba44a7d-c032-4434-bfe4-497391abb12e tempest-VolumeDependencyTests-325487065 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:25:11 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-5ba44a7d-c032-4434-bfe4-497391abb12e tempest-VolumeDependencyTests-325487065 None] Deleted volume successfully. Jul 22 03:25:11 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-5ba44a7d-c032-4434-bfe4-497391abb12e tempest-VolumeDependencyTests-325487065 None] Lock "cinder-c28f4c9f-3068-4c70-9e29-4d97a6f48dd7-delete_volume" released by "delete_volume" :: held 1.138s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:25:12 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-f879634a-1b31-4dbf-9034-18d0fe4a5698 tempest-GroupSnapshotsTest-172189020 None] Update group completed successfully. Jul 22 03:25:13 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-89bcef13-f7bc-4acc-89ab-7d9c27234294 tempest-GroupSnapshotsTest-172189020 None] Update group completed successfully. Jul 22 03:25:14 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-83bdf9a7-4186-4cc7-a746-94000f456620 tempest-CinderUnicodeTest-1483653559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:25:14 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-83bdf9a7-4186-4cc7-a746-94000f456620 tempest-CinderUnicodeTest-1483653559 None] Flow 'volume_create_manager' (4c22893f-e856-460f-8142-0b751e3de978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:25:14 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-83bdf9a7-4186-4cc7-a746-94000f456620 tempest-CinderUnicodeTest-1483653559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f56fa1e1-0a49-434f-a229-90790b3f18e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:25:14 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-83bdf9a7-4186-4cc7-a746-94000f456620 tempest-CinderUnicodeTest-1483653559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f56fa1e1-0a49-434f-a229-90790b3f18e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:25:14Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=308e6cb6-67a2-4769-a5e6-42d9e811afe3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fb0cc017456497b8cf42f55997a23d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:25:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:25:15Z,use_quota=True,user_id='bc7d2487892e4627829514752e4a62a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:25:14 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-83bdf9a7-4186-4cc7-a746-94000f456620 tempest-CinderUnicodeTest-1483653559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ddf4efd-3d51-4551-a954-68db80c12b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:25:14 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-83bdf9a7-4186-4cc7-a746-94000f456620 tempest-CinderUnicodeTest-1483653559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ddf4efd-3d51-4551-a954-68db80c12b3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:25:14 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-83bdf9a7-4186-4cc7-a746-94000f456620 tempest-CinderUnicodeTest-1483653559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d444b02a-55bf-4837-a3f9-927fcbe37028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:25:14 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-83bdf9a7-4186-4cc7-a746-94000f456620 tempest-CinderUnicodeTest-1483653559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d444b02a-55bf-4837-a3f9-927fcbe37028) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '308e6cb6-67a2-4769-a5e6-42d9e811afe3', 'volume_name': 'volume-308e6cb6-67a2-4769-a5e6-42d9e811afe3', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:25:14 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-83bdf9a7-4186-4cc7-a746-94000f456620 tempest-CinderUnicodeTest-1483653559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (239183e3-97f2-43ca-a09a-d22c4175ff81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:25:14 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-83bdf9a7-4186-4cc7-a746-94000f456620 tempest-CinderUnicodeTest-1483653559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (239183e3-97f2-43ca-a09a-d22c4175ff81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:25:14 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-83bdf9a7-4186-4cc7-a746-94000f456620 tempest-CinderUnicodeTest-1483653559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1fa6463-71fd-4a27-82c0-1d27159a1e76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:25:14 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-83bdf9a7-4186-4cc7-a746-94000f456620 tempest-CinderUnicodeTest-1483653559 None] Volume 308e6cb6-67a2-4769-a5e6-42d9e811afe3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-308e6cb6-67a2-4769-a5e6-42d9e811afe3', 'volume_size': 1} Jul 22 03:25:14 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-83bdf9a7-4186-4cc7-a746-94000f456620 tempest-CinderUnicodeTest-1483653559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:25:14 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-83bdf9a7-4186-4cc7-a746-94000f456620 tempest-CinderUnicodeTest-1483653559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:25:14 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-83bdf9a7-4186-4cc7-a746-94000f456620 tempest-CinderUnicodeTest-1483653559 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:25:14Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=308e6cb6-67a2-4769-a5e6-42d9e811afe3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fb0cc017456497b8cf42f55997a23d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:25:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:25:15Z,use_quota=True,user_id='bc7d2487892e4627829514752e4a62a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:25:14 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-83bdf9a7-4186-4cc7-a746-94000f456620 tempest-CinderUnicodeTest-1483653559 None] Creating volume 308e6cb6-67a2-4769-a5e6-42d9e811afe3 {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:25:14 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-83bdf9a7-4186-4cc7-a746-94000f456620 tempest-CinderUnicodeTest-1483653559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:25:14 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-83bdf9a7-4186-4cc7-a746-94000f456620 tempest-CinderUnicodeTest-1483653559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:25:14 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-83bdf9a7-4186-4cc7-a746-94000f456620 tempest-CinderUnicodeTest-1483653559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:25:14 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-83bdf9a7-4186-4cc7-a746-94000f456620 tempest-CinderUnicodeTest-1483653559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:25:14 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-83bdf9a7-4186-4cc7-a746-94000f456620 tempest-CinderUnicodeTest-1483653559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:25:14 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-83bdf9a7-4186-4cc7-a746-94000f456620 tempest-CinderUnicodeTest-1483653559 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:25:14 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-83bdf9a7-4186-4cc7-a746-94000f456620 tempest-CinderUnicodeTest-1483653559 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:25:14 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-83bdf9a7-4186-4cc7-a746-94000f456620 tempest-CinderUnicodeTest-1483653559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-308e6cb6-67a2-4769-a5e6-42d9e811afe3 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:25:14 devstack sudo[99339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-308e6cb6-67a2-4769-a5e6-42d9e811afe3 1073741824 Jul 22 03:25:14 devstack sudo[99339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:25:15 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-005593d8-b5f1-440c-b1ef-f29018748e56 tempest-GroupSnapshotsTest-172189020 None] GroupSnapshot 715d6592-790a-45ff-a93c-77d2a3f9eda2: creating. Jul 22 03:25:15 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-005593d8-b5f1-440c-b1ef-f29018748e56 tempest-GroupSnapshotsTest-172189020 None] Group snapshot 715d6592-790a-45ff-a93c-77d2a3f9eda2: creating. {{(pid=87747) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 22 03:25:15 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-005593d8-b5f1-440c-b1ef-f29018748e56 tempest-GroupSnapshotsTest-172189020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:25:15 devstack sudo[99339]: pam_unix(sudo:session): session closed for user root Jul 22 03:25:15 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-83bdf9a7-4186-4cc7-a746-94000f456620 tempest-CinderUnicodeTest-1483653559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-308e6cb6-67a2-4769-a5e6-42d9e811afe3 1073741824" returned: 0 in 0.509s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:25:15 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-83bdf9a7-4186-4cc7-a746-94000f456620 tempest-CinderUnicodeTest-1483653559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-308e6cb6-67a2-4769-a5e6-42d9e811afe3 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:25:15 devstack sudo[99345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-308e6cb6-67a2-4769-a5e6-42d9e811afe3 Jul 22 03:25:15 devstack sudo[99345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:25:15 devstack sudo[99345]: pam_unix(sudo:session): session closed for user root Jul 22 03:25:15 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-83bdf9a7-4186-4cc7-a746-94000f456620 tempest-CinderUnicodeTest-1483653559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-308e6cb6-67a2-4769-a5e6-42d9e811afe3" returned: 0 in 0.268s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:25:15 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-83bdf9a7-4186-4cc7-a746-94000f456620 tempest-CinderUnicodeTest-1483653559 None] <== create_volume: return (825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:25:15 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-83bdf9a7-4186-4cc7-a746-94000f456620 tempest-CinderUnicodeTest-1483653559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.828s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:25:15 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-005593d8-b5f1-440c-b1ef-f29018748e56 tempest-GroupSnapshotsTest-172189020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.410s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:25:15 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-005593d8-b5f1-440c-b1ef-f29018748e56 tempest-GroupSnapshotsTest-172189020 None] Creating offline snapshot 1b11cd47-34cf-4124-90bd-e2cdaa45bbf7 of volume 27766e11-001e-4ea6-be54-82fc3f88c5ad {{(pid=87747) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 03:25:15 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-83bdf9a7-4186-4cc7-a746-94000f456620 tempest-CinderUnicodeTest-1483653559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1fa6463-71fd-4a27-82c0-1d27159a1e76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-308e6cb6-67a2-4769-a5e6-42d9e811afe3', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:25:15 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-83bdf9a7-4186-4cc7-a746-94000f456620 tempest-CinderUnicodeTest-1483653559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70d96e21-e762-45c1-a79a-63aa573ec70a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:25:15 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[2122e5fc-8fb7-40bd-95b2-9cea00c99e48]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:25:15 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-005593d8-b5f1-440c-b1ef-f29018748e56 tempest-GroupSnapshotsTest-172189020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-27766e11-001e-4ea6-be54-82fc3f88c5ad {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:25:15 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-83bdf9a7-4186-4cc7-a746-94000f456620 tempest-CinderUnicodeTest-1483653559 None] Volume volume-308e6cb6-67a2-4769-a5e6-42d9e811afe3 (308e6cb6-67a2-4769-a5e6-42d9e811afe3): created successfully Jul 22 03:25:15 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-83bdf9a7-4186-4cc7-a746-94000f456620 tempest-CinderUnicodeTest-1483653559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70d96e21-e762-45c1-a79a-63aa573ec70a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:25:15 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-83bdf9a7-4186-4cc7-a746-94000f456620 tempest-CinderUnicodeTest-1483653559 None] Flow 'volume_create_manager' (4c22893f-e856-460f-8142-0b751e3de978) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:25:15 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-83bdf9a7-4186-4cc7-a746-94000f456620 tempest-CinderUnicodeTest-1483653559 None] Created volume successfully. Jul 22 03:25:15 devstack sudo[99348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-27766e11-001e-4ea6-be54-82fc3f88c5ad Jul 22 03:25:15 devstack sudo[99348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:25:15 devstack sudo[99348]: pam_unix(sudo:session): session closed for user root Jul 22 03:25:15 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-005593d8-b5f1-440c-b1ef-f29018748e56 tempest-GroupSnapshotsTest-172189020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-27766e11-001e-4ea6-be54-82fc3f88c5ad" returned: 0 in 0.370s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:25:15 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-005593d8-b5f1-440c-b1ef-f29018748e56 tempest-GroupSnapshotsTest-172189020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-27766e11-001e-4ea6-be54-82fc3f88c5ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-27766e11-001e-4ea6-be54-82fc3f88c5ad.1b11cd47-34cf-4124-90bd-e2cdaa45bbf7 1G {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:25:15 devstack sudo[99353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-27766e11-001e-4ea6-be54-82fc3f88c5ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-27766e11-001e-4ea6-be54-82fc3f88c5ad.1b11cd47-34cf-4124-90bd-e2cdaa45bbf7 1G Jul 22 03:25:15 devstack sudo[99353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:25:16 devstack sudo[99353]: pam_unix(sudo:session): session closed for user root Jul 22 03:25:16 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-005593d8-b5f1-440c-b1ef-f29018748e56 tempest-GroupSnapshotsTest-172189020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-27766e11-001e-4ea6-be54-82fc3f88c5ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-27766e11-001e-4ea6-be54-82fc3f88c5ad.1b11cd47-34cf-4124-90bd-e2cdaa45bbf7 1G" returned: 0 in 0.386s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:25:16 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-005593d8-b5f1-440c-b1ef-f29018748e56 tempest-GroupSnapshotsTest-172189020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27766e11-001e-4ea6-be54-82fc3f88c5ad -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-27766e11-001e-4ea6-be54-82fc3f88c5ad.1b11cd47-34cf-4124-90bd-e2cdaa45bbf7 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:25:16 devstack sudo[99359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27766e11-001e-4ea6-be54-82fc3f88c5ad -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-27766e11-001e-4ea6-be54-82fc3f88c5ad.1b11cd47-34cf-4124-90bd-e2cdaa45bbf7 Jul 22 03:25:16 devstack sudo[99359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:25:16 devstack sudo[99359]: pam_unix(sudo:session): session closed for user root Jul 22 03:25:16 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-005593d8-b5f1-440c-b1ef-f29018748e56 tempest-GroupSnapshotsTest-172189020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27766e11-001e-4ea6-be54-82fc3f88c5ad -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-27766e11-001e-4ea6-be54-82fc3f88c5ad.1b11cd47-34cf-4124-90bd-e2cdaa45bbf7" returned: 0 in 0.292s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:25:16 devstack cinder-volume[87747]: WARNING cinder.volume.drivers.remotefs [None req-005593d8-b5f1-440c-b1ef-f29018748e56 tempest-GroupSnapshotsTest-172189020 None] /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-27766e11-001e-4ea6-be54-82fc3f88c5ad.1b11cd47-34cf-4124-90bd-e2cdaa45bbf7 is being set with open permissions: ugo+rw: NotImplementedError Jul 22 03:25:16 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-005593d8-b5f1-440c-b1ef-f29018748e56 tempest-GroupSnapshotsTest-172189020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-27766e11-001e-4ea6-be54-82fc3f88c5ad.1b11cd47-34cf-4124-90bd-e2cdaa45bbf7 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:25:16 devstack sudo[99364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-27766e11-001e-4ea6-be54-82fc3f88c5ad.1b11cd47-34cf-4124-90bd-e2cdaa45bbf7 Jul 22 03:25:16 devstack sudo[99364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:25:16 devstack sudo[99364]: pam_unix(sudo:session): session closed for user root Jul 22 03:25:16 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-005593d8-b5f1-440c-b1ef-f29018748e56 tempest-GroupSnapshotsTest-172189020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-27766e11-001e-4ea6-be54-82fc3f88c5ad.1b11cd47-34cf-4124-90bd-e2cdaa45bbf7" returned: 0 in 0.267s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:25:16 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-005593d8-b5f1-440c-b1ef-f29018748e56 tempest-GroupSnapshotsTest-172189020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-27766e11-001e-4ea6-be54-82fc3f88c5ad.info {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:25:16 devstack sudo[99367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-27766e11-001e-4ea6-be54-82fc3f88c5ad.info Jul 22 03:25:16 devstack sudo[99367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:25:17 devstack sudo[99367]: pam_unix(sudo:session): session closed for user root Jul 22 03:25:17 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-005593d8-b5f1-440c-b1ef-f29018748e56 tempest-GroupSnapshotsTest-172189020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-27766e11-001e-4ea6-be54-82fc3f88c5ad.info" returned: 0 in 0.388s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:25:17 devstack cinder-volume[87747]: WARNING cinder.volume.drivers.remotefs [None req-005593d8-b5f1-440c-b1ef-f29018748e56 tempest-GroupSnapshotsTest-172189020 None] /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-27766e11-001e-4ea6-be54-82fc3f88c5ad.info is being set with open permissions: ugo+rw: NotImplementedError Jul 22 03:25:17 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-005593d8-b5f1-440c-b1ef-f29018748e56 tempest-GroupSnapshotsTest-172189020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-27766e11-001e-4ea6-be54-82fc3f88c5ad.info {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:25:17 devstack sudo[99375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-27766e11-001e-4ea6-be54-82fc3f88c5ad.info Jul 22 03:25:17 devstack sudo[99375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:25:17 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a19a83c-cdc8-45f1-a85b-c44c80e7a421 tempest-CinderUnicodeTest-1483653559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:25:17 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-4a19a83c-cdc8-45f1-a85b-c44c80e7a421 tempest-CinderUnicodeTest-1483653559 None] Flow 'volume_create_manager' (728f0fde-fb11-49cf-a983-511136715255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:25:17 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-4a19a83c-cdc8-45f1-a85b-c44c80e7a421 tempest-CinderUnicodeTest-1483653559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3314efae-df84-4545-8b47-ee41f6568d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:25:17 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-4a19a83c-cdc8-45f1-a85b-c44c80e7a421 tempest-CinderUnicodeTest-1483653559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3314efae-df84-4545-8b47-ee41f6568d94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:25:17Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-706065795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c002e14-b5da-47b9-a3f3-5bebad1e0a6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fb0cc017456497b8cf42f55997a23d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:25:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:25:17Z,use_quota=True,user_id='bc7d2487892e4627829514752e4a62a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:25:17 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-4a19a83c-cdc8-45f1-a85b-c44c80e7a421 tempest-CinderUnicodeTest-1483653559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5eca43e1-2cfd-4ba6-8ab1-f45444695b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:25:17 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-4a19a83c-cdc8-45f1-a85b-c44c80e7a421 tempest-CinderUnicodeTest-1483653559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5eca43e1-2cfd-4ba6-8ab1-f45444695b27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:25:17 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-4a19a83c-cdc8-45f1-a85b-c44c80e7a421 tempest-CinderUnicodeTest-1483653559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (396512de-4f8a-4b38-94d8-a5245e7426ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:25:17 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-4a19a83c-cdc8-45f1-a85b-c44c80e7a421 tempest-CinderUnicodeTest-1483653559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (396512de-4f8a-4b38-94d8-a5245e7426ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c002e14-b5da-47b9-a3f3-5bebad1e0a6d', 'volume_name': 'volume-4c002e14-b5da-47b9-a3f3-5bebad1e0a6d', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:25:17 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-4a19a83c-cdc8-45f1-a85b-c44c80e7a421 tempest-CinderUnicodeTest-1483653559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64a96de5-7ae7-4fd6-ba8e-d306c3f4a772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:25:17 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-4a19a83c-cdc8-45f1-a85b-c44c80e7a421 tempest-CinderUnicodeTest-1483653559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64a96de5-7ae7-4fd6-ba8e-d306c3f4a772) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:25:17 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-4a19a83c-cdc8-45f1-a85b-c44c80e7a421 tempest-CinderUnicodeTest-1483653559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf493f8a-4741-4d07-8b16-f480a971c940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:25:17 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-4a19a83c-cdc8-45f1-a85b-c44c80e7a421 tempest-CinderUnicodeTest-1483653559 None] Volume 4c002e14-b5da-47b9-a3f3-5bebad1e0a6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c002e14-b5da-47b9-a3f3-5bebad1e0a6d', 'volume_size': 1} Jul 22 03:25:17 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-4a19a83c-cdc8-45f1-a85b-c44c80e7a421 tempest-CinderUnicodeTest-1483653559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:25:17 devstack sudo[99375]: pam_unix(sudo:session): session closed for user root Jul 22 03:25:17 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-005593d8-b5f1-440c-b1ef-f29018748e56 tempest-GroupSnapshotsTest-172189020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-27766e11-001e-4ea6-be54-82fc3f88c5ad.info" returned: 0 in 0.331s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:25:17 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-005593d8-b5f1-440c-b1ef-f29018748e56 tempest-GroupSnapshotsTest-172189020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.144s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:25:17 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-005593d8-b5f1-440c-b1ef-f29018748e56 tempest-GroupSnapshotsTest-172189020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:25:17 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-005593d8-b5f1-440c-b1ef-f29018748e56 tempest-GroupSnapshotsTest-172189020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:25:17 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-005593d8-b5f1-440c-b1ef-f29018748e56 tempest-GroupSnapshotsTest-172189020 None] Creating offline snapshot a87af899-cde5-47cd-b7a6-70688078d7c1 of volume a69b0920-fdd0-4c2a-8463-2fc415c144f1 {{(pid=87747) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 03:25:17 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c1404e7-3959-46eb-b4cb-35a6b6fb1623]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:25:17 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-005593d8-b5f1-440c-b1ef-f29018748e56 tempest-GroupSnapshotsTest-172189020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a69b0920-fdd0-4c2a-8463-2fc415c144f1 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:25:17 devstack sudo[99382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a69b0920-fdd0-4c2a-8463-2fc415c144f1 Jul 22 03:25:17 devstack sudo[99382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:25:18 devstack sudo[99382]: pam_unix(sudo:session): session closed for user root Jul 22 03:25:18 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-005593d8-b5f1-440c-b1ef-f29018748e56 tempest-GroupSnapshotsTest-172189020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a69b0920-fdd0-4c2a-8463-2fc415c144f1" returned: 0 in 0.418s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:25:18 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-005593d8-b5f1-440c-b1ef-f29018748e56 tempest-GroupSnapshotsTest-172189020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a69b0920-fdd0-4c2a-8463-2fc415c144f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a69b0920-fdd0-4c2a-8463-2fc415c144f1.a87af899-cde5-47cd-b7a6-70688078d7c1 1G {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:25:18 devstack sudo[99387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a69b0920-fdd0-4c2a-8463-2fc415c144f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a69b0920-fdd0-4c2a-8463-2fc415c144f1.a87af899-cde5-47cd-b7a6-70688078d7c1 1G Jul 22 03:25:18 devstack sudo[99387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:25:18 devstack sudo[99387]: pam_unix(sudo:session): session closed for user root Jul 22 03:25:18 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-005593d8-b5f1-440c-b1ef-f29018748e56 tempest-GroupSnapshotsTest-172189020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a69b0920-fdd0-4c2a-8463-2fc415c144f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a69b0920-fdd0-4c2a-8463-2fc415c144f1.a87af899-cde5-47cd-b7a6-70688078d7c1 1G" returned: 0 in 0.426s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:25:18 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-005593d8-b5f1-440c-b1ef-f29018748e56 tempest-GroupSnapshotsTest-172189020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a69b0920-fdd0-4c2a-8463-2fc415c144f1 -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a69b0920-fdd0-4c2a-8463-2fc415c144f1.a87af899-cde5-47cd-b7a6-70688078d7c1 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:25:18 devstack sudo[99393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a69b0920-fdd0-4c2a-8463-2fc415c144f1 -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a69b0920-fdd0-4c2a-8463-2fc415c144f1.a87af899-cde5-47cd-b7a6-70688078d7c1 Jul 22 03:25:18 devstack sudo[99393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:25:18 devstack sudo[99393]: pam_unix(sudo:session): session closed for user root Jul 22 03:25:18 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-005593d8-b5f1-440c-b1ef-f29018748e56 tempest-GroupSnapshotsTest-172189020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a69b0920-fdd0-4c2a-8463-2fc415c144f1 -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a69b0920-fdd0-4c2a-8463-2fc415c144f1.a87af899-cde5-47cd-b7a6-70688078d7c1" returned: 0 in 0.299s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:25:18 devstack cinder-volume[87747]: WARNING cinder.volume.drivers.remotefs [None req-005593d8-b5f1-440c-b1ef-f29018748e56 tempest-GroupSnapshotsTest-172189020 None] /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a69b0920-fdd0-4c2a-8463-2fc415c144f1.a87af899-cde5-47cd-b7a6-70688078d7c1 is being set with open permissions: ugo+rw: NotImplementedError Jul 22 03:25:18 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-005593d8-b5f1-440c-b1ef-f29018748e56 tempest-GroupSnapshotsTest-172189020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a69b0920-fdd0-4c2a-8463-2fc415c144f1.a87af899-cde5-47cd-b7a6-70688078d7c1 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:25:18 devstack sudo[99410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a69b0920-fdd0-4c2a-8463-2fc415c144f1.a87af899-cde5-47cd-b7a6-70688078d7c1 Jul 22 03:25:18 devstack sudo[99410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:25:19 devstack sudo[99410]: pam_unix(sudo:session): session closed for user root Jul 22 03:25:19 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-005593d8-b5f1-440c-b1ef-f29018748e56 tempest-GroupSnapshotsTest-172189020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a69b0920-fdd0-4c2a-8463-2fc415c144f1.a87af899-cde5-47cd-b7a6-70688078d7c1" returned: 0 in 0.258s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:25:19 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-005593d8-b5f1-440c-b1ef-f29018748e56 tempest-GroupSnapshotsTest-172189020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a69b0920-fdd0-4c2a-8463-2fc415c144f1.info {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:25:19 devstack sudo[99420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a69b0920-fdd0-4c2a-8463-2fc415c144f1.info Jul 22 03:25:19 devstack sudo[99420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:25:19 devstack sudo[99420]: pam_unix(sudo:session): session closed for user root Jul 22 03:25:19 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-005593d8-b5f1-440c-b1ef-f29018748e56 tempest-GroupSnapshotsTest-172189020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a69b0920-fdd0-4c2a-8463-2fc415c144f1.info" returned: 0 in 0.274s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:25:19 devstack cinder-volume[87747]: WARNING cinder.volume.drivers.remotefs [None req-005593d8-b5f1-440c-b1ef-f29018748e56 tempest-GroupSnapshotsTest-172189020 None] /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a69b0920-fdd0-4c2a-8463-2fc415c144f1.info is being set with open permissions: ugo+rw: NotImplementedError Jul 22 03:25:19 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-005593d8-b5f1-440c-b1ef-f29018748e56 tempest-GroupSnapshotsTest-172189020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a69b0920-fdd0-4c2a-8463-2fc415c144f1.info {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:25:19 devstack sudo[99423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a69b0920-fdd0-4c2a-8463-2fc415c144f1.info Jul 22 03:25:19 devstack sudo[99423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:25:19 devstack sudo[99423]: pam_unix(sudo:session): session closed for user root Jul 22 03:25:19 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-005593d8-b5f1-440c-b1ef-f29018748e56 tempest-GroupSnapshotsTest-172189020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a69b0920-fdd0-4c2a-8463-2fc415c144f1.info" returned: 0 in 0.241s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:25:19 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-005593d8-b5f1-440c-b1ef-f29018748e56 tempest-GroupSnapshotsTest-172189020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.008s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:25:19 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-4a19a83c-cdc8-45f1-a85b-c44c80e7a421 tempest-CinderUnicodeTest-1483653559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.204s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:25:19 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-4a19a83c-cdc8-45f1-a85b-c44c80e7a421 tempest-CinderUnicodeTest-1483653559 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:25:17Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-706065795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c002e14-b5da-47b9-a3f3-5bebad1e0a6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fb0cc017456497b8cf42f55997a23d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:25:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:25:17Z,use_quota=True,user_id='bc7d2487892e4627829514752e4a62a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:25:19 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-4a19a83c-cdc8-45f1-a85b-c44c80e7a421 tempest-CinderUnicodeTest-1483653559 None] Creating volume 4c002e14-b5da-47b9-a3f3-5bebad1e0a6d {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:25:19 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-4a19a83c-cdc8-45f1-a85b-c44c80e7a421 tempest-CinderUnicodeTest-1483653559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:25:19 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-4a19a83c-cdc8-45f1-a85b-c44c80e7a421 tempest-CinderUnicodeTest-1483653559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:25:19 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-4a19a83c-cdc8-45f1-a85b-c44c80e7a421 tempest-CinderUnicodeTest-1483653559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:25:19 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-4a19a83c-cdc8-45f1-a85b-c44c80e7a421 tempest-CinderUnicodeTest-1483653559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:25:19 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-4a19a83c-cdc8-45f1-a85b-c44c80e7a421 tempest-CinderUnicodeTest-1483653559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:25:19 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-4a19a83c-cdc8-45f1-a85b-c44c80e7a421 tempest-CinderUnicodeTest-1483653559 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:25:19 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-4a19a83c-cdc8-45f1-a85b-c44c80e7a421 tempest-CinderUnicodeTest-1483653559 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:25:19 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-4a19a83c-cdc8-45f1-a85b-c44c80e7a421 tempest-CinderUnicodeTest-1483653559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4c002e14-b5da-47b9-a3f3-5bebad1e0a6d 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:25:19 devstack sudo[99426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4c002e14-b5da-47b9-a3f3-5bebad1e0a6d 1073741824 Jul 22 03:25:19 devstack sudo[99426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:25:19 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-005593d8-b5f1-440c-b1ef-f29018748e56 tempest-GroupSnapshotsTest-172189020 None] group_snapshot 715d6592-790a-45ff-a93c-77d2a3f9eda2: created successfully Jul 22 03:25:20 devstack sudo[99426]: pam_unix(sudo:session): session closed for user root Jul 22 03:25:20 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-4a19a83c-cdc8-45f1-a85b-c44c80e7a421 tempest-CinderUnicodeTest-1483653559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4c002e14-b5da-47b9-a3f3-5bebad1e0a6d 1073741824" returned: 0 in 0.419s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:25:20 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-4a19a83c-cdc8-45f1-a85b-c44c80e7a421 tempest-CinderUnicodeTest-1483653559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4c002e14-b5da-47b9-a3f3-5bebad1e0a6d {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:25:20 devstack sudo[99431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4c002e14-b5da-47b9-a3f3-5bebad1e0a6d Jul 22 03:25:20 devstack sudo[99431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:25:20 devstack sudo[99431]: pam_unix(sudo:session): session closed for user root Jul 22 03:25:20 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-4a19a83c-cdc8-45f1-a85b-c44c80e7a421 tempest-CinderUnicodeTest-1483653559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4c002e14-b5da-47b9-a3f3-5bebad1e0a6d" returned: 0 in 0.250s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:25:20 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-4a19a83c-cdc8-45f1-a85b-c44c80e7a421 tempest-CinderUnicodeTest-1483653559 None] <== create_volume: return (708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:25:20 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-4a19a83c-cdc8-45f1-a85b-c44c80e7a421 tempest-CinderUnicodeTest-1483653559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.713s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:25:20 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-4a19a83c-cdc8-45f1-a85b-c44c80e7a421 tempest-CinderUnicodeTest-1483653559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf493f8a-4741-4d07-8b16-f480a971c940) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c002e14-b5da-47b9-a3f3-5bebad1e0a6d', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:25:20 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-4a19a83c-cdc8-45f1-a85b-c44c80e7a421 tempest-CinderUnicodeTest-1483653559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e40ba985-58b2-49a7-86fc-7b5aad9e9f7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:25:20 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-4a19a83c-cdc8-45f1-a85b-c44c80e7a421 tempest-CinderUnicodeTest-1483653559 None] Volume volume-4c002e14-b5da-47b9-a3f3-5bebad1e0a6d (4c002e14-b5da-47b9-a3f3-5bebad1e0a6d): created successfully Jul 22 03:25:20 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-4a19a83c-cdc8-45f1-a85b-c44c80e7a421 tempest-CinderUnicodeTest-1483653559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e40ba985-58b2-49a7-86fc-7b5aad9e9f7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:25:20 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-4a19a83c-cdc8-45f1-a85b-c44c80e7a421 tempest-CinderUnicodeTest-1483653559 None] Flow 'volume_create_manager' (728f0fde-fb11-49cf-a983-511136715255) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:25:20 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-4a19a83c-cdc8-45f1-a85b-c44c80e7a421 tempest-CinderUnicodeTest-1483653559 None] Created volume successfully. Jul 22 03:25:20 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-d270355d-b832-4a96-a2b7-7483fc369b55 tempest-GroupSnapshotsTest-172189020 None] group_snapshot 715d6592-790a-45ff-a93c-77d2a3f9eda2: deleting Jul 22 03:25:20 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-d270355d-b832-4a96-a2b7-7483fc369b55 tempest-GroupSnapshotsTest-172189020 None] group_snapshot 715d6592-790a-45ff-a93c-77d2a3f9eda2: deleting {{(pid=87747) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 22 03:25:20 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-d270355d-b832-4a96-a2b7-7483fc369b55 tempest-GroupSnapshotsTest-172189020 None] Acquiring lock "cinder-quobyte-27766e11-001e-4ea6-be54-82fc3f88c5ad" by "delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:25:20 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-d270355d-b832-4a96-a2b7-7483fc369b55 tempest-GroupSnapshotsTest-172189020 None] Lock "cinder-quobyte-27766e11-001e-4ea6-be54-82fc3f88c5ad" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:25:20 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-d270355d-b832-4a96-a2b7-7483fc369b55 tempest-GroupSnapshotsTest-172189020 None] Acquiring lock "cinder-quobyte-1b11cd47-34cf-4124-90bd-e2cdaa45bbf7" by "_delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:25:20 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-d270355d-b832-4a96-a2b7-7483fc369b55 tempest-GroupSnapshotsTest-172189020 None] Lock "cinder-quobyte-1b11cd47-34cf-4124-90bd-e2cdaa45bbf7" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:25:20 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-d270355d-b832-4a96-a2b7-7483fc369b55 tempest-GroupSnapshotsTest-172189020 None] Deleting offline snapshot 1b11cd47-34cf-4124-90bd-e2cdaa45bbf7 of volume 27766e11-001e-4ea6-be54-82fc3f88c5ad {{(pid=87747) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 03:25:20 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-d270355d-b832-4a96-a2b7-7483fc369b55 tempest-GroupSnapshotsTest-172189020 None] snapshot_file for this snap is: volume-27766e11-001e-4ea6-be54-82fc3f88c5ad.1b11cd47-34cf-4124-90bd-e2cdaa45bbf7 {{(pid=87747) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 03:25:20 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[d81acf21-c357-41e5-8ec3-c4929aaf6946]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:25:20 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d270355d-b832-4a96-a2b7-7483fc369b55 tempest-GroupSnapshotsTest-172189020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-27766e11-001e-4ea6-be54-82fc3f88c5ad.1b11cd47-34cf-4124-90bd-e2cdaa45bbf7 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:25:20 devstack sudo[99434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-27766e11-001e-4ea6-be54-82fc3f88c5ad.1b11cd47-34cf-4124-90bd-e2cdaa45bbf7 Jul 22 03:25:20 devstack sudo[99434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:25:21 devstack sudo[99434]: pam_unix(sudo:session): session closed for user root Jul 22 03:25:21 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d270355d-b832-4a96-a2b7-7483fc369b55 tempest-GroupSnapshotsTest-172189020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-27766e11-001e-4ea6-be54-82fc3f88c5ad.1b11cd47-34cf-4124-90bd-e2cdaa45bbf7" returned: 0 in 0.357s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:25:21 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-d270355d-b832-4a96-a2b7-7483fc369b55 tempest-GroupSnapshotsTest-172189020 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-27766e11-001e-4ea6-be54-82fc3f88c5ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87747) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 03:25:21 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[113f608b-9476-4c9c-a051-844ab0864de5]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:25:21 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d270355d-b832-4a96-a2b7-7483fc369b55 tempest-GroupSnapshotsTest-172189020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-27766e11-001e-4ea6-be54-82fc3f88c5ad {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:25:21 devstack sudo[99439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-27766e11-001e-4ea6-be54-82fc3f88c5ad Jul 22 03:25:21 devstack sudo[99439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:25:21 devstack sudo[99439]: pam_unix(sudo:session): session closed for user root Jul 22 03:25:21 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d270355d-b832-4a96-a2b7-7483fc369b55 tempest-GroupSnapshotsTest-172189020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-27766e11-001e-4ea6-be54-82fc3f88c5ad" returned: 0 in 0.345s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:25:21 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d270355d-b832-4a96-a2b7-7483fc369b55 tempest-GroupSnapshotsTest-172189020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-27766e11-001e-4ea6-be54-82fc3f88c5ad.1b11cd47-34cf-4124-90bd-e2cdaa45bbf7 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:25:21 devstack sudo[99444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-27766e11-001e-4ea6-be54-82fc3f88c5ad.1b11cd47-34cf-4124-90bd-e2cdaa45bbf7 Jul 22 03:25:21 devstack sudo[99444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:25:21 devstack sudo[99444]: pam_unix(sudo:session): session closed for user root Jul 22 03:25:21 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d270355d-b832-4a96-a2b7-7483fc369b55 tempest-GroupSnapshotsTest-172189020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-27766e11-001e-4ea6-be54-82fc3f88c5ad.1b11cd47-34cf-4124-90bd-e2cdaa45bbf7" returned: 0 in 0.345s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:25:21 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d270355d-b832-4a96-a2b7-7483fc369b55 tempest-GroupSnapshotsTest-172189020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-27766e11-001e-4ea6-be54-82fc3f88c5ad.1b11cd47-34cf-4124-90bd-e2cdaa45bbf7 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:25:21 devstack sudo[99450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-27766e11-001e-4ea6-be54-82fc3f88c5ad.1b11cd47-34cf-4124-90bd-e2cdaa45bbf7 Jul 22 03:25:21 devstack sudo[99450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:25:21 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-aea57a48-d302-49e4-92ff-b1c4c23fdef7 tempest-CinderUnicodeTest-1483653559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:25:21 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-aea57a48-d302-49e4-92ff-b1c4c23fdef7 tempest-CinderUnicodeTest-1483653559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:25:21 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-aea57a48-d302-49e4-92ff-b1c4c23fdef7 tempest-CinderUnicodeTest-1483653559 None] Creating offline snapshot 1d7d45c9-3121-433d-bced-454a2c284aab of volume 4c002e14-b5da-47b9-a3f3-5bebad1e0a6d {{(pid=87747) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 03:25:21 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ad9dd01-b596-4246-a04f-766bdbe81569]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:25:21 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-aea57a48-d302-49e4-92ff-b1c4c23fdef7 tempest-CinderUnicodeTest-1483653559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4c002e14-b5da-47b9-a3f3-5bebad1e0a6d {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:25:21 devstack sudo[99452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4c002e14-b5da-47b9-a3f3-5bebad1e0a6d Jul 22 03:25:21 devstack sudo[99452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:25:22 devstack sudo[99450]: pam_unix(sudo:session): session closed for user root Jul 22 03:25:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d270355d-b832-4a96-a2b7-7483fc369b55 tempest-GroupSnapshotsTest-172189020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-27766e11-001e-4ea6-be54-82fc3f88c5ad.1b11cd47-34cf-4124-90bd-e2cdaa45bbf7" returned: 0 in 0.252s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:25:22 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-d270355d-b832-4a96-a2b7-7483fc369b55 tempest-GroupSnapshotsTest-172189020 None] Lock "cinder-quobyte-1b11cd47-34cf-4124-90bd-e2cdaa45bbf7" released by "_delete_snapshot" :: held 1.397s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:25:22 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-d270355d-b832-4a96-a2b7-7483fc369b55 tempest-GroupSnapshotsTest-172189020 None] Lock "cinder-quobyte-27766e11-001e-4ea6-be54-82fc3f88c5ad" released by "delete_snapshot" :: held 1.418s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:25:22 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-d270355d-b832-4a96-a2b7-7483fc369b55 tempest-GroupSnapshotsTest-172189020 None] Acquiring lock "cinder-quobyte-a69b0920-fdd0-4c2a-8463-2fc415c144f1" by "delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:25:22 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-d270355d-b832-4a96-a2b7-7483fc369b55 tempest-GroupSnapshotsTest-172189020 None] Lock "cinder-quobyte-a69b0920-fdd0-4c2a-8463-2fc415c144f1" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:25:22 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-d270355d-b832-4a96-a2b7-7483fc369b55 tempest-GroupSnapshotsTest-172189020 None] Acquiring lock "cinder-quobyte-a87af899-cde5-47cd-b7a6-70688078d7c1" by "_delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:25:22 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-d270355d-b832-4a96-a2b7-7483fc369b55 tempest-GroupSnapshotsTest-172189020 None] Lock "cinder-quobyte-a87af899-cde5-47cd-b7a6-70688078d7c1" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:25:22 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-d270355d-b832-4a96-a2b7-7483fc369b55 tempest-GroupSnapshotsTest-172189020 None] Deleting offline snapshot a87af899-cde5-47cd-b7a6-70688078d7c1 of volume a69b0920-fdd0-4c2a-8463-2fc415c144f1 {{(pid=87747) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 03:25:22 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-d270355d-b832-4a96-a2b7-7483fc369b55 tempest-GroupSnapshotsTest-172189020 None] snapshot_file for this snap is: volume-a69b0920-fdd0-4c2a-8463-2fc415c144f1.a87af899-cde5-47cd-b7a6-70688078d7c1 {{(pid=87747) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 03:25:22 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd6047f1-1dd0-42be-9f99-34aae8827852]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:25:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d270355d-b832-4a96-a2b7-7483fc369b55 tempest-GroupSnapshotsTest-172189020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a69b0920-fdd0-4c2a-8463-2fc415c144f1.a87af899-cde5-47cd-b7a6-70688078d7c1 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:25:22 devstack sudo[99452]: pam_unix(sudo:session): session closed for user root Jul 22 03:25:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-aea57a48-d302-49e4-92ff-b1c4c23fdef7 tempest-CinderUnicodeTest-1483653559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4c002e14-b5da-47b9-a3f3-5bebad1e0a6d" returned: 0 in 0.365s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:25:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-aea57a48-d302-49e4-92ff-b1c4c23fdef7 tempest-CinderUnicodeTest-1483653559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4c002e14-b5da-47b9-a3f3-5bebad1e0a6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4c002e14-b5da-47b9-a3f3-5bebad1e0a6d.1d7d45c9-3121-433d-bced-454a2c284aab 1G {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:25:22 devstack sudo[99459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4c002e14-b5da-47b9-a3f3-5bebad1e0a6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4c002e14-b5da-47b9-a3f3-5bebad1e0a6d.1d7d45c9-3121-433d-bced-454a2c284aab 1G Jul 22 03:25:22 devstack sudo[99459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:25:22 devstack sudo[99456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a69b0920-fdd0-4c2a-8463-2fc415c144f1.a87af899-cde5-47cd-b7a6-70688078d7c1 Jul 22 03:25:22 devstack sudo[99456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:25:22 devstack cinder-volume[87747]: DEBUG oslo_service.periodic_task [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87747) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 03:25:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:25:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:25:22 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:25:22 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:25:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:25:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:25:22 devstack sudo[99456]: pam_unix(sudo:session): session closed for user root Jul 22 03:25:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d270355d-b832-4a96-a2b7-7483fc369b55 tempest-GroupSnapshotsTest-172189020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a69b0920-fdd0-4c2a-8463-2fc415c144f1.a87af899-cde5-47cd-b7a6-70688078d7c1" returned: 0 in 0.353s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:25:22 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-d270355d-b832-4a96-a2b7-7483fc369b55 tempest-GroupSnapshotsTest-172189020 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a69b0920-fdd0-4c2a-8463-2fc415c144f1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87747) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 03:25:22 devstack sudo[99468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:25:22 devstack sudo[99468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:25:22 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[a75173e4-c73b-436c-8655-9525e8d07ec8]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:25:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d270355d-b832-4a96-a2b7-7483fc369b55 tempest-GroupSnapshotsTest-172189020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a69b0920-fdd0-4c2a-8463-2fc415c144f1 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:25:22 devstack sudo[99459]: pam_unix(sudo:session): session closed for user root Jul 22 03:25:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-aea57a48-d302-49e4-92ff-b1c4c23fdef7 tempest-CinderUnicodeTest-1483653559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4c002e14-b5da-47b9-a3f3-5bebad1e0a6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4c002e14-b5da-47b9-a3f3-5bebad1e0a6d.1d7d45c9-3121-433d-bced-454a2c284aab 1G" returned: 0 in 0.414s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:25:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-aea57a48-d302-49e4-92ff-b1c4c23fdef7 tempest-CinderUnicodeTest-1483653559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c002e14-b5da-47b9-a3f3-5bebad1e0a6d -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4c002e14-b5da-47b9-a3f3-5bebad1e0a6d.1d7d45c9-3121-433d-bced-454a2c284aab {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:25:22 devstack sudo[99470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a69b0920-fdd0-4c2a-8463-2fc415c144f1 Jul 22 03:25:22 devstack sudo[99470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:25:22 devstack sudo[99471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c002e14-b5da-47b9-a3f3-5bebad1e0a6d -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4c002e14-b5da-47b9-a3f3-5bebad1e0a6d.1d7d45c9-3121-433d-bced-454a2c284aab Jul 22 03:25:22 devstack sudo[99471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:25:22 devstack sudo[99468]: pam_unix(sudo:session): session closed for user root Jul 22 03:25:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.261s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:25:22 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:25:22 devstack cinder-volume[87747]: DEBUG oslo_service.periodic_task [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Running periodic task VolumeManager._thread_info {{(pid=87747) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 03:25:22 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] thread count: 28 {{(pid=87747) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 22 03:25:22 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] thread info: [<_MainThread(MainThread, started 132775275860096)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87747) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 22 03:25:22 devstack sudo[99470]: pam_unix(sudo:session): session closed for user root Jul 22 03:25:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d270355d-b832-4a96-a2b7-7483fc369b55 tempest-GroupSnapshotsTest-172189020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a69b0920-fdd0-4c2a-8463-2fc415c144f1" returned: 0 in 0.372s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:25:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d270355d-b832-4a96-a2b7-7483fc369b55 tempest-GroupSnapshotsTest-172189020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a69b0920-fdd0-4c2a-8463-2fc415c144f1.a87af899-cde5-47cd-b7a6-70688078d7c1 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:25:22 devstack sudo[99471]: pam_unix(sudo:session): session closed for user root Jul 22 03:25:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-aea57a48-d302-49e4-92ff-b1c4c23fdef7 tempest-CinderUnicodeTest-1483653559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c002e14-b5da-47b9-a3f3-5bebad1e0a6d -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4c002e14-b5da-47b9-a3f3-5bebad1e0a6d.1d7d45c9-3121-433d-bced-454a2c284aab" returned: 0 in 0.302s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:25:22 devstack cinder-volume[87747]: WARNING cinder.volume.drivers.remotefs [None req-aea57a48-d302-49e4-92ff-b1c4c23fdef7 tempest-CinderUnicodeTest-1483653559 None] /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4c002e14-b5da-47b9-a3f3-5bebad1e0a6d.1d7d45c9-3121-433d-bced-454a2c284aab is being set with open permissions: ugo+rw Jul 22 03:25:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-aea57a48-d302-49e4-92ff-b1c4c23fdef7 tempest-CinderUnicodeTest-1483653559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4c002e14-b5da-47b9-a3f3-5bebad1e0a6d.1d7d45c9-3121-433d-bced-454a2c284aab {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:25:22 devstack sudo[99481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a69b0920-fdd0-4c2a-8463-2fc415c144f1.a87af899-cde5-47cd-b7a6-70688078d7c1 Jul 22 03:25:22 devstack sudo[99481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:25:22 devstack sudo[99483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4c002e14-b5da-47b9-a3f3-5bebad1e0a6d.1d7d45c9-3121-433d-bced-454a2c284aab Jul 22 03:25:22 devstack sudo[99483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:25:23 devstack sudo[99483]: pam_unix(sudo:session): session closed for user root Jul 22 03:25:23 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-aea57a48-d302-49e4-92ff-b1c4c23fdef7 tempest-CinderUnicodeTest-1483653559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4c002e14-b5da-47b9-a3f3-5bebad1e0a6d.1d7d45c9-3121-433d-bced-454a2c284aab" returned: 0 in 0.238s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:25:23 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-aea57a48-d302-49e4-92ff-b1c4c23fdef7 tempest-CinderUnicodeTest-1483653559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4c002e14-b5da-47b9-a3f3-5bebad1e0a6d.info {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:25:23 devstack sudo[99490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4c002e14-b5da-47b9-a3f3-5bebad1e0a6d.info Jul 22 03:25:23 devstack sudo[99490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:25:23 devstack sudo[99481]: pam_unix(sudo:session): session closed for user root Jul 22 03:25:23 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d270355d-b832-4a96-a2b7-7483fc369b55 tempest-GroupSnapshotsTest-172189020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a69b0920-fdd0-4c2a-8463-2fc415c144f1.a87af899-cde5-47cd-b7a6-70688078d7c1" returned: 0 in 0.349s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:25:23 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d270355d-b832-4a96-a2b7-7483fc369b55 tempest-GroupSnapshotsTest-172189020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a69b0920-fdd0-4c2a-8463-2fc415c144f1.a87af899-cde5-47cd-b7a6-70688078d7c1 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:25:23 devstack sudo[99492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a69b0920-fdd0-4c2a-8463-2fc415c144f1.a87af899-cde5-47cd-b7a6-70688078d7c1 Jul 22 03:25:23 devstack sudo[99492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:25:23 devstack sudo[99490]: pam_unix(sudo:session): session closed for user root Jul 22 03:25:23 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-aea57a48-d302-49e4-92ff-b1c4c23fdef7 tempest-CinderUnicodeTest-1483653559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4c002e14-b5da-47b9-a3f3-5bebad1e0a6d.info" returned: 0 in 0.264s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:25:23 devstack cinder-volume[87747]: WARNING cinder.volume.drivers.remotefs [None req-aea57a48-d302-49e4-92ff-b1c4c23fdef7 tempest-CinderUnicodeTest-1483653559 None] /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4c002e14-b5da-47b9-a3f3-5bebad1e0a6d.info is being set with open permissions: ugo+rw Jul 22 03:25:23 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-aea57a48-d302-49e4-92ff-b1c4c23fdef7 tempest-CinderUnicodeTest-1483653559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4c002e14-b5da-47b9-a3f3-5bebad1e0a6d.info {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:25:23 devstack sudo[99492]: pam_unix(sudo:session): session closed for user root Jul 22 03:25:23 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d270355d-b832-4a96-a2b7-7483fc369b55 tempest-GroupSnapshotsTest-172189020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a69b0920-fdd0-4c2a-8463-2fc415c144f1.a87af899-cde5-47cd-b7a6-70688078d7c1" returned: 0 in 0.253s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:25:23 devstack sudo[99496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4c002e14-b5da-47b9-a3f3-5bebad1e0a6d.info Jul 22 03:25:23 devstack sudo[99496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:25:23 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-d270355d-b832-4a96-a2b7-7483fc369b55 tempest-GroupSnapshotsTest-172189020 None] Lock "cinder-quobyte-a87af899-cde5-47cd-b7a6-70688078d7c1" released by "_delete_snapshot" :: held 1.425s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:25:23 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-d270355d-b832-4a96-a2b7-7483fc369b55 tempest-GroupSnapshotsTest-172189020 None] Lock "cinder-quobyte-a69b0920-fdd0-4c2a-8463-2fc415c144f1" released by "delete_snapshot" :: held 1.449s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:25:23 devstack cinder-volume[87747]: WARNING cinder.quota [None req-d270355d-b832-4a96-a2b7-7483fc369b55 tempest-GroupSnapshotsTest-172189020 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1336311484 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1336311484, it is now deprecated. Please use the default quota class for default quota. Jul 22 03:25:23 devstack cinder-volume[87747]: WARNING cinder.quota [None req-d270355d-b832-4a96-a2b7-7483fc369b55 tempest-GroupSnapshotsTest-172189020 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1336311484 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1336311484, it is now deprecated. Please use the default quota class for default quota. Jul 22 03:25:23 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-d270355d-b832-4a96-a2b7-7483fc369b55 tempest-GroupSnapshotsTest-172189020 None] Created reservations ['f67c14f8-6440-4b64-92c5-452071dd5c38', '3c0758cf-69e5-43b1-9245-ede16ce338e2', '008f2ec6-7d93-4f82-8fd5-dc5737e01975', '3d91de22-93d7-45a6-a504-fe7e189747de'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:25:23 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-d270355d-b832-4a96-a2b7-7483fc369b55 tempest-GroupSnapshotsTest-172189020 None] Created reservations ['4f3aedcc-df50-4c8a-b688-60f17385d5a3', 'ce51c29c-5cf1-41d9-9201-15f29eb35d70', '8abecc3e-2302-42ee-b2b4-5bccb48fd225', '186a1062-1d59-4b7b-a800-8ac58bada447'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:25:23 devstack sudo[99496]: pam_unix(sudo:session): session closed for user root Jul 22 03:25:23 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-aea57a48-d302-49e4-92ff-b1c4c23fdef7 tempest-CinderUnicodeTest-1483653559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4c002e14-b5da-47b9-a3f3-5bebad1e0a6d.info" returned: 0 in 0.264s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:25:23 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-aea57a48-d302-49e4-92ff-b1c4c23fdef7 tempest-CinderUnicodeTest-1483653559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.942s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:25:23 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-aea57a48-d302-49e4-92ff-b1c4c23fdef7 tempest-CinderUnicodeTest-1483653559 None] Create snapshot completed successfully Jul 22 03:25:23 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-d270355d-b832-4a96-a2b7-7483fc369b55 tempest-GroupSnapshotsTest-172189020 None] group_snapshot 715d6592-790a-45ff-a93c-77d2a3f9eda2: deleted successfully Jul 22 03:25:23 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-f55452b2-9892-4aa4-85e6-fe96783bacbd tempest-CinderUnicodeTest-1483653559 None] Acquiring lock "cinder-1d7d45c9-3121-433d-bced-454a2c284aab-delete_snapshot" by "delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:25:23 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-f55452b2-9892-4aa4-85e6-fe96783bacbd tempest-CinderUnicodeTest-1483653559 None] Lock "cinder-1d7d45c9-3121-433d-bced-454a2c284aab-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:25:23 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-f55452b2-9892-4aa4-85e6-fe96783bacbd tempest-CinderUnicodeTest-1483653559 None] Acquiring lock "cinder-quobyte-4c002e14-b5da-47b9-a3f3-5bebad1e0a6d" by "delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:25:23 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-f55452b2-9892-4aa4-85e6-fe96783bacbd tempest-CinderUnicodeTest-1483653559 None] Lock "cinder-quobyte-4c002e14-b5da-47b9-a3f3-5bebad1e0a6d" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:25:23 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-f55452b2-9892-4aa4-85e6-fe96783bacbd tempest-CinderUnicodeTest-1483653559 None] Acquiring lock "cinder-quobyte-1d7d45c9-3121-433d-bced-454a2c284aab" by "_delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:25:23 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-f55452b2-9892-4aa4-85e6-fe96783bacbd tempest-CinderUnicodeTest-1483653559 None] Lock "cinder-quobyte-1d7d45c9-3121-433d-bced-454a2c284aab" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:25:23 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-f55452b2-9892-4aa4-85e6-fe96783bacbd tempest-CinderUnicodeTest-1483653559 None] Deleting offline snapshot 1d7d45c9-3121-433d-bced-454a2c284aab of volume 4c002e14-b5da-47b9-a3f3-5bebad1e0a6d {{(pid=87747) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 03:25:23 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-f55452b2-9892-4aa4-85e6-fe96783bacbd tempest-CinderUnicodeTest-1483653559 None] snapshot_file for this snap is: volume-4c002e14-b5da-47b9-a3f3-5bebad1e0a6d.1d7d45c9-3121-433d-bced-454a2c284aab {{(pid=87747) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 03:25:23 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f2b90b9-d3e1-4714-a8fa-4e7c3b412862]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:25:23 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f55452b2-9892-4aa4-85e6-fe96783bacbd tempest-CinderUnicodeTest-1483653559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4c002e14-b5da-47b9-a3f3-5bebad1e0a6d.1d7d45c9-3121-433d-bced-454a2c284aab {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:25:24 devstack sudo[99499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4c002e14-b5da-47b9-a3f3-5bebad1e0a6d.1d7d45c9-3121-433d-bced-454a2c284aab Jul 22 03:25:24 devstack sudo[99499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:25:24 devstack sudo[99499]: pam_unix(sudo:session): session closed for user root Jul 22 03:25:24 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f55452b2-9892-4aa4-85e6-fe96783bacbd tempest-CinderUnicodeTest-1483653559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4c002e14-b5da-47b9-a3f3-5bebad1e0a6d.1d7d45c9-3121-433d-bced-454a2c284aab" returned: 0 in 0.373s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:25:24 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-f55452b2-9892-4aa4-85e6-fe96783bacbd tempest-CinderUnicodeTest-1483653559 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4c002e14-b5da-47b9-a3f3-5bebad1e0a6d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87747) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 03:25:24 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[d492d6f1-52e3-446a-86d8-36751fb3a5ce]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:25:24 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f55452b2-9892-4aa4-85e6-fe96783bacbd tempest-CinderUnicodeTest-1483653559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4c002e14-b5da-47b9-a3f3-5bebad1e0a6d {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:25:24 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-2cbbfb9e-c36b-4573-bc96-62a22276cd3e tempest-GroupSnapshotsTest-172189020 None] Acquiring lock "cinder-quobyte-27766e11-001e-4ea6-be54-82fc3f88c5ad" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:25:24 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-2cbbfb9e-c36b-4573-bc96-62a22276cd3e tempest-GroupSnapshotsTest-172189020 None] Lock "cinder-quobyte-27766e11-001e-4ea6-be54-82fc3f88c5ad" acquired by "delete_volume" :: waited 0.019s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:25:24 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e22cff1-38c3-4a35-8f91-9fb3e2a71868]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:25:24 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2cbbfb9e-c36b-4573-bc96-62a22276cd3e tempest-GroupSnapshotsTest-172189020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-27766e11-001e-4ea6-be54-82fc3f88c5ad {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:25:24 devstack sudo[99504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4c002e14-b5da-47b9-a3f3-5bebad1e0a6d Jul 22 03:25:24 devstack sudo[99504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:25:24 devstack sudo[99505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-27766e11-001e-4ea6-be54-82fc3f88c5ad Jul 22 03:25:24 devstack sudo[99505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:25:24 devstack sudo[99504]: pam_unix(sudo:session): session closed for user root Jul 22 03:25:24 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f55452b2-9892-4aa4-85e6-fe96783bacbd tempest-CinderUnicodeTest-1483653559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4c002e14-b5da-47b9-a3f3-5bebad1e0a6d" returned: 0 in 0.364s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:25:24 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f55452b2-9892-4aa4-85e6-fe96783bacbd tempest-CinderUnicodeTest-1483653559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4c002e14-b5da-47b9-a3f3-5bebad1e0a6d.1d7d45c9-3121-433d-bced-454a2c284aab {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:25:24 devstack sudo[99511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4c002e14-b5da-47b9-a3f3-5bebad1e0a6d.1d7d45c9-3121-433d-bced-454a2c284aab Jul 22 03:25:24 devstack sudo[99511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:25:24 devstack sudo[99505]: pam_unix(sudo:session): session closed for user root Jul 22 03:25:24 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2cbbfb9e-c36b-4573-bc96-62a22276cd3e tempest-GroupSnapshotsTest-172189020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-27766e11-001e-4ea6-be54-82fc3f88c5ad" returned: 0 in 0.378s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:25:24 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2cbbfb9e-c36b-4573-bc96-62a22276cd3e tempest-GroupSnapshotsTest-172189020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-27766e11-001e-4ea6-be54-82fc3f88c5ad {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:25:24 devstack sudo[99516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-27766e11-001e-4ea6-be54-82fc3f88c5ad Jul 22 03:25:24 devstack sudo[99516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:25:25 devstack sudo[99511]: pam_unix(sudo:session): session closed for user root Jul 22 03:25:25 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f55452b2-9892-4aa4-85e6-fe96783bacbd tempest-CinderUnicodeTest-1483653559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4c002e14-b5da-47b9-a3f3-5bebad1e0a6d.1d7d45c9-3121-433d-bced-454a2c284aab" returned: 0 in 0.336s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:25:25 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f55452b2-9892-4aa4-85e6-fe96783bacbd tempest-CinderUnicodeTest-1483653559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4c002e14-b5da-47b9-a3f3-5bebad1e0a6d.1d7d45c9-3121-433d-bced-454a2c284aab {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:25:25 devstack sudo[99516]: pam_unix(sudo:session): session closed for user root Jul 22 03:25:25 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2cbbfb9e-c36b-4573-bc96-62a22276cd3e tempest-GroupSnapshotsTest-172189020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-27766e11-001e-4ea6-be54-82fc3f88c5ad" returned: 0 in 0.264s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:25:25 devstack sudo[99522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4c002e14-b5da-47b9-a3f3-5bebad1e0a6d.1d7d45c9-3121-433d-bced-454a2c284aab Jul 22 03:25:25 devstack sudo[99522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:25:25 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-2cbbfb9e-c36b-4573-bc96-62a22276cd3e tempest-GroupSnapshotsTest-172189020 None] Lock "cinder-quobyte-27766e11-001e-4ea6-be54-82fc3f88c5ad" released by "delete_volume" :: held 0.704s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:25:25 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-2cbbfb9e-c36b-4573-bc96-62a22276cd3e tempest-GroupSnapshotsTest-172189020 None] Acquiring lock "cinder-quobyte-a69b0920-fdd0-4c2a-8463-2fc415c144f1" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:25:25 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-2cbbfb9e-c36b-4573-bc96-62a22276cd3e tempest-GroupSnapshotsTest-172189020 None] Lock "cinder-quobyte-a69b0920-fdd0-4c2a-8463-2fc415c144f1" acquired by "delete_volume" :: waited 0.012s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:25:25 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7d184f2-da5c-4cfe-befd-618035622295]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:25:25 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2cbbfb9e-c36b-4573-bc96-62a22276cd3e tempest-GroupSnapshotsTest-172189020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a69b0920-fdd0-4c2a-8463-2fc415c144f1 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:25:25 devstack sudo[99524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a69b0920-fdd0-4c2a-8463-2fc415c144f1 Jul 22 03:25:25 devstack sudo[99524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:25:25 devstack sudo[99522]: pam_unix(sudo:session): session closed for user root Jul 22 03:25:25 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f55452b2-9892-4aa4-85e6-fe96783bacbd tempest-CinderUnicodeTest-1483653559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4c002e14-b5da-47b9-a3f3-5bebad1e0a6d.1d7d45c9-3121-433d-bced-454a2c284aab" returned: 0 in 0.250s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:25:25 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-f55452b2-9892-4aa4-85e6-fe96783bacbd tempest-CinderUnicodeTest-1483653559 None] Lock "cinder-quobyte-1d7d45c9-3121-433d-bced-454a2c284aab" released by "_delete_snapshot" :: held 1.437s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:25:25 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-f55452b2-9892-4aa4-85e6-fe96783bacbd tempest-CinderUnicodeTest-1483653559 None] Lock "cinder-quobyte-4c002e14-b5da-47b9-a3f3-5bebad1e0a6d" released by "delete_snapshot" :: held 1.466s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:25:25 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-f55452b2-9892-4aa4-85e6-fe96783bacbd tempest-CinderUnicodeTest-1483653559 None] Created reservations ['7a03fbe7-5be2-446f-9390-0f4e6b812410', '91e7d9d9-c3dc-4b98-97fc-435bef8eb09e', 'f28a9c82-cb28-4b49-93eb-b8a8a5c89b69', '3a26e907-26a0-4556-91ab-217726327b29'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:25:25 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-f55452b2-9892-4aa4-85e6-fe96783bacbd tempest-CinderUnicodeTest-1483653559 None] Delete snapshot completed successfully. Jul 22 03:25:25 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-f55452b2-9892-4aa4-85e6-fe96783bacbd tempest-CinderUnicodeTest-1483653559 None] Lock "cinder-1d7d45c9-3121-433d-bced-454a2c284aab-delete_snapshot" released by "delete_snapshot" :: held 1.600s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:25:25 devstack sudo[99524]: pam_unix(sudo:session): session closed for user root Jul 22 03:25:25 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2cbbfb9e-c36b-4573-bc96-62a22276cd3e tempest-GroupSnapshotsTest-172189020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a69b0920-fdd0-4c2a-8463-2fc415c144f1" returned: 0 in 0.375s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:25:25 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2cbbfb9e-c36b-4573-bc96-62a22276cd3e tempest-GroupSnapshotsTest-172189020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a69b0920-fdd0-4c2a-8463-2fc415c144f1 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:25:25 devstack sudo[99530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a69b0920-fdd0-4c2a-8463-2fc415c144f1 Jul 22 03:25:25 devstack sudo[99530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:25:25 devstack sudo[99530]: pam_unix(sudo:session): session closed for user root Jul 22 03:25:25 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2cbbfb9e-c36b-4573-bc96-62a22276cd3e tempest-GroupSnapshotsTest-172189020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a69b0920-fdd0-4c2a-8463-2fc415c144f1" returned: 0 in 0.256s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:25:25 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-2cbbfb9e-c36b-4573-bc96-62a22276cd3e tempest-GroupSnapshotsTest-172189020 None] Lock "cinder-quobyte-a69b0920-fdd0-4c2a-8463-2fc415c144f1" released by "delete_volume" :: held 0.681s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:25:25 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-2cbbfb9e-c36b-4573-bc96-62a22276cd3e tempest-GroupSnapshotsTest-172189020 None] Created reservations ['4faa9b80-0746-43d9-a8c8-c98a093133eb'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:25:25 devstack cinder-volume[87747]: WARNING cinder.quota [None req-2cbbfb9e-c36b-4573-bc96-62a22276cd3e tempest-GroupSnapshotsTest-172189020 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1336311484 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1336311484, it is now deprecated. Please use the default quota class for default quota. Jul 22 03:25:25 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-2cbbfb9e-c36b-4573-bc96-62a22276cd3e tempest-GroupSnapshotsTest-172189020 None] Created reservations ['fdeda5d6-13a4-400d-a272-817d8b9ee35d', 'a197d815-e786-40e0-9401-8ab10f3aaa66', '27017a9d-de51-4034-a7b0-1210083399b1', '0d8a7cc4-ce77-40a4-a4a0-94b05c91a6dc'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:25:26 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-2cbbfb9e-c36b-4573-bc96-62a22276cd3e tempest-GroupSnapshotsTest-172189020 None] Created reservations ['bf19e452-f9fe-4834-a726-bc8ad83b487f', 'e6861022-775b-4f9c-bfa5-7754752baf1e', '05ce24f5-5fd3-4995-b4d9-5c8700cf3791', 'b518ba42-455d-4574-9e4f-7ba237fa2e11'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:25:26 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-0de0ac27-7880-423a-a575-1ca1785564e1 tempest-CinderUnicodeTest-1483653559 None] Acquiring lock "cinder-4c002e14-b5da-47b9-a3f3-5bebad1e0a6d-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:25:26 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-0de0ac27-7880-423a-a575-1ca1785564e1 tempest-CinderUnicodeTest-1483653559 None] Lock "cinder-4c002e14-b5da-47b9-a3f3-5bebad1e0a6d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:25:26 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-0de0ac27-7880-423a-a575-1ca1785564e1 tempest-CinderUnicodeTest-1483653559 None] Acquiring lock "cinder-quobyte-4c002e14-b5da-47b9-a3f3-5bebad1e0a6d" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:25:26 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-0de0ac27-7880-423a-a575-1ca1785564e1 tempest-CinderUnicodeTest-1483653559 None] Lock "cinder-quobyte-4c002e14-b5da-47b9-a3f3-5bebad1e0a6d" acquired by "delete_volume" :: waited 0.019s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:25:26 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[92d720c3-b817-4c3c-9a07-06f0ee5e0c2d]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:25:26 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-0de0ac27-7880-423a-a575-1ca1785564e1 tempest-CinderUnicodeTest-1483653559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4c002e14-b5da-47b9-a3f3-5bebad1e0a6d {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:25:26 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-2cbbfb9e-c36b-4573-bc96-62a22276cd3e tempest-GroupSnapshotsTest-172189020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:25:26 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-2cbbfb9e-c36b-4573-bc96-62a22276cd3e tempest-GroupSnapshotsTest-172189020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:25:26 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-2cbbfb9e-c36b-4573-bc96-62a22276cd3e tempest-GroupSnapshotsTest-172189020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:25:26 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-2cbbfb9e-c36b-4573-bc96-62a22276cd3e tempest-GroupSnapshotsTest-172189020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:25:26 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-2cbbfb9e-c36b-4573-bc96-62a22276cd3e tempest-GroupSnapshotsTest-172189020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:25:26 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2cbbfb9e-c36b-4573-bc96-62a22276cd3e tempest-GroupSnapshotsTest-172189020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:25:26 devstack sudo[99534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:25:26 devstack sudo[99534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:25:26 devstack sudo[99533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4c002e14-b5da-47b9-a3f3-5bebad1e0a6d Jul 22 03:25:26 devstack sudo[99533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:25:26 devstack sudo[99534]: pam_unix(sudo:session): session closed for user root Jul 22 03:25:26 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2cbbfb9e-c36b-4573-bc96-62a22276cd3e tempest-GroupSnapshotsTest-172189020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.245s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:25:26 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-2cbbfb9e-c36b-4573-bc96-62a22276cd3e tempest-GroupSnapshotsTest-172189020 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:25:26 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-2cbbfb9e-c36b-4573-bc96-62a22276cd3e tempest-GroupSnapshotsTest-172189020 None] Delete group completed successfully. Jul 22 03:25:26 devstack sudo[99533]: pam_unix(sudo:session): session closed for user root Jul 22 03:25:26 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-0de0ac27-7880-423a-a575-1ca1785564e1 tempest-CinderUnicodeTest-1483653559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4c002e14-b5da-47b9-a3f3-5bebad1e0a6d" returned: 0 in 0.364s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:25:26 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-0de0ac27-7880-423a-a575-1ca1785564e1 tempest-CinderUnicodeTest-1483653559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4c002e14-b5da-47b9-a3f3-5bebad1e0a6d {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:25:26 devstack sudo[99541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4c002e14-b5da-47b9-a3f3-5bebad1e0a6d Jul 22 03:25:26 devstack sudo[99541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:25:26 devstack sudo[99541]: pam_unix(sudo:session): session closed for user root Jul 22 03:25:26 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-0de0ac27-7880-423a-a575-1ca1785564e1 tempest-CinderUnicodeTest-1483653559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4c002e14-b5da-47b9-a3f3-5bebad1e0a6d" returned: 0 in 0.268s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:25:26 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-0de0ac27-7880-423a-a575-1ca1785564e1 tempest-CinderUnicodeTest-1483653559 None] Lock "cinder-quobyte-4c002e14-b5da-47b9-a3f3-5bebad1e0a6d" released by "delete_volume" :: held 0.692s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:25:26 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-0de0ac27-7880-423a-a575-1ca1785564e1 tempest-CinderUnicodeTest-1483653559 None] Created reservations ['849e6186-367e-4834-84ef-24ec4d45dd83', '27803940-ba0c-4b80-918a-e6bf011ef945', '68f3dede-ea11-438d-98fa-c4c59d2f2e25', 'ee110a00-af07-487f-96c9-42eeaf047292'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:25:26 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-0de0ac27-7880-423a-a575-1ca1785564e1 tempest-CinderUnicodeTest-1483653559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:25:26 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-0de0ac27-7880-423a-a575-1ca1785564e1 tempest-CinderUnicodeTest-1483653559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:25:26 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-0de0ac27-7880-423a-a575-1ca1785564e1 tempest-CinderUnicodeTest-1483653559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:25:26 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-0de0ac27-7880-423a-a575-1ca1785564e1 tempest-CinderUnicodeTest-1483653559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:25:26 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-0de0ac27-7880-423a-a575-1ca1785564e1 tempest-CinderUnicodeTest-1483653559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:25:26 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-0de0ac27-7880-423a-a575-1ca1785564e1 tempest-CinderUnicodeTest-1483653559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:25:27 devstack sudo[99544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:25:27 devstack sudo[99544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:25:27 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-e083d532-681d-43f2-8958-149cd36bc397 tempest-CinderUnicodeTest-1483653559 None] Acquiring lock "cinder-308e6cb6-67a2-4769-a5e6-42d9e811afe3-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:25:27 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-357b9210-9e77-4f30-9b85-f7b902c7d4ab tempest-GroupSnapshotsTest-172189020 None] Group tempest-GroupSnapshotsTest-Group-1566444631: creating Jul 22 03:25:27 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-e083d532-681d-43f2-8958-149cd36bc397 tempest-CinderUnicodeTest-1483653559 None] Lock "cinder-308e6cb6-67a2-4769-a5e6-42d9e811afe3-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:25:27 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-357b9210-9e77-4f30-9b85-f7b902c7d4ab tempest-GroupSnapshotsTest-172189020 None] Group tempest-GroupSnapshotsTest-Group-1566444631: created successfully Jul 22 03:25:27 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-e083d532-681d-43f2-8958-149cd36bc397 tempest-CinderUnicodeTest-1483653559 None] Acquiring lock "cinder-quobyte-308e6cb6-67a2-4769-a5e6-42d9e811afe3" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:25:27 devstack sudo[99544]: pam_unix(sudo:session): session closed for user root Jul 22 03:25:27 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-0de0ac27-7880-423a-a575-1ca1785564e1 tempest-CinderUnicodeTest-1483653559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.398s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:25:27 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-0de0ac27-7880-423a-a575-1ca1785564e1 tempest-CinderUnicodeTest-1483653559 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:25:27 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-357b9210-9e77-4f30-9b85-f7b902c7d4ab tempest-GroupSnapshotsTest-172189020 None] Create group completed successfully. Jul 22 03:25:27 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-e083d532-681d-43f2-8958-149cd36bc397 tempest-CinderUnicodeTest-1483653559 None] Lock "cinder-quobyte-308e6cb6-67a2-4769-a5e6-42d9e811afe3" acquired by "delete_volume" :: waited 0.020s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:25:27 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-0de0ac27-7880-423a-a575-1ca1785564e1 tempest-CinderUnicodeTest-1483653559 None] Deleted volume successfully. Jul 22 03:25:27 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-0de0ac27-7880-423a-a575-1ca1785564e1 tempest-CinderUnicodeTest-1483653559 None] Lock "cinder-4c002e14-b5da-47b9-a3f3-5bebad1e0a6d-delete_volume" released by "delete_volume" :: held 1.359s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:25:27 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[84a00db5-4a12-4502-b394-6cd224496380]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:25:27 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-e083d532-681d-43f2-8958-149cd36bc397 tempest-CinderUnicodeTest-1483653559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-308e6cb6-67a2-4769-a5e6-42d9e811afe3 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:25:27 devstack sudo[99547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-308e6cb6-67a2-4769-a5e6-42d9e811afe3 Jul 22 03:25:27 devstack sudo[99547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:25:27 devstack sudo[99547]: pam_unix(sudo:session): session closed for user root Jul 22 03:25:27 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-e083d532-681d-43f2-8958-149cd36bc397 tempest-CinderUnicodeTest-1483653559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-308e6cb6-67a2-4769-a5e6-42d9e811afe3" returned: 0 in 0.375s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:25:27 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-e083d532-681d-43f2-8958-149cd36bc397 tempest-CinderUnicodeTest-1483653559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-308e6cb6-67a2-4769-a5e6-42d9e811afe3 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:25:27 devstack sudo[99552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-308e6cb6-67a2-4769-a5e6-42d9e811afe3 Jul 22 03:25:27 devstack sudo[99552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:25:28 devstack sudo[99552]: pam_unix(sudo:session): session closed for user root Jul 22 03:25:28 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-e083d532-681d-43f2-8958-149cd36bc397 tempest-CinderUnicodeTest-1483653559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-308e6cb6-67a2-4769-a5e6-42d9e811afe3" returned: 0 in 0.260s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:25:28 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-e083d532-681d-43f2-8958-149cd36bc397 tempest-CinderUnicodeTest-1483653559 None] Lock "cinder-quobyte-308e6cb6-67a2-4769-a5e6-42d9e811afe3" released by "delete_volume" :: held 0.689s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:25:28 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-e083d532-681d-43f2-8958-149cd36bc397 tempest-CinderUnicodeTest-1483653559 None] Created reservations ['a8649317-d043-4e01-9d91-1da4c4fe217b', '19d16c6b-169f-4976-868f-2adfe5e5dac4', '8820138c-5f85-44f6-b313-c17ee9afaa15', 'baf6a6aa-a072-4dae-889d-9f2fb6ed6e49'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:25:28 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-e083d532-681d-43f2-8958-149cd36bc397 tempest-CinderUnicodeTest-1483653559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:25:28 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-e083d532-681d-43f2-8958-149cd36bc397 tempest-CinderUnicodeTest-1483653559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:25:28 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-e083d532-681d-43f2-8958-149cd36bc397 tempest-CinderUnicodeTest-1483653559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:25:28 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-e083d532-681d-43f2-8958-149cd36bc397 tempest-CinderUnicodeTest-1483653559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:25:28 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-e083d532-681d-43f2-8958-149cd36bc397 tempest-CinderUnicodeTest-1483653559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:25:28 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-e083d532-681d-43f2-8958-149cd36bc397 tempest-CinderUnicodeTest-1483653559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:25:28 devstack sudo[99555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:25:28 devstack sudo[99555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:25:28 devstack sudo[99555]: pam_unix(sudo:session): session closed for user root Jul 22 03:25:28 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-e083d532-681d-43f2-8958-149cd36bc397 tempest-CinderUnicodeTest-1483653559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.306s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:25:28 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-e083d532-681d-43f2-8958-149cd36bc397 tempest-CinderUnicodeTest-1483653559 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:25:28 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-e083d532-681d-43f2-8958-149cd36bc397 tempest-CinderUnicodeTest-1483653559 None] Deleted volume successfully. Jul 22 03:25:28 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-e083d532-681d-43f2-8958-149cd36bc397 tempest-CinderUnicodeTest-1483653559 None] Lock "cinder-308e6cb6-67a2-4769-a5e6-42d9e811afe3-delete_volume" released by "delete_volume" :: held 1.225s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:25:28 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba312758-7f23-4ab4-8f96-c864a669a66f tempest-GroupSnapshotsTest-172189020 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:25:29 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-ba312758-7f23-4ab4-8f96-c864a669a66f tempest-GroupSnapshotsTest-172189020 None] Flow 'volume_create_manager' (5d55d7b4-9d75-48bc-88e8-623f8a95791a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:25:29 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-ba312758-7f23-4ab4-8f96-c864a669a66f tempest-GroupSnapshotsTest-172189020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49f1cfb7-d8e9-4445-ad18-c790350c808b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:25:29 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-ba312758-7f23-4ab4-8f96-c864a669a66f tempest-GroupSnapshotsTest-172189020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49f1cfb7-d8e9-4445-ad18-c790350c808b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:25:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2140365433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=13523fb2-0d5c-4d60-bed6-cbe7b76e1913,host='devstack@QuobyteHD#QuobyteHD',id=1a48cafc-d135-480f-a2ec-9c0b6cacb482,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a058032650974a56a4f1348c499a4293',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:25:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:25:29Z,use_quota=True,user_id='8b50bd7a480f42ac8ba487a2cd387e87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83afc2dd-e14d-4562-95a1-cc947e1882df),volume_type_id=83afc2dd-e14d-4562-95a1-cc947e1882df)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:25:29 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-ba312758-7f23-4ab4-8f96-c864a669a66f tempest-GroupSnapshotsTest-172189020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff84d5ca-1aac-4be0-b528-018976ebdb81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:25:29 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-ba312758-7f23-4ab4-8f96-c864a669a66f tempest-GroupSnapshotsTest-172189020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff84d5ca-1aac-4be0-b528-018976ebdb81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:25:29 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-ba312758-7f23-4ab4-8f96-c864a669a66f tempest-GroupSnapshotsTest-172189020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e3af3bc-6701-4adb-bc2e-b7c620500f51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:25:29 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-ba312758-7f23-4ab4-8f96-c864a669a66f tempest-GroupSnapshotsTest-172189020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e3af3bc-6701-4adb-bc2e-b7c620500f51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a48cafc-d135-480f-a2ec-9c0b6cacb482', 'volume_name': 'volume-1a48cafc-d135-480f-a2ec-9c0b6cacb482', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:25:29 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-ba312758-7f23-4ab4-8f96-c864a669a66f tempest-GroupSnapshotsTest-172189020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ca02849-ac02-4f45-89b6-9e6edc6843b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:25:29 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-ba312758-7f23-4ab4-8f96-c864a669a66f tempest-GroupSnapshotsTest-172189020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ca02849-ac02-4f45-89b6-9e6edc6843b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:25:29 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-ba312758-7f23-4ab4-8f96-c864a669a66f tempest-GroupSnapshotsTest-172189020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9d3f644-1ac2-42a8-8bc8-d5d04e25cc56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:25:29 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-ba312758-7f23-4ab4-8f96-c864a669a66f tempest-GroupSnapshotsTest-172189020 None] Volume 1a48cafc-d135-480f-a2ec-9c0b6cacb482: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a48cafc-d135-480f-a2ec-9c0b6cacb482', 'volume_size': 1} Jul 22 03:25:29 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-ba312758-7f23-4ab4-8f96-c864a669a66f tempest-GroupSnapshotsTest-172189020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:25:29 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-ba312758-7f23-4ab4-8f96-c864a669a66f tempest-GroupSnapshotsTest-172189020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:25:29 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-ba312758-7f23-4ab4-8f96-c864a669a66f tempest-GroupSnapshotsTest-172189020 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=13523fb2-0d5c-4d60-bed6-cbe7b76e1913,created_at=2026-07-22T01:25:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2140365433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=13523fb2-0d5c-4d60-bed6-cbe7b76e1913,host='devstack@QuobyteHD#QuobyteHD',id=1a48cafc-d135-480f-a2ec-9c0b6cacb482,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a058032650974a56a4f1348c499a4293',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:25:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:25:29Z,use_quota=True,user_id='8b50bd7a480f42ac8ba487a2cd387e87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83afc2dd-e14d-4562-95a1-cc947e1882df),volume_type_id=83afc2dd-e14d-4562-95a1-cc947e1882df)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:25:29 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-ba312758-7f23-4ab4-8f96-c864a669a66f tempest-GroupSnapshotsTest-172189020 None] Creating volume 1a48cafc-d135-480f-a2ec-9c0b6cacb482 {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:25:29 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-ba312758-7f23-4ab4-8f96-c864a669a66f tempest-GroupSnapshotsTest-172189020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:25:29 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-ba312758-7f23-4ab4-8f96-c864a669a66f tempest-GroupSnapshotsTest-172189020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:25:29 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-ba312758-7f23-4ab4-8f96-c864a669a66f tempest-GroupSnapshotsTest-172189020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:25:29 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-ba312758-7f23-4ab4-8f96-c864a669a66f tempest-GroupSnapshotsTest-172189020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:25:29 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-ba312758-7f23-4ab4-8f96-c864a669a66f tempest-GroupSnapshotsTest-172189020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:25:29 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-ba312758-7f23-4ab4-8f96-c864a669a66f tempest-GroupSnapshotsTest-172189020 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:25:29 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-ba312758-7f23-4ab4-8f96-c864a669a66f tempest-GroupSnapshotsTest-172189020 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:25:29 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ba312758-7f23-4ab4-8f96-c864a669a66f tempest-GroupSnapshotsTest-172189020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1a48cafc-d135-480f-a2ec-9c0b6cacb482 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:25:29 devstack sudo[99560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1a48cafc-d135-480f-a2ec-9c0b6cacb482 1073741824 Jul 22 03:25:29 devstack sudo[99560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:25:29 devstack sudo[99560]: pam_unix(sudo:session): session closed for user root Jul 22 03:25:29 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ba312758-7f23-4ab4-8f96-c864a669a66f tempest-GroupSnapshotsTest-172189020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1a48cafc-d135-480f-a2ec-9c0b6cacb482 1073741824" returned: 0 in 0.538s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:25:29 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ba312758-7f23-4ab4-8f96-c864a669a66f tempest-GroupSnapshotsTest-172189020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1a48cafc-d135-480f-a2ec-9c0b6cacb482 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:25:29 devstack sudo[99567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1a48cafc-d135-480f-a2ec-9c0b6cacb482 Jul 22 03:25:29 devstack sudo[99567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:25:29 devstack sudo[99567]: pam_unix(sudo:session): session closed for user root Jul 22 03:25:29 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3da134c-5d94-4d84-b796-61c1712f46a0 tempest-TestServerVolumeAttachScenarioOldVersion-210647678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:25:30 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-a3da134c-5d94-4d84-b796-61c1712f46a0 tempest-TestServerVolumeAttachScenarioOldVersion-210647678 None] Flow 'volume_create_manager' (476ea16c-a486-4554-9bbc-28bc63cc0d52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:25:30 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-a3da134c-5d94-4d84-b796-61c1712f46a0 tempest-TestServerVolumeAttachScenarioOldVersion-210647678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c485153-dbb0-4884-b46f-9439fd4efebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:25:30 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ba312758-7f23-4ab4-8f96-c864a669a66f tempest-GroupSnapshotsTest-172189020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1a48cafc-d135-480f-a2ec-9c0b6cacb482" returned: 0 in 0.356s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:25:30 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-ba312758-7f23-4ab4-8f96-c864a669a66f tempest-GroupSnapshotsTest-172189020 None] <== create_volume: return (953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:25:30 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-ba312758-7f23-4ab4-8f96-c864a669a66f tempest-GroupSnapshotsTest-172189020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:25:30 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-a3da134c-5d94-4d84-b796-61c1712f46a0 tempest-TestServerVolumeAttachScenarioOldVersion-210647678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c485153-dbb0-4884-b46f-9439fd4efebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:25:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-690595548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68eec25c-cd00-44d3-b3d7-c935f6dfa4ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b906f635d0f4e969311950b6dc723f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:25:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:25:30Z,use_quota=True,user_id='27e8cb64f85c4ac68ef6d067a8477735',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:25:30 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-a3da134c-5d94-4d84-b796-61c1712f46a0 tempest-TestServerVolumeAttachScenarioOldVersion-210647678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (319ae057-0521-4443-ac30-8c11cb8b5069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:25:30 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-a3da134c-5d94-4d84-b796-61c1712f46a0 tempest-TestServerVolumeAttachScenarioOldVersion-210647678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (319ae057-0521-4443-ac30-8c11cb8b5069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:25:30 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-a3da134c-5d94-4d84-b796-61c1712f46a0 tempest-TestServerVolumeAttachScenarioOldVersion-210647678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff5b38ad-480b-4989-909a-3e0b2bf5947d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:25:30 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-a3da134c-5d94-4d84-b796-61c1712f46a0 tempest-TestServerVolumeAttachScenarioOldVersion-210647678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff5b38ad-480b-4989-909a-3e0b2bf5947d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68eec25c-cd00-44d3-b3d7-c935f6dfa4ac', 'volume_name': 'volume-68eec25c-cd00-44d3-b3d7-c935f6dfa4ac', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:25:30 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-a3da134c-5d94-4d84-b796-61c1712f46a0 tempest-TestServerVolumeAttachScenarioOldVersion-210647678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (931a5e35-1065-4adc-9f6c-845416a7a280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:25:30 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-a3da134c-5d94-4d84-b796-61c1712f46a0 tempest-TestServerVolumeAttachScenarioOldVersion-210647678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (931a5e35-1065-4adc-9f6c-845416a7a280) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:25:30 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-a3da134c-5d94-4d84-b796-61c1712f46a0 tempest-TestServerVolumeAttachScenarioOldVersion-210647678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (038f4cfe-2ed1-4d44-99bf-ba9edfc929ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:25:30 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-a3da134c-5d94-4d84-b796-61c1712f46a0 tempest-TestServerVolumeAttachScenarioOldVersion-210647678 None] Volume 68eec25c-cd00-44d3-b3d7-c935f6dfa4ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68eec25c-cd00-44d3-b3d7-c935f6dfa4ac', 'volume_size': 1} Jul 22 03:25:30 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-a3da134c-5d94-4d84-b796-61c1712f46a0 tempest-TestServerVolumeAttachScenarioOldVersion-210647678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:25:30 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-a3da134c-5d94-4d84-b796-61c1712f46a0 tempest-TestServerVolumeAttachScenarioOldVersion-210647678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:25:30 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-a3da134c-5d94-4d84-b796-61c1712f46a0 tempest-TestServerVolumeAttachScenarioOldVersion-210647678 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:25:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-690595548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68eec25c-cd00-44d3-b3d7-c935f6dfa4ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b906f635d0f4e969311950b6dc723f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:25:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:25:30Z,use_quota=True,user_id='27e8cb64f85c4ac68ef6d067a8477735',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:25:30 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-a3da134c-5d94-4d84-b796-61c1712f46a0 tempest-TestServerVolumeAttachScenarioOldVersion-210647678 None] Creating volume 68eec25c-cd00-44d3-b3d7-c935f6dfa4ac {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:25:30 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-a3da134c-5d94-4d84-b796-61c1712f46a0 tempest-TestServerVolumeAttachScenarioOldVersion-210647678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:25:30 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-a3da134c-5d94-4d84-b796-61c1712f46a0 tempest-TestServerVolumeAttachScenarioOldVersion-210647678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:25:30 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-a3da134c-5d94-4d84-b796-61c1712f46a0 tempest-TestServerVolumeAttachScenarioOldVersion-210647678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:25:30 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-a3da134c-5d94-4d84-b796-61c1712f46a0 tempest-TestServerVolumeAttachScenarioOldVersion-210647678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:25:30 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-a3da134c-5d94-4d84-b796-61c1712f46a0 tempest-TestServerVolumeAttachScenarioOldVersion-210647678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:25:30 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-a3da134c-5d94-4d84-b796-61c1712f46a0 tempest-TestServerVolumeAttachScenarioOldVersion-210647678 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:25:30 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-a3da134c-5d94-4d84-b796-61c1712f46a0 tempest-TestServerVolumeAttachScenarioOldVersion-210647678 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:25:30 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-a3da134c-5d94-4d84-b796-61c1712f46a0 tempest-TestServerVolumeAttachScenarioOldVersion-210647678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-68eec25c-cd00-44d3-b3d7-c935f6dfa4ac 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:25:30 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-ba312758-7f23-4ab4-8f96-c864a669a66f tempest-GroupSnapshotsTest-172189020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9d3f644-1ac2-42a8-8bc8-d5d04e25cc56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a48cafc-d135-480f-a2ec-9c0b6cacb482', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:25:30 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-ba312758-7f23-4ab4-8f96-c864a669a66f tempest-GroupSnapshotsTest-172189020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (081baf37-037b-4437-a37d-30b3f80168d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:25:30 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-ba312758-7f23-4ab4-8f96-c864a669a66f tempest-GroupSnapshotsTest-172189020 None] Volume volume-1a48cafc-d135-480f-a2ec-9c0b6cacb482 (1a48cafc-d135-480f-a2ec-9c0b6cacb482): created successfully Jul 22 03:25:30 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-ba312758-7f23-4ab4-8f96-c864a669a66f tempest-GroupSnapshotsTest-172189020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (081baf37-037b-4437-a37d-30b3f80168d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:25:30 devstack sudo[99570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-68eec25c-cd00-44d3-b3d7-c935f6dfa4ac 1073741824 Jul 22 03:25:30 devstack sudo[99570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:25:30 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-ba312758-7f23-4ab4-8f96-c864a669a66f tempest-GroupSnapshotsTest-172189020 None] Flow 'volume_create_manager' (5d55d7b4-9d75-48bc-88e8-623f8a95791a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:25:30 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-ba312758-7f23-4ab4-8f96-c864a669a66f tempest-GroupSnapshotsTest-172189020 None] Created volume successfully. Jul 22 03:25:30 devstack sudo[99570]: pam_unix(sudo:session): session closed for user root Jul 22 03:25:30 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-a3da134c-5d94-4d84-b796-61c1712f46a0 tempest-TestServerVolumeAttachScenarioOldVersion-210647678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-68eec25c-cd00-44d3-b3d7-c935f6dfa4ac 1073741824" returned: 0 in 0.486s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:25:30 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-a3da134c-5d94-4d84-b796-61c1712f46a0 tempest-TestServerVolumeAttachScenarioOldVersion-210647678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-68eec25c-cd00-44d3-b3d7-c935f6dfa4ac {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:25:30 devstack sudo[99576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-68eec25c-cd00-44d3-b3d7-c935f6dfa4ac Jul 22 03:25:30 devstack sudo[99576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:25:30 devstack sudo[99576]: pam_unix(sudo:session): session closed for user root Jul 22 03:25:30 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-a3da134c-5d94-4d84-b796-61c1712f46a0 tempest-TestServerVolumeAttachScenarioOldVersion-210647678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-68eec25c-cd00-44d3-b3d7-c935f6dfa4ac" returned: 0 in 0.254s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:25:30 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-a3da134c-5d94-4d84-b796-61c1712f46a0 tempest-TestServerVolumeAttachScenarioOldVersion-210647678 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:25:30 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-a3da134c-5d94-4d84-b796-61c1712f46a0 tempest-TestServerVolumeAttachScenarioOldVersion-210647678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.791s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:25:30 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-a3da134c-5d94-4d84-b796-61c1712f46a0 tempest-TestServerVolumeAttachScenarioOldVersion-210647678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (038f4cfe-2ed1-4d44-99bf-ba9edfc929ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68eec25c-cd00-44d3-b3d7-c935f6dfa4ac', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:25:30 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-a3da134c-5d94-4d84-b796-61c1712f46a0 tempest-TestServerVolumeAttachScenarioOldVersion-210647678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a73c60d8-df72-4ac5-a5d1-f52191e3a8b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:25:30 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-a3da134c-5d94-4d84-b796-61c1712f46a0 tempest-TestServerVolumeAttachScenarioOldVersion-210647678 None] Volume volume-68eec25c-cd00-44d3-b3d7-c935f6dfa4ac (68eec25c-cd00-44d3-b3d7-c935f6dfa4ac): created successfully Jul 22 03:25:30 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-a3da134c-5d94-4d84-b796-61c1712f46a0 tempest-TestServerVolumeAttachScenarioOldVersion-210647678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a73c60d8-df72-4ac5-a5d1-f52191e3a8b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:25:30 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-a3da134c-5d94-4d84-b796-61c1712f46a0 tempest-TestServerVolumeAttachScenarioOldVersion-210647678 None] Flow 'volume_create_manager' (476ea16c-a486-4554-9bbc-28bc63cc0d52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:25:30 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-a3da134c-5d94-4d84-b796-61c1712f46a0 tempest-TestServerVolumeAttachScenarioOldVersion-210647678 None] Created volume successfully. Jul 22 03:25:31 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-77717d09-523c-4512-93f9-f292e4dde768 tempest-GroupSnapshotsTest-172189020 None] GroupSnapshot c8ae87c9-3963-4832-a668-ac11bcda0a18: creating. Jul 22 03:25:31 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-77717d09-523c-4512-93f9-f292e4dde768 tempest-GroupSnapshotsTest-172189020 None] Group snapshot c8ae87c9-3963-4832-a668-ac11bcda0a18: creating. {{(pid=87747) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 22 03:25:31 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-77717d09-523c-4512-93f9-f292e4dde768 tempest-GroupSnapshotsTest-172189020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:25:31 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-77717d09-523c-4512-93f9-f292e4dde768 tempest-GroupSnapshotsTest-172189020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:25:31 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-77717d09-523c-4512-93f9-f292e4dde768 tempest-GroupSnapshotsTest-172189020 None] Creating offline snapshot f95e617b-cb08-46c3-a2b8-353271588f7a of volume 1a48cafc-d135-480f-a2ec-9c0b6cacb482 {{(pid=87747) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 03:25:31 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6701949-1249-49ea-a469-480204f34e8a]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:25:31 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-77717d09-523c-4512-93f9-f292e4dde768 tempest-GroupSnapshotsTest-172189020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1a48cafc-d135-480f-a2ec-9c0b6cacb482 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:25:31 devstack sudo[99579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1a48cafc-d135-480f-a2ec-9c0b6cacb482 Jul 22 03:25:31 devstack sudo[99579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:25:32 devstack sudo[99579]: pam_unix(sudo:session): session closed for user root Jul 22 03:25:32 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-77717d09-523c-4512-93f9-f292e4dde768 tempest-GroupSnapshotsTest-172189020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1a48cafc-d135-480f-a2ec-9c0b6cacb482" returned: 0 in 0.388s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:25:32 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-77717d09-523c-4512-93f9-f292e4dde768 tempest-GroupSnapshotsTest-172189020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1a48cafc-d135-480f-a2ec-9c0b6cacb482,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1a48cafc-d135-480f-a2ec-9c0b6cacb482.f95e617b-cb08-46c3-a2b8-353271588f7a 1G {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:25:32 devstack sudo[99584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1a48cafc-d135-480f-a2ec-9c0b6cacb482,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1a48cafc-d135-480f-a2ec-9c0b6cacb482.f95e617b-cb08-46c3-a2b8-353271588f7a 1G Jul 22 03:25:32 devstack sudo[99584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:25:32 devstack sudo[99584]: pam_unix(sudo:session): session closed for user root Jul 22 03:25:32 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-77717d09-523c-4512-93f9-f292e4dde768 tempest-GroupSnapshotsTest-172189020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1a48cafc-d135-480f-a2ec-9c0b6cacb482,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1a48cafc-d135-480f-a2ec-9c0b6cacb482.f95e617b-cb08-46c3-a2b8-353271588f7a 1G" returned: 0 in 0.519s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:25:32 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-77717d09-523c-4512-93f9-f292e4dde768 tempest-GroupSnapshotsTest-172189020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a48cafc-d135-480f-a2ec-9c0b6cacb482 -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1a48cafc-d135-480f-a2ec-9c0b6cacb482.f95e617b-cb08-46c3-a2b8-353271588f7a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:25:32 devstack sudo[99593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a48cafc-d135-480f-a2ec-9c0b6cacb482 -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1a48cafc-d135-480f-a2ec-9c0b6cacb482.f95e617b-cb08-46c3-a2b8-353271588f7a Jul 22 03:25:32 devstack sudo[99593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:25:32 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [req-94d6b624-cbee-4b1e-be49-a386f7deac79 req-6f4c9db6-4d7a-45b8-9731-7667d334f539 tempest-TestServerVolumeAttachScenarioOldVersion-210647678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:25:32 devstack sudo[99593]: pam_unix(sudo:session): session closed for user root Jul 22 03:25:32 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-77717d09-523c-4512-93f9-f292e4dde768 tempest-GroupSnapshotsTest-172189020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a48cafc-d135-480f-a2ec-9c0b6cacb482 -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1a48cafc-d135-480f-a2ec-9c0b6cacb482.f95e617b-cb08-46c3-a2b8-353271588f7a" returned: 0 in 0.327s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:25:32 devstack cinder-volume[87747]: WARNING cinder.volume.drivers.remotefs [None req-77717d09-523c-4512-93f9-f292e4dde768 tempest-GroupSnapshotsTest-172189020 None] /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1a48cafc-d135-480f-a2ec-9c0b6cacb482.f95e617b-cb08-46c3-a2b8-353271588f7a is being set with open permissions: ugo+rw: NotImplementedError Jul 22 03:25:32 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-77717d09-523c-4512-93f9-f292e4dde768 tempest-GroupSnapshotsTest-172189020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1a48cafc-d135-480f-a2ec-9c0b6cacb482.f95e617b-cb08-46c3-a2b8-353271588f7a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:25:32 devstack sudo[99606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1a48cafc-d135-480f-a2ec-9c0b6cacb482.f95e617b-cb08-46c3-a2b8-353271588f7a Jul 22 03:25:32 devstack sudo[99606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:25:33 devstack sudo[99606]: pam_unix(sudo:session): session closed for user root Jul 22 03:25:33 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-77717d09-523c-4512-93f9-f292e4dde768 tempest-GroupSnapshotsTest-172189020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1a48cafc-d135-480f-a2ec-9c0b6cacb482.f95e617b-cb08-46c3-a2b8-353271588f7a" returned: 0 in 0.243s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:25:33 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-77717d09-523c-4512-93f9-f292e4dde768 tempest-GroupSnapshotsTest-172189020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1a48cafc-d135-480f-a2ec-9c0b6cacb482.info {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:25:33 devstack sudo[99610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1a48cafc-d135-480f-a2ec-9c0b6cacb482.info Jul 22 03:25:33 devstack sudo[99610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:25:33 devstack sudo[99610]: pam_unix(sudo:session): session closed for user root Jul 22 03:25:33 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-77717d09-523c-4512-93f9-f292e4dde768 tempest-GroupSnapshotsTest-172189020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1a48cafc-d135-480f-a2ec-9c0b6cacb482.info" returned: 0 in 0.260s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:25:33 devstack cinder-volume[87747]: WARNING cinder.volume.drivers.remotefs [None req-77717d09-523c-4512-93f9-f292e4dde768 tempest-GroupSnapshotsTest-172189020 None] /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1a48cafc-d135-480f-a2ec-9c0b6cacb482.info is being set with open permissions: ugo+rw: NotImplementedError Jul 22 03:25:33 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-77717d09-523c-4512-93f9-f292e4dde768 tempest-GroupSnapshotsTest-172189020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1a48cafc-d135-480f-a2ec-9c0b6cacb482.info {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:25:33 devstack sudo[99613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1a48cafc-d135-480f-a2ec-9c0b6cacb482.info Jul 22 03:25:33 devstack sudo[99613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:25:33 devstack sudo[99613]: pam_unix(sudo:session): session closed for user root Jul 22 03:25:33 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-77717d09-523c-4512-93f9-f292e4dde768 tempest-GroupSnapshotsTest-172189020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1a48cafc-d135-480f-a2ec-9c0b6cacb482.info" returned: 0 in 0.249s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:25:33 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-77717d09-523c-4512-93f9-f292e4dde768 tempest-GroupSnapshotsTest-172189020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.082s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:25:33 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [req-94d6b624-cbee-4b1e-be49-a386f7deac79 req-6f4c9db6-4d7a-45b8-9731-7667d334f539 tempest-TestServerVolumeAttachScenarioOldVersion-210647678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.900s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:25:33 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [req-94d6b624-cbee-4b1e-be49-a386f7deac79 req-6f4c9db6-4d7a-45b8-9731-7667d334f539 tempest-TestServerVolumeAttachScenarioOldVersion-210647678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:25:33 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [req-94d6b624-cbee-4b1e-be49-a386f7deac79 req-6f4c9db6-4d7a-45b8-9731-7667d334f539 tempest-TestServerVolumeAttachScenarioOldVersion-210647678 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f', 'name': 'volume-68eec25c-cd00-44d3-b3d7-c935f6dfa4ac', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ec9dd63d-1f78-48fa-a784-fd2509bc6d93', 'enforce_multipath': True} {{(pid=87747) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 22 03:25:33 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-77717d09-523c-4512-93f9-f292e4dde768 tempest-GroupSnapshotsTest-172189020 None] group_snapshot c8ae87c9-3963-4832-a668-ac11bcda0a18: created successfully Jul 22 03:25:33 devstack cinder-volume[87747]: INFO cinder.volume.manager [req-94d6b624-cbee-4b1e-be49-a386f7deac79 req-6f4c9db6-4d7a-45b8-9731-7667d334f539 tempest-TestServerVolumeAttachScenarioOldVersion-210647678 None] attachment_update completed successfully. Jul 22 03:25:35 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-5e123c77-6e20-42cd-a7b8-9476ffd47f36 tempest-GroupSnapshotsTest-172189020 None] group_snapshot c8ae87c9-3963-4832-a668-ac11bcda0a18: deleting Jul 22 03:25:35 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-5e123c77-6e20-42cd-a7b8-9476ffd47f36 tempest-GroupSnapshotsTest-172189020 None] group_snapshot c8ae87c9-3963-4832-a668-ac11bcda0a18: deleting {{(pid=87747) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 22 03:25:35 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-5e123c77-6e20-42cd-a7b8-9476ffd47f36 tempest-GroupSnapshotsTest-172189020 None] Acquiring lock "cinder-quobyte-1a48cafc-d135-480f-a2ec-9c0b6cacb482" by "delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:25:35 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-5e123c77-6e20-42cd-a7b8-9476ffd47f36 tempest-GroupSnapshotsTest-172189020 None] Lock "cinder-quobyte-1a48cafc-d135-480f-a2ec-9c0b6cacb482" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:25:35 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-5e123c77-6e20-42cd-a7b8-9476ffd47f36 tempest-GroupSnapshotsTest-172189020 None] Acquiring lock "cinder-quobyte-f95e617b-cb08-46c3-a2b8-353271588f7a" by "_delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:25:35 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-5e123c77-6e20-42cd-a7b8-9476ffd47f36 tempest-GroupSnapshotsTest-172189020 None] Lock "cinder-quobyte-f95e617b-cb08-46c3-a2b8-353271588f7a" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:25:35 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-5e123c77-6e20-42cd-a7b8-9476ffd47f36 tempest-GroupSnapshotsTest-172189020 None] Deleting offline snapshot f95e617b-cb08-46c3-a2b8-353271588f7a of volume 1a48cafc-d135-480f-a2ec-9c0b6cacb482 {{(pid=87747) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 03:25:35 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-5e123c77-6e20-42cd-a7b8-9476ffd47f36 tempest-GroupSnapshotsTest-172189020 None] snapshot_file for this snap is: volume-1a48cafc-d135-480f-a2ec-9c0b6cacb482.f95e617b-cb08-46c3-a2b8-353271588f7a {{(pid=87747) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 03:25:35 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3a9fe72-90b8-49ac-b4e5-3b027bef40da]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:25:35 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5e123c77-6e20-42cd-a7b8-9476ffd47f36 tempest-GroupSnapshotsTest-172189020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1a48cafc-d135-480f-a2ec-9c0b6cacb482.f95e617b-cb08-46c3-a2b8-353271588f7a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:25:35 devstack sudo[100034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1a48cafc-d135-480f-a2ec-9c0b6cacb482.f95e617b-cb08-46c3-a2b8-353271588f7a Jul 22 03:25:35 devstack sudo[100034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:25:35 devstack sudo[100034]: pam_unix(sudo:session): session closed for user root Jul 22 03:25:35 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5e123c77-6e20-42cd-a7b8-9476ffd47f36 tempest-GroupSnapshotsTest-172189020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1a48cafc-d135-480f-a2ec-9c0b6cacb482.f95e617b-cb08-46c3-a2b8-353271588f7a" returned: 0 in 0.443s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:25:35 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-5e123c77-6e20-42cd-a7b8-9476ffd47f36 tempest-GroupSnapshotsTest-172189020 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a48cafc-d135-480f-a2ec-9c0b6cacb482(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87747) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 03:25:35 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d8a242e-4cb8-4adf-aeff-05f517bd9a38]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:25:35 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5e123c77-6e20-42cd-a7b8-9476ffd47f36 tempest-GroupSnapshotsTest-172189020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1a48cafc-d135-480f-a2ec-9c0b6cacb482 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:25:35 devstack sudo[100039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1a48cafc-d135-480f-a2ec-9c0b6cacb482 Jul 22 03:25:35 devstack sudo[100039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:25:36 devstack sudo[100039]: pam_unix(sudo:session): session closed for user root Jul 22 03:25:36 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5e123c77-6e20-42cd-a7b8-9476ffd47f36 tempest-GroupSnapshotsTest-172189020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1a48cafc-d135-480f-a2ec-9c0b6cacb482" returned: 0 in 0.406s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:25:36 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5e123c77-6e20-42cd-a7b8-9476ffd47f36 tempest-GroupSnapshotsTest-172189020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1a48cafc-d135-480f-a2ec-9c0b6cacb482.f95e617b-cb08-46c3-a2b8-353271588f7a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:25:36 devstack sudo[100044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1a48cafc-d135-480f-a2ec-9c0b6cacb482.f95e617b-cb08-46c3-a2b8-353271588f7a Jul 22 03:25:36 devstack sudo[100044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:25:36 devstack sudo[100044]: pam_unix(sudo:session): session closed for user root Jul 22 03:25:36 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5e123c77-6e20-42cd-a7b8-9476ffd47f36 tempest-GroupSnapshotsTest-172189020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1a48cafc-d135-480f-a2ec-9c0b6cacb482.f95e617b-cb08-46c3-a2b8-353271588f7a" returned: 0 in 0.404s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:25:36 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5e123c77-6e20-42cd-a7b8-9476ffd47f36 tempest-GroupSnapshotsTest-172189020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1a48cafc-d135-480f-a2ec-9c0b6cacb482.f95e617b-cb08-46c3-a2b8-353271588f7a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:25:36 devstack sudo[100049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1a48cafc-d135-480f-a2ec-9c0b6cacb482.f95e617b-cb08-46c3-a2b8-353271588f7a Jul 22 03:25:36 devstack sudo[100049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:25:36 devstack sudo[100049]: pam_unix(sudo:session): session closed for user root Jul 22 03:25:36 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5e123c77-6e20-42cd-a7b8-9476ffd47f36 tempest-GroupSnapshotsTest-172189020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1a48cafc-d135-480f-a2ec-9c0b6cacb482.f95e617b-cb08-46c3-a2b8-353271588f7a" returned: 0 in 0.280s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:25:36 devstack cinder-volume[87747]: INFO cinder.volume.manager [req-35c81de0-fe17-495a-ab28-b1538793d7c8 req-622c453e-be06-4e79-9e47-fe3155bce178 tempest-TestServerVolumeAttachScenarioOldVersion-210647678 None] Terminate volume connection completed successfully. Jul 22 03:25:36 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [req-35c81de0-fe17-495a-ab28-b1538793d7c8 req-622c453e-be06-4e79-9e47-fe3155bce178 tempest-TestServerVolumeAttachScenarioOldVersion-210647678 None] Deleting attachment ec9dd63d-1f78-48fa-a784-fd2509bc6d93. {{(pid=87747) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 22 03:25:36 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-5e123c77-6e20-42cd-a7b8-9476ffd47f36 tempest-GroupSnapshotsTest-172189020 None] Lock "cinder-quobyte-f95e617b-cb08-46c3-a2b8-353271588f7a" released by "_delete_snapshot" :: held 1.658s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:25:36 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-5e123c77-6e20-42cd-a7b8-9476ffd47f36 tempest-GroupSnapshotsTest-172189020 None] Lock "cinder-quobyte-1a48cafc-d135-480f-a2ec-9c0b6cacb482" released by "delete_snapshot" :: held 1.691s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:25:36 devstack cinder-volume[87747]: WARNING cinder.quota [None req-5e123c77-6e20-42cd-a7b8-9476ffd47f36 tempest-GroupSnapshotsTest-172189020 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1878148008 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1878148008, it is now deprecated. Please use the default quota class for default quota. Jul 22 03:25:36 devstack cinder-volume[87747]: WARNING cinder.quota [None req-5e123c77-6e20-42cd-a7b8-9476ffd47f36 tempest-GroupSnapshotsTest-172189020 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1878148008 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1878148008, it is now deprecated. Please use the default quota class for default quota. Jul 22 03:25:36 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-5e123c77-6e20-42cd-a7b8-9476ffd47f36 tempest-GroupSnapshotsTest-172189020 None] Created reservations ['949b7419-b39c-484f-90c2-e632c7eaed6a', 'a28cdd68-d634-4a62-a573-0dc1118655d1', '021e6321-1504-465a-a6a9-fe8d204a23a2', '505146ec-cd91-4e07-b528-24e61591ef0c'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:25:36 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-5e123c77-6e20-42cd-a7b8-9476ffd47f36 tempest-GroupSnapshotsTest-172189020 None] group_snapshot c8ae87c9-3963-4832-a668-ac11bcda0a18: deleted successfully Jul 22 03:25:37 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-ddc01b9a-18e4-4e99-9aad-f6e52428e241 tempest-GroupSnapshotsTest-172189020 None] Acquiring lock "cinder-quobyte-1a48cafc-d135-480f-a2ec-9c0b6cacb482" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:25:37 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-ddc01b9a-18e4-4e99-9aad-f6e52428e241 tempest-GroupSnapshotsTest-172189020 None] Lock "cinder-quobyte-1a48cafc-d135-480f-a2ec-9c0b6cacb482" acquired by "delete_volume" :: waited 0.019s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:25:37 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-46e49296-de90-47de-8746-31061bd373d5 tempest-TestServerVolumeAttachScenarioOldVersion-210647678 None] Acquiring lock "cinder-68eec25c-cd00-44d3-b3d7-c935f6dfa4ac-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:25:37 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[0045241c-640b-47af-8b6b-2daccab0ec73]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:25:37 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ddc01b9a-18e4-4e99-9aad-f6e52428e241 tempest-GroupSnapshotsTest-172189020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1a48cafc-d135-480f-a2ec-9c0b6cacb482 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:25:37 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-46e49296-de90-47de-8746-31061bd373d5 tempest-TestServerVolumeAttachScenarioOldVersion-210647678 None] Lock "cinder-68eec25c-cd00-44d3-b3d7-c935f6dfa4ac-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:25:37 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-46e49296-de90-47de-8746-31061bd373d5 tempest-TestServerVolumeAttachScenarioOldVersion-210647678 None] Acquiring lock "cinder-quobyte-68eec25c-cd00-44d3-b3d7-c935f6dfa4ac" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:25:37 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-46e49296-de90-47de-8746-31061bd373d5 tempest-TestServerVolumeAttachScenarioOldVersion-210647678 None] Lock "cinder-quobyte-68eec25c-cd00-44d3-b3d7-c935f6dfa4ac" acquired by "delete_volume" :: waited 0.020s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:25:37 devstack sudo[100078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1a48cafc-d135-480f-a2ec-9c0b6cacb482 Jul 22 03:25:37 devstack sudo[100078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:25:37 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6697fdf-a92d-413a-8207-65ad14c50427]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:25:37 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-46e49296-de90-47de-8746-31061bd373d5 tempest-TestServerVolumeAttachScenarioOldVersion-210647678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-68eec25c-cd00-44d3-b3d7-c935f6dfa4ac {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:25:38 devstack sudo[100080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-68eec25c-cd00-44d3-b3d7-c935f6dfa4ac Jul 22 03:25:38 devstack sudo[100080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:25:38 devstack sudo[100078]: pam_unix(sudo:session): session closed for user root Jul 22 03:25:38 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ddc01b9a-18e4-4e99-9aad-f6e52428e241 tempest-GroupSnapshotsTest-172189020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1a48cafc-d135-480f-a2ec-9c0b6cacb482" returned: 0 in 0.410s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:25:38 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ddc01b9a-18e4-4e99-9aad-f6e52428e241 tempest-GroupSnapshotsTest-172189020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1a48cafc-d135-480f-a2ec-9c0b6cacb482 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:25:38 devstack sudo[100085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1a48cafc-d135-480f-a2ec-9c0b6cacb482 Jul 22 03:25:38 devstack sudo[100085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:25:38 devstack sudo[100080]: pam_unix(sudo:session): session closed for user root Jul 22 03:25:38 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-46e49296-de90-47de-8746-31061bd373d5 tempest-TestServerVolumeAttachScenarioOldVersion-210647678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-68eec25c-cd00-44d3-b3d7-c935f6dfa4ac" returned: 0 in 0.404s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:25:38 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-46e49296-de90-47de-8746-31061bd373d5 tempest-TestServerVolumeAttachScenarioOldVersion-210647678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-68eec25c-cd00-44d3-b3d7-c935f6dfa4ac {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:25:38 devstack sudo[100090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-68eec25c-cd00-44d3-b3d7-c935f6dfa4ac Jul 22 03:25:38 devstack sudo[100090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:25:38 devstack sudo[100085]: pam_unix(sudo:session): session closed for user root Jul 22 03:25:38 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ddc01b9a-18e4-4e99-9aad-f6e52428e241 tempest-GroupSnapshotsTest-172189020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1a48cafc-d135-480f-a2ec-9c0b6cacb482" returned: 0 in 0.285s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:25:38 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-ddc01b9a-18e4-4e99-9aad-f6e52428e241 tempest-GroupSnapshotsTest-172189020 None] Lock "cinder-quobyte-1a48cafc-d135-480f-a2ec-9c0b6cacb482" released by "delete_volume" :: held 0.789s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:25:38 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-ddc01b9a-18e4-4e99-9aad-f6e52428e241 tempest-GroupSnapshotsTest-172189020 None] Created reservations ['f7463fe8-902d-478c-a261-39e8840f5809'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:25:38 devstack sudo[100090]: pam_unix(sudo:session): session closed for user root Jul 22 03:25:38 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-46e49296-de90-47de-8746-31061bd373d5 tempest-TestServerVolumeAttachScenarioOldVersion-210647678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-68eec25c-cd00-44d3-b3d7-c935f6dfa4ac" returned: 0 in 0.259s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:25:38 devstack cinder-volume[87747]: WARNING cinder.quota [None req-ddc01b9a-18e4-4e99-9aad-f6e52428e241 tempest-GroupSnapshotsTest-172189020 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1878148008 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1878148008, it is now deprecated. Please use the default quota class for default quota. Jul 22 03:25:38 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-46e49296-de90-47de-8746-31061bd373d5 tempest-TestServerVolumeAttachScenarioOldVersion-210647678 None] Lock "cinder-quobyte-68eec25c-cd00-44d3-b3d7-c935f6dfa4ac" released by "delete_volume" :: held 0.723s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:25:38 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-ddc01b9a-18e4-4e99-9aad-f6e52428e241 tempest-GroupSnapshotsTest-172189020 None] Created reservations ['fb528036-891e-4e60-9d52-be848fb3c71c', 'c1318a30-c1d4-4d6b-8368-a466d23088f9', '87a27f2a-3dad-49d5-8bf8-63a30cdfac3b', '745c808d-c3e7-4004-8342-40ec59362ac9'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:25:38 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-46e49296-de90-47de-8746-31061bd373d5 tempest-TestServerVolumeAttachScenarioOldVersion-210647678 None] Created reservations ['4e083a44-5fa7-4a73-9a78-921bea629812', '384f5259-cc4d-4a27-a49c-44c3a068c41d', '12e1aa8d-0080-436c-8b81-5eb732020109', '449d4ac4-df30-43eb-b717-7eac112ca1a6'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:25:38 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-46e49296-de90-47de-8746-31061bd373d5 tempest-TestServerVolumeAttachScenarioOldVersion-210647678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:25:38 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-46e49296-de90-47de-8746-31061bd373d5 tempest-TestServerVolumeAttachScenarioOldVersion-210647678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:25:38 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-46e49296-de90-47de-8746-31061bd373d5 tempest-TestServerVolumeAttachScenarioOldVersion-210647678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:25:38 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-46e49296-de90-47de-8746-31061bd373d5 tempest-TestServerVolumeAttachScenarioOldVersion-210647678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:25:38 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-46e49296-de90-47de-8746-31061bd373d5 tempest-TestServerVolumeAttachScenarioOldVersion-210647678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:25:38 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-46e49296-de90-47de-8746-31061bd373d5 tempest-TestServerVolumeAttachScenarioOldVersion-210647678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:25:38 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-ddc01b9a-18e4-4e99-9aad-f6e52428e241 tempest-GroupSnapshotsTest-172189020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:25:38 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-ddc01b9a-18e4-4e99-9aad-f6e52428e241 tempest-GroupSnapshotsTest-172189020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:25:38 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-ddc01b9a-18e4-4e99-9aad-f6e52428e241 tempest-GroupSnapshotsTest-172189020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:25:38 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-ddc01b9a-18e4-4e99-9aad-f6e52428e241 tempest-GroupSnapshotsTest-172189020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:25:38 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-ddc01b9a-18e4-4e99-9aad-f6e52428e241 tempest-GroupSnapshotsTest-172189020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:25:38 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ddc01b9a-18e4-4e99-9aad-f6e52428e241 tempest-GroupSnapshotsTest-172189020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:25:38 devstack sudo[100094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:25:38 devstack sudo[100094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:25:38 devstack sudo[100096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:25:38 devstack sudo[100096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:25:39 devstack sudo[100094]: pam_unix(sudo:session): session closed for user root Jul 22 03:25:39 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-46e49296-de90-47de-8746-31061bd373d5 tempest-TestServerVolumeAttachScenarioOldVersion-210647678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.292s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:25:39 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-46e49296-de90-47de-8746-31061bd373d5 tempest-TestServerVolumeAttachScenarioOldVersion-210647678 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:25:39 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-46e49296-de90-47de-8746-31061bd373d5 tempest-TestServerVolumeAttachScenarioOldVersion-210647678 None] Deleted volume successfully. Jul 22 03:25:39 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-46e49296-de90-47de-8746-31061bd373d5 tempest-TestServerVolumeAttachScenarioOldVersion-210647678 None] Lock "cinder-68eec25c-cd00-44d3-b3d7-c935f6dfa4ac-delete_volume" released by "delete_volume" :: held 1.318s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:25:39 devstack sudo[100096]: pam_unix(sudo:session): session closed for user root Jul 22 03:25:39 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ddc01b9a-18e4-4e99-9aad-f6e52428e241 tempest-GroupSnapshotsTest-172189020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.345s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:25:39 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-ddc01b9a-18e4-4e99-9aad-f6e52428e241 tempest-GroupSnapshotsTest-172189020 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:25:39 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-ddc01b9a-18e4-4e99-9aad-f6e52428e241 tempest-GroupSnapshotsTest-172189020 None] Delete group completed successfully. Jul 22 03:25:48 devstack cinder-volume[87747]: DEBUG dbcounter [-] [87747] Writing DB stats cinder:UPDATE=173,cinder:SELECT=157,cinder:INSERT=43,cinder:DELETE=10 {{(pid=87747) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 03:25:49 devstack cinder-volume[87747]: DEBUG dbcounter [-] [87747] Writing DB stats cinder:SELECT=153,cinder:UPDATE=153,cinder:INSERT=36,cinder:DELETE=4 {{(pid=87747) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 03:25:54 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2989f35-78e3-41a2-99a0-a4f9c67fc25b tempest-VolumesServicesTestJSON-1288874465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:25:54 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-d2989f35-78e3-41a2-99a0-a4f9c67fc25b tempest-VolumesServicesTestJSON-1288874465 None] Flow 'volume_create_manager' (d5cd3fd7-9813-4ca4-8c0d-52d5039a5917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:25:54 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-d2989f35-78e3-41a2-99a0-a4f9c67fc25b tempest-VolumesServicesTestJSON-1288874465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (549cc481-a70d-45fa-8d69-77e7460889d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:25:54 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-d2989f35-78e3-41a2-99a0-a4f9c67fc25b tempest-VolumesServicesTestJSON-1288874465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (549cc481-a70d-45fa-8d69-77e7460889d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:25:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1324333251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=652df668-24ec-4824-be18-e3ae837d9d3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c35b05882a3e4d5d8278a4ce7d9febee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:25:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:25:54Z,use_quota=True,user_id='f5cf3c96f456439eb37654bffedc1ecf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:25:54 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-d2989f35-78e3-41a2-99a0-a4f9c67fc25b tempest-VolumesServicesTestJSON-1288874465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17a02f99-cdfd-4c50-b841-e6ac5cd69ea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:25:54 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-d2989f35-78e3-41a2-99a0-a4f9c67fc25b tempest-VolumesServicesTestJSON-1288874465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17a02f99-cdfd-4c50-b841-e6ac5cd69ea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:25:54 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-d2989f35-78e3-41a2-99a0-a4f9c67fc25b tempest-VolumesServicesTestJSON-1288874465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ffde5fd-cfd0-497e-b82c-c7df66d762ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:25:54 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-d2989f35-78e3-41a2-99a0-a4f9c67fc25b tempest-VolumesServicesTestJSON-1288874465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ffde5fd-cfd0-497e-b82c-c7df66d762ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '652df668-24ec-4824-be18-e3ae837d9d3d', 'volume_name': 'volume-652df668-24ec-4824-be18-e3ae837d9d3d', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:25:54 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-d2989f35-78e3-41a2-99a0-a4f9c67fc25b tempest-VolumesServicesTestJSON-1288874465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fccf83c-b1be-4128-a956-25be35ddffb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:25:54 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-d2989f35-78e3-41a2-99a0-a4f9c67fc25b tempest-VolumesServicesTestJSON-1288874465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fccf83c-b1be-4128-a956-25be35ddffb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:25:54 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-d2989f35-78e3-41a2-99a0-a4f9c67fc25b tempest-VolumesServicesTestJSON-1288874465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f31ff6ca-bfbf-4e12-baf2-ae4d9e95d047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:25:54 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-d2989f35-78e3-41a2-99a0-a4f9c67fc25b tempest-VolumesServicesTestJSON-1288874465 None] Volume 652df668-24ec-4824-be18-e3ae837d9d3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-652df668-24ec-4824-be18-e3ae837d9d3d', 'volume_size': 1} Jul 22 03:25:54 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-d2989f35-78e3-41a2-99a0-a4f9c67fc25b tempest-VolumesServicesTestJSON-1288874465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:25:54 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-d2989f35-78e3-41a2-99a0-a4f9c67fc25b tempest-VolumesServicesTestJSON-1288874465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:25:54 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-d2989f35-78e3-41a2-99a0-a4f9c67fc25b tempest-VolumesServicesTestJSON-1288874465 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:25:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1324333251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=652df668-24ec-4824-be18-e3ae837d9d3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c35b05882a3e4d5d8278a4ce7d9febee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:25:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:25:54Z,use_quota=True,user_id='f5cf3c96f456439eb37654bffedc1ecf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:25:54 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-d2989f35-78e3-41a2-99a0-a4f9c67fc25b tempest-VolumesServicesTestJSON-1288874465 None] Creating volume 652df668-24ec-4824-be18-e3ae837d9d3d {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:25:54 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-d2989f35-78e3-41a2-99a0-a4f9c67fc25b tempest-VolumesServicesTestJSON-1288874465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:25:54 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-d2989f35-78e3-41a2-99a0-a4f9c67fc25b tempest-VolumesServicesTestJSON-1288874465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:25:54 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-d2989f35-78e3-41a2-99a0-a4f9c67fc25b tempest-VolumesServicesTestJSON-1288874465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:25:54 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-d2989f35-78e3-41a2-99a0-a4f9c67fc25b tempest-VolumesServicesTestJSON-1288874465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:25:54 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-d2989f35-78e3-41a2-99a0-a4f9c67fc25b tempest-VolumesServicesTestJSON-1288874465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:25:54 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-d2989f35-78e3-41a2-99a0-a4f9c67fc25b tempest-VolumesServicesTestJSON-1288874465 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:25:54 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-d2989f35-78e3-41a2-99a0-a4f9c67fc25b tempest-VolumesServicesTestJSON-1288874465 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:25:54 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d2989f35-78e3-41a2-99a0-a4f9c67fc25b tempest-VolumesServicesTestJSON-1288874465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-652df668-24ec-4824-be18-e3ae837d9d3d 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:25:54 devstack sudo[100135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-652df668-24ec-4824-be18-e3ae837d9d3d 1073741824 Jul 22 03:25:54 devstack sudo[100135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:25:54 devstack sudo[100135]: pam_unix(sudo:session): session closed for user root Jul 22 03:25:54 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d2989f35-78e3-41a2-99a0-a4f9c67fc25b tempest-VolumesServicesTestJSON-1288874465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-652df668-24ec-4824-be18-e3ae837d9d3d 1073741824" returned: 0 in 0.554s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:25:55 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d2989f35-78e3-41a2-99a0-a4f9c67fc25b tempest-VolumesServicesTestJSON-1288874465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-652df668-24ec-4824-be18-e3ae837d9d3d {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:25:55 devstack sudo[100141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-652df668-24ec-4824-be18-e3ae837d9d3d Jul 22 03:25:55 devstack sudo[100141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:25:55 devstack sudo[100141]: pam_unix(sudo:session): session closed for user root Jul 22 03:25:55 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d2989f35-78e3-41a2-99a0-a4f9c67fc25b tempest-VolumesServicesTestJSON-1288874465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-652df668-24ec-4824-be18-e3ae837d9d3d" returned: 0 in 0.353s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:25:55 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-d2989f35-78e3-41a2-99a0-a4f9c67fc25b tempest-VolumesServicesTestJSON-1288874465 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:25:55 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-d2989f35-78e3-41a2-99a0-a4f9c67fc25b tempest-VolumesServicesTestJSON-1288874465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:25:55 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-d2989f35-78e3-41a2-99a0-a4f9c67fc25b tempest-VolumesServicesTestJSON-1288874465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f31ff6ca-bfbf-4e12-baf2-ae4d9e95d047) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-652df668-24ec-4824-be18-e3ae837d9d3d', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:25:55 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-d2989f35-78e3-41a2-99a0-a4f9c67fc25b tempest-VolumesServicesTestJSON-1288874465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f25aed0-cbfe-4060-9221-380831f9fece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:25:55 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-d2989f35-78e3-41a2-99a0-a4f9c67fc25b tempest-VolumesServicesTestJSON-1288874465 None] Volume volume-652df668-24ec-4824-be18-e3ae837d9d3d (652df668-24ec-4824-be18-e3ae837d9d3d): created successfully Jul 22 03:25:55 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-d2989f35-78e3-41a2-99a0-a4f9c67fc25b tempest-VolumesServicesTestJSON-1288874465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f25aed0-cbfe-4060-9221-380831f9fece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:25:55 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-d2989f35-78e3-41a2-99a0-a4f9c67fc25b tempest-VolumesServicesTestJSON-1288874465 None] Flow 'volume_create_manager' (d5cd3fd7-9813-4ca4-8c0d-52d5039a5917) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:25:55 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-d2989f35-78e3-41a2-99a0-a4f9c67fc25b tempest-VolumesServicesTestJSON-1288874465 None] Created volume successfully. Jul 22 03:25:56 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-8c4929e6-a6b8-4d1b-b60f-e20faf073da8 tempest-VolumesServicesTestJSON-1288874465 None] Acquiring lock "cinder-652df668-24ec-4824-be18-e3ae837d9d3d-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:25:56 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-8c4929e6-a6b8-4d1b-b60f-e20faf073da8 tempest-VolumesServicesTestJSON-1288874465 None] Lock "cinder-652df668-24ec-4824-be18-e3ae837d9d3d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:25:56 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-8c4929e6-a6b8-4d1b-b60f-e20faf073da8 tempest-VolumesServicesTestJSON-1288874465 None] Acquiring lock "cinder-quobyte-652df668-24ec-4824-be18-e3ae837d9d3d" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:25:56 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-8c4929e6-a6b8-4d1b-b60f-e20faf073da8 tempest-VolumesServicesTestJSON-1288874465 None] Lock "cinder-quobyte-652df668-24ec-4824-be18-e3ae837d9d3d" acquired by "delete_volume" :: waited 0.021s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:25:56 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d3195e9-1d24-4646-9961-7f1fc246be8f]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:25:56 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-8c4929e6-a6b8-4d1b-b60f-e20faf073da8 tempest-VolumesServicesTestJSON-1288874465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-652df668-24ec-4824-be18-e3ae837d9d3d {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:25:56 devstack sudo[100146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-652df668-24ec-4824-be18-e3ae837d9d3d Jul 22 03:25:56 devstack sudo[100146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:25:57 devstack sudo[100146]: pam_unix(sudo:session): session closed for user root Jul 22 03:25:57 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-8c4929e6-a6b8-4d1b-b60f-e20faf073da8 tempest-VolumesServicesTestJSON-1288874465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-652df668-24ec-4824-be18-e3ae837d9d3d" returned: 0 in 0.425s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:25:57 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-8c4929e6-a6b8-4d1b-b60f-e20faf073da8 tempest-VolumesServicesTestJSON-1288874465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-652df668-24ec-4824-be18-e3ae837d9d3d {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:25:57 devstack sudo[100151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-652df668-24ec-4824-be18-e3ae837d9d3d Jul 22 03:25:57 devstack sudo[100151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:25:57 devstack sudo[100151]: pam_unix(sudo:session): session closed for user root Jul 22 03:25:57 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-8c4929e6-a6b8-4d1b-b60f-e20faf073da8 tempest-VolumesServicesTestJSON-1288874465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-652df668-24ec-4824-be18-e3ae837d9d3d" returned: 0 in 0.317s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:25:57 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-8c4929e6-a6b8-4d1b-b60f-e20faf073da8 tempest-VolumesServicesTestJSON-1288874465 None] Lock "cinder-quobyte-652df668-24ec-4824-be18-e3ae837d9d3d" released by "delete_volume" :: held 0.792s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:25:57 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-8c4929e6-a6b8-4d1b-b60f-e20faf073da8 tempest-VolumesServicesTestJSON-1288874465 None] Created reservations ['1d60a8f8-b277-404d-ad85-5852bde6f522', 'db7ac03e-3dff-4799-8d9f-ff70eb4e4ba6', '6385fc26-0c20-4b70-9e28-1e85891c2e6a', 'd0127a66-ca27-4d90-b62e-dd3cfd61f35b'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:25:57 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-8c4929e6-a6b8-4d1b-b60f-e20faf073da8 tempest-VolumesServicesTestJSON-1288874465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:25:57 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-8c4929e6-a6b8-4d1b-b60f-e20faf073da8 tempest-VolumesServicesTestJSON-1288874465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:25:57 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-8c4929e6-a6b8-4d1b-b60f-e20faf073da8 tempest-VolumesServicesTestJSON-1288874465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:25:57 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-8c4929e6-a6b8-4d1b-b60f-e20faf073da8 tempest-VolumesServicesTestJSON-1288874465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:25:57 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-8c4929e6-a6b8-4d1b-b60f-e20faf073da8 tempest-VolumesServicesTestJSON-1288874465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:25:57 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-8c4929e6-a6b8-4d1b-b60f-e20faf073da8 tempest-VolumesServicesTestJSON-1288874465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:25:57 devstack sudo[100154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:25:57 devstack sudo[100154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:25:57 devstack sudo[100154]: pam_unix(sudo:session): session closed for user root Jul 22 03:25:58 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-8c4929e6-a6b8-4d1b-b60f-e20faf073da8 tempest-VolumesServicesTestJSON-1288874465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.342s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:25:58 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-8c4929e6-a6b8-4d1b-b60f-e20faf073da8 tempest-VolumesServicesTestJSON-1288874465 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:25:58 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-8c4929e6-a6b8-4d1b-b60f-e20faf073da8 tempest-VolumesServicesTestJSON-1288874465 None] Deleted volume successfully. Jul 22 03:25:58 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-8c4929e6-a6b8-4d1b-b60f-e20faf073da8 tempest-VolumesServicesTestJSON-1288874465 None] Lock "cinder-652df668-24ec-4824-be18-e3ae837d9d3d-delete_volume" released by "delete_volume" :: held 1.396s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:26:04 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-b94471e2-e9b7-402d-b758-d09aee4158de tempest-SnapshotDependencyTests-1568297841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:26:04 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b94471e2-e9b7-402d-b758-d09aee4158de tempest-SnapshotDependencyTests-1568297841 None] Flow 'volume_create_manager' (fed5692a-35d4-4e08-847a-ac6fb057b603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:26:04 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b94471e2-e9b7-402d-b758-d09aee4158de tempest-SnapshotDependencyTests-1568297841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60247760-4d3a-478d-b92f-705904c86277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:26:04 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b94471e2-e9b7-402d-b758-d09aee4158de tempest-SnapshotDependencyTests-1568297841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60247760-4d3a-478d-b92f-705904c86277) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:26:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-125902921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08bd2cc8-a529-49b8-8291-ec3fdeb0abec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4579364717564889896a756895272ffe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:26:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:26:04Z,use_quota=True,user_id='f9f6eb9a24fa41b9bece3f27ee572d11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:26:04 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b94471e2-e9b7-402d-b758-d09aee4158de tempest-SnapshotDependencyTests-1568297841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb3d42f4-ab00-4875-90ef-9edaf746dd78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:26:04 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b94471e2-e9b7-402d-b758-d09aee4158de tempest-SnapshotDependencyTests-1568297841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb3d42f4-ab00-4875-90ef-9edaf746dd78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:26:04 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b94471e2-e9b7-402d-b758-d09aee4158de tempest-SnapshotDependencyTests-1568297841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f077a7bd-62c0-475d-9344-39f0c2763713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:26:04 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b94471e2-e9b7-402d-b758-d09aee4158de tempest-SnapshotDependencyTests-1568297841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f077a7bd-62c0-475d-9344-39f0c2763713) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08bd2cc8-a529-49b8-8291-ec3fdeb0abec', 'volume_name': 'volume-08bd2cc8-a529-49b8-8291-ec3fdeb0abec', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:26:04 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b94471e2-e9b7-402d-b758-d09aee4158de tempest-SnapshotDependencyTests-1568297841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4d1af62-e105-4614-b801-d317b9ca6343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:26:04 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b94471e2-e9b7-402d-b758-d09aee4158de tempest-SnapshotDependencyTests-1568297841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4d1af62-e105-4614-b801-d317b9ca6343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:26:04 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b94471e2-e9b7-402d-b758-d09aee4158de tempest-SnapshotDependencyTests-1568297841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03100889-e3ec-4da9-9d3c-fd139d0f77e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:26:04 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-b94471e2-e9b7-402d-b758-d09aee4158de tempest-SnapshotDependencyTests-1568297841 None] Volume 08bd2cc8-a529-49b8-8291-ec3fdeb0abec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08bd2cc8-a529-49b8-8291-ec3fdeb0abec', 'volume_size': 1} Jul 22 03:26:04 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b94471e2-e9b7-402d-b758-d09aee4158de tempest-SnapshotDependencyTests-1568297841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:26:04 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b94471e2-e9b7-402d-b758-d09aee4158de tempest-SnapshotDependencyTests-1568297841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:26:04 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-b94471e2-e9b7-402d-b758-d09aee4158de tempest-SnapshotDependencyTests-1568297841 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:26:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-125902921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08bd2cc8-a529-49b8-8291-ec3fdeb0abec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4579364717564889896a756895272ffe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:26:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:26:04Z,use_quota=True,user_id='f9f6eb9a24fa41b9bece3f27ee572d11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:26:04 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-b94471e2-e9b7-402d-b758-d09aee4158de tempest-SnapshotDependencyTests-1568297841 None] Creating volume 08bd2cc8-a529-49b8-8291-ec3fdeb0abec {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:26:04 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b94471e2-e9b7-402d-b758-d09aee4158de tempest-SnapshotDependencyTests-1568297841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:26:04 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b94471e2-e9b7-402d-b758-d09aee4158de tempest-SnapshotDependencyTests-1568297841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:26:04 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-b94471e2-e9b7-402d-b758-d09aee4158de tempest-SnapshotDependencyTests-1568297841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:26:04 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-b94471e2-e9b7-402d-b758-d09aee4158de tempest-SnapshotDependencyTests-1568297841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:26:04 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b94471e2-e9b7-402d-b758-d09aee4158de tempest-SnapshotDependencyTests-1568297841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:26:04 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-b94471e2-e9b7-402d-b758-d09aee4158de tempest-SnapshotDependencyTests-1568297841 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:26:04 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-b94471e2-e9b7-402d-b758-d09aee4158de tempest-SnapshotDependencyTests-1568297841 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:26:04 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b94471e2-e9b7-402d-b758-d09aee4158de tempest-SnapshotDependencyTests-1568297841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-08bd2cc8-a529-49b8-8291-ec3fdeb0abec 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:26:04 devstack sudo[100160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-08bd2cc8-a529-49b8-8291-ec3fdeb0abec 1073741824 Jul 22 03:26:04 devstack sudo[100160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:26:04 devstack sudo[100160]: pam_unix(sudo:session): session closed for user root Jul 22 03:26:04 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b94471e2-e9b7-402d-b758-d09aee4158de tempest-SnapshotDependencyTests-1568297841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-08bd2cc8-a529-49b8-8291-ec3fdeb0abec 1073741824" returned: 0 in 0.539s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:26:04 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b94471e2-e9b7-402d-b758-d09aee4158de tempest-SnapshotDependencyTests-1568297841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-08bd2cc8-a529-49b8-8291-ec3fdeb0abec {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:26:04 devstack sudo[100166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-08bd2cc8-a529-49b8-8291-ec3fdeb0abec Jul 22 03:26:04 devstack sudo[100166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:26:05 devstack sudo[100166]: pam_unix(sudo:session): session closed for user root Jul 22 03:26:05 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b94471e2-e9b7-402d-b758-d09aee4158de tempest-SnapshotDependencyTests-1568297841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-08bd2cc8-a529-49b8-8291-ec3fdeb0abec" returned: 0 in 0.303s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:26:05 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-b94471e2-e9b7-402d-b758-d09aee4158de tempest-SnapshotDependencyTests-1568297841 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:26:05 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b94471e2-e9b7-402d-b758-d09aee4158de tempest-SnapshotDependencyTests-1568297841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:26:05 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b94471e2-e9b7-402d-b758-d09aee4158de tempest-SnapshotDependencyTests-1568297841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03100889-e3ec-4da9-9d3c-fd139d0f77e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08bd2cc8-a529-49b8-8291-ec3fdeb0abec', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:26:05 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b94471e2-e9b7-402d-b758-d09aee4158de tempest-SnapshotDependencyTests-1568297841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (236f0255-4c55-4df2-8be2-68b54c1f5c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:26:05 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-b94471e2-e9b7-402d-b758-d09aee4158de tempest-SnapshotDependencyTests-1568297841 None] Volume volume-08bd2cc8-a529-49b8-8291-ec3fdeb0abec (08bd2cc8-a529-49b8-8291-ec3fdeb0abec): created successfully Jul 22 03:26:05 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b94471e2-e9b7-402d-b758-d09aee4158de tempest-SnapshotDependencyTests-1568297841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (236f0255-4c55-4df2-8be2-68b54c1f5c66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:26:05 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b94471e2-e9b7-402d-b758-d09aee4158de tempest-SnapshotDependencyTests-1568297841 None] Flow 'volume_create_manager' (fed5692a-35d4-4e08-847a-ac6fb057b603) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:26:05 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-b94471e2-e9b7-402d-b758-d09aee4158de tempest-SnapshotDependencyTests-1568297841 None] Created volume successfully. Jul 22 03:26:06 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-a54eef4e-8199-4568-8b37-32800b5f0367 tempest-SnapshotDependencyTests-1568297841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:26:06 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-a54eef4e-8199-4568-8b37-32800b5f0367 tempest-SnapshotDependencyTests-1568297841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:26:06 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-a54eef4e-8199-4568-8b37-32800b5f0367 tempest-SnapshotDependencyTests-1568297841 None] Creating offline snapshot 896bea75-bdb3-4b94-8b34-d21708d291f6 of volume 08bd2cc8-a529-49b8-8291-ec3fdeb0abec {{(pid=87747) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 03:26:06 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff346ec1-707e-48c5-b020-03d5e484f2ef]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:26:06 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-a54eef4e-8199-4568-8b37-32800b5f0367 tempest-SnapshotDependencyTests-1568297841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-08bd2cc8-a529-49b8-8291-ec3fdeb0abec {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:26:06 devstack sudo[100169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-08bd2cc8-a529-49b8-8291-ec3fdeb0abec Jul 22 03:26:06 devstack sudo[100169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:26:07 devstack sudo[100169]: pam_unix(sudo:session): session closed for user root Jul 22 03:26:07 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-a54eef4e-8199-4568-8b37-32800b5f0367 tempest-SnapshotDependencyTests-1568297841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-08bd2cc8-a529-49b8-8291-ec3fdeb0abec" returned: 0 in 0.445s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:26:07 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-a54eef4e-8199-4568-8b37-32800b5f0367 tempest-SnapshotDependencyTests-1568297841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-08bd2cc8-a529-49b8-8291-ec3fdeb0abec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-08bd2cc8-a529-49b8-8291-ec3fdeb0abec.896bea75-bdb3-4b94-8b34-d21708d291f6 1G {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:26:07 devstack sudo[100174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-08bd2cc8-a529-49b8-8291-ec3fdeb0abec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-08bd2cc8-a529-49b8-8291-ec3fdeb0abec.896bea75-bdb3-4b94-8b34-d21708d291f6 1G Jul 22 03:26:07 devstack sudo[100174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:26:07 devstack sudo[100174]: pam_unix(sudo:session): session closed for user root Jul 22 03:26:07 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-a54eef4e-8199-4568-8b37-32800b5f0367 tempest-SnapshotDependencyTests-1568297841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-08bd2cc8-a529-49b8-8291-ec3fdeb0abec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-08bd2cc8-a529-49b8-8291-ec3fdeb0abec.896bea75-bdb3-4b94-8b34-d21708d291f6 1G" returned: 0 in 0.511s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:26:07 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-a54eef4e-8199-4568-8b37-32800b5f0367 tempest-SnapshotDependencyTests-1568297841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08bd2cc8-a529-49b8-8291-ec3fdeb0abec -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-08bd2cc8-a529-49b8-8291-ec3fdeb0abec.896bea75-bdb3-4b94-8b34-d21708d291f6 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:26:07 devstack sudo[100180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08bd2cc8-a529-49b8-8291-ec3fdeb0abec -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-08bd2cc8-a529-49b8-8291-ec3fdeb0abec.896bea75-bdb3-4b94-8b34-d21708d291f6 Jul 22 03:26:07 devstack sudo[100180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:26:07 devstack sudo[100180]: pam_unix(sudo:session): session closed for user root Jul 22 03:26:07 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-a54eef4e-8199-4568-8b37-32800b5f0367 tempest-SnapshotDependencyTests-1568297841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08bd2cc8-a529-49b8-8291-ec3fdeb0abec -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-08bd2cc8-a529-49b8-8291-ec3fdeb0abec.896bea75-bdb3-4b94-8b34-d21708d291f6" returned: 0 in 0.336s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:26:07 devstack cinder-volume[87747]: WARNING cinder.volume.drivers.remotefs [None req-a54eef4e-8199-4568-8b37-32800b5f0367 tempest-SnapshotDependencyTests-1568297841 None] /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-08bd2cc8-a529-49b8-8291-ec3fdeb0abec.896bea75-bdb3-4b94-8b34-d21708d291f6 is being set with open permissions: ugo+rw Jul 22 03:26:07 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-a54eef4e-8199-4568-8b37-32800b5f0367 tempest-SnapshotDependencyTests-1568297841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-08bd2cc8-a529-49b8-8291-ec3fdeb0abec.896bea75-bdb3-4b94-8b34-d21708d291f6 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:26:07 devstack sudo[100186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-08bd2cc8-a529-49b8-8291-ec3fdeb0abec.896bea75-bdb3-4b94-8b34-d21708d291f6 Jul 22 03:26:07 devstack sudo[100186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:26:08 devstack sudo[100186]: pam_unix(sudo:session): session closed for user root Jul 22 03:26:08 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-a54eef4e-8199-4568-8b37-32800b5f0367 tempest-SnapshotDependencyTests-1568297841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-08bd2cc8-a529-49b8-8291-ec3fdeb0abec.896bea75-bdb3-4b94-8b34-d21708d291f6" returned: 0 in 0.282s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:26:08 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-a54eef4e-8199-4568-8b37-32800b5f0367 tempest-SnapshotDependencyTests-1568297841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-08bd2cc8-a529-49b8-8291-ec3fdeb0abec.info {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:26:08 devstack sudo[100189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-08bd2cc8-a529-49b8-8291-ec3fdeb0abec.info Jul 22 03:26:08 devstack sudo[100189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:26:08 devstack sudo[100189]: pam_unix(sudo:session): session closed for user root Jul 22 03:26:08 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-a54eef4e-8199-4568-8b37-32800b5f0367 tempest-SnapshotDependencyTests-1568297841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-08bd2cc8-a529-49b8-8291-ec3fdeb0abec.info" returned: 0 in 0.350s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:26:08 devstack cinder-volume[87747]: WARNING cinder.volume.drivers.remotefs [None req-a54eef4e-8199-4568-8b37-32800b5f0367 tempest-SnapshotDependencyTests-1568297841 None] /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-08bd2cc8-a529-49b8-8291-ec3fdeb0abec.info is being set with open permissions: ugo+rw Jul 22 03:26:08 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-a54eef4e-8199-4568-8b37-32800b5f0367 tempest-SnapshotDependencyTests-1568297841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-08bd2cc8-a529-49b8-8291-ec3fdeb0abec.info {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:26:08 devstack sudo[100192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-08bd2cc8-a529-49b8-8291-ec3fdeb0abec.info Jul 22 03:26:08 devstack sudo[100192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:26:08 devstack sudo[100192]: pam_unix(sudo:session): session closed for user root Jul 22 03:26:08 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-a54eef4e-8199-4568-8b37-32800b5f0367 tempest-SnapshotDependencyTests-1568297841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-08bd2cc8-a529-49b8-8291-ec3fdeb0abec.info" returned: 0 in 0.245s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:26:08 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-a54eef4e-8199-4568-8b37-32800b5f0367 tempest-SnapshotDependencyTests-1568297841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.341s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:26:08 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-a54eef4e-8199-4568-8b37-32800b5f0367 tempest-SnapshotDependencyTests-1568297841 None] Create snapshot completed successfully Jul 22 03:26:10 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-855781a7-61ca-42bd-b3b0-af8522d869a8 tempest-SnapshotDependencyTests-1568297841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:26:10 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-855781a7-61ca-42bd-b3b0-af8522d869a8 tempest-SnapshotDependencyTests-1568297841 None] Flow 'volume_create_manager' (3bc659d5-310d-401b-8c3c-f4e436a5341f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:26:10 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-855781a7-61ca-42bd-b3b0-af8522d869a8 tempest-SnapshotDependencyTests-1568297841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3c3ba3d-1ac3-4698-a158-409ca29ce0ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:26:10 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-855781a7-61ca-42bd-b3b0-af8522d869a8 tempest-SnapshotDependencyTests-1568297841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3c3ba3d-1ac3-4698-a158-409ca29ce0ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:26:10Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6757f563-ebbe-4dd0-893a-07443ebc0172,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4579364717564889896a756895272ffe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:26:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=896bea75-bdb3-4b94-8b34-d21708d291f6,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:26:10Z,use_quota=True,user_id='f9f6eb9a24fa41b9bece3f27ee572d11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:26:10 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-855781a7-61ca-42bd-b3b0-af8522d869a8 tempest-SnapshotDependencyTests-1568297841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6842c389-ec7b-487d-96da-d0ece0fa85ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:26:10 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-855781a7-61ca-42bd-b3b0-af8522d869a8 tempest-SnapshotDependencyTests-1568297841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6842c389-ec7b-487d-96da-d0ece0fa85ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:26:10 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-855781a7-61ca-42bd-b3b0-af8522d869a8 tempest-SnapshotDependencyTests-1568297841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08ab1fdc-03ae-4334-88e5-abc6fe949e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:26:10 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-855781a7-61ca-42bd-b3b0-af8522d869a8 tempest-SnapshotDependencyTests-1568297841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08ab1fdc-03ae-4334-88e5-abc6fe949e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6757f563-ebbe-4dd0-893a-07443ebc0172', 'volume_name': 'volume-6757f563-ebbe-4dd0-893a-07443ebc0172', 'volume_size': 1, 'snapshot_id': '896bea75-bdb3-4b94-8b34-d21708d291f6'}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:26:10 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-855781a7-61ca-42bd-b3b0-af8522d869a8 tempest-SnapshotDependencyTests-1568297841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec3b57d5-4f76-4317-90f4-f26e1294b14b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:26:10 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-855781a7-61ca-42bd-b3b0-af8522d869a8 tempest-SnapshotDependencyTests-1568297841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec3b57d5-4f76-4317-90f4-f26e1294b14b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:26:10 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-855781a7-61ca-42bd-b3b0-af8522d869a8 tempest-SnapshotDependencyTests-1568297841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cf952c8-dcaf-43a2-ab8b-d4577b30d2ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:26:10 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-855781a7-61ca-42bd-b3b0-af8522d869a8 tempest-SnapshotDependencyTests-1568297841 None] Volume 6757f563-ebbe-4dd0-893a-07443ebc0172: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6757f563-ebbe-4dd0-893a-07443ebc0172', 'volume_size': 1, 'snapshot_id': '896bea75-bdb3-4b94-8b34-d21708d291f6'} Jul 22 03:26:10 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-855781a7-61ca-42bd-b3b0-af8522d869a8 tempest-SnapshotDependencyTests-1568297841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:26:10 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-855781a7-61ca-42bd-b3b0-af8522d869a8 tempest-SnapshotDependencyTests-1568297841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:26:10 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-855781a7-61ca-42bd-b3b0-af8522d869a8 tempest-SnapshotDependencyTests-1568297841 None] Acquiring lock "cinder-quobyte-896bea75-bdb3-4b94-8b34-d21708d291f6-6757f563-ebbe-4dd0-893a-07443ebc0172" by "_create_volume_from_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:26:10 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-855781a7-61ca-42bd-b3b0-af8522d869a8 tempest-SnapshotDependencyTests-1568297841 None] Lock "cinder-quobyte-896bea75-bdb3-4b94-8b34-d21708d291f6-6757f563-ebbe-4dd0-893a-07443ebc0172" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:26:10 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-855781a7-61ca-42bd-b3b0-af8522d869a8 tempest-SnapshotDependencyTests-1568297841 None] Creating volume 6757f563-ebbe-4dd0-893a-07443ebc0172 from snapshot 896bea75-bdb3-4b94-8b34-d21708d291f6 {{(pid=87747) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 22 03:26:10 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-855781a7-61ca-42bd-b3b0-af8522d869a8 tempest-SnapshotDependencyTests-1568297841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:26:10 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-855781a7-61ca-42bd-b3b0-af8522d869a8 tempest-SnapshotDependencyTests-1568297841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:26:10 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-855781a7-61ca-42bd-b3b0-af8522d869a8 tempest-SnapshotDependencyTests-1568297841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:26:10 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-855781a7-61ca-42bd-b3b0-af8522d869a8 tempest-SnapshotDependencyTests-1568297841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:26:10 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-855781a7-61ca-42bd-b3b0-af8522d869a8 tempest-SnapshotDependencyTests-1568297841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:26:10 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-855781a7-61ca-42bd-b3b0-af8522d869a8 tempest-SnapshotDependencyTests-1568297841 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:26:10 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-855781a7-61ca-42bd-b3b0-af8522d869a8 tempest-SnapshotDependencyTests-1568297841 None] Acquiring lock "cinder-quobyte-6757f563-ebbe-4dd0-893a-07443ebc0172" by "_copy_volume_from_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:26:10 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-855781a7-61ca-42bd-b3b0-af8522d869a8 tempest-SnapshotDependencyTests-1568297841 None] Lock "cinder-quobyte-6757f563-ebbe-4dd0-893a-07443ebc0172" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:26:10 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-855781a7-61ca-42bd-b3b0-af8522d869a8 tempest-SnapshotDependencyTests-1568297841 None] snapshot: 896bea75-bdb3-4b94-8b34-d21708d291f6, volume: 6757f563-ebbe-4dd0-893a-07443ebc0172, {{(pid=87747) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 22 03:26:10 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-855781a7-61ca-42bd-b3b0-af8522d869a8 tempest-SnapshotDependencyTests-1568297841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:26:10 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-855781a7-61ca-42bd-b3b0-af8522d869a8 tempest-SnapshotDependencyTests-1568297841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:26:10 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-855781a7-61ca-42bd-b3b0-af8522d869a8 tempest-SnapshotDependencyTests-1568297841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:26:10 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-855781a7-61ca-42bd-b3b0-af8522d869a8 tempest-SnapshotDependencyTests-1568297841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:26:10 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-855781a7-61ca-42bd-b3b0-af8522d869a8 tempest-SnapshotDependencyTests-1568297841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:26:10 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[504af41d-e9cc-4409-85d3-9161d6ffc32d]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:26:10 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-855781a7-61ca-42bd-b3b0-af8522d869a8 tempest-SnapshotDependencyTests-1568297841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-08bd2cc8-a529-49b8-8291-ec3fdeb0abec.896bea75-bdb3-4b94-8b34-d21708d291f6 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:26:10 devstack sudo[100195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-08bd2cc8-a529-49b8-8291-ec3fdeb0abec.896bea75-bdb3-4b94-8b34-d21708d291f6 Jul 22 03:26:10 devstack sudo[100195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:26:11 devstack sudo[100195]: pam_unix(sudo:session): session closed for user root Jul 22 03:26:11 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-855781a7-61ca-42bd-b3b0-af8522d869a8 tempest-SnapshotDependencyTests-1568297841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-08bd2cc8-a529-49b8-8291-ec3fdeb0abec.896bea75-bdb3-4b94-8b34-d21708d291f6" returned: 0 in 0.402s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:26:11 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-855781a7-61ca-42bd-b3b0-af8522d869a8 tempest-SnapshotDependencyTests-1568297841 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-08bd2cc8-a529-49b8-8291-ec3fdeb0abec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87747) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 03:26:11 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-855781a7-61ca-42bd-b3b0-af8522d869a8 tempest-SnapshotDependencyTests-1568297841 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-08bd2cc8-a529-49b8-8291-ec3fdeb0abec {{(pid=87747) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 22 03:26:11 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-855781a7-61ca-42bd-b3b0-af8522d869a8 tempest-SnapshotDependencyTests-1568297841 None] Creating direct copy from snapshot {{(pid=87747) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 22 03:26:11 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef31101d-f8b0-48b1-b64c-1e7ed044c83e]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:26:11 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-855781a7-61ca-42bd-b3b0-af8522d869a8 tempest-SnapshotDependencyTests-1568297841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-08bd2cc8-a529-49b8-8291-ec3fdeb0abec {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:26:11 devstack sudo[100200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-08bd2cc8-a529-49b8-8291-ec3fdeb0abec Jul 22 03:26:11 devstack sudo[100200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:26:11 devstack sudo[100200]: pam_unix(sudo:session): session closed for user root Jul 22 03:26:11 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-855781a7-61ca-42bd-b3b0-af8522d869a8 tempest-SnapshotDependencyTests-1568297841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-08bd2cc8-a529-49b8-8291-ec3fdeb0abec" returned: 0 in 0.463s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:26:11 devstack cinder-volume[87747]: DEBUG cinder.utils [None req-855781a7-61ca-42bd-b3b0-af8522d869a8 tempest-SnapshotDependencyTests-1568297841 None] Path /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-6757f563-ebbe-4dd0-893a-07443ebc0172 not found in is_blk_device check {{(pid=87747) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 22 03:26:11 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-855781a7-61ca-42bd-b3b0-af8522d869a8 tempest-SnapshotDependencyTests-1568297841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-08bd2cc8-a529-49b8-8291-ec3fdeb0abec /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-6757f563-ebbe-4dd0-893a-07443ebc0172 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:26:11 devstack sudo[100207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-08bd2cc8-a529-49b8-8291-ec3fdeb0abec /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-6757f563-ebbe-4dd0-893a-07443ebc0172 Jul 22 03:26:11 devstack sudo[100207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:26:17 devstack sudo[100207]: pam_unix(sudo:session): session closed for user root Jul 22 03:26:17 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-855781a7-61ca-42bd-b3b0-af8522d869a8 tempest-SnapshotDependencyTests-1568297841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-08bd2cc8-a529-49b8-8291-ec3fdeb0abec /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-6757f563-ebbe-4dd0-893a-07443ebc0172" returned: 0 in 5.730s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:26:17 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[edcf6957-9318-4ecc-beae-0a8115fc2a2a]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:26:17 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-855781a7-61ca-42bd-b3b0-af8522d869a8 tempest-SnapshotDependencyTests-1568297841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-08bd2cc8-a529-49b8-8291-ec3fdeb0abec {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:26:17 devstack sudo[100222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-08bd2cc8-a529-49b8-8291-ec3fdeb0abec Jul 22 03:26:17 devstack sudo[100222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:26:17 devstack sudo[100222]: pam_unix(sudo:session): session closed for user root Jul 22 03:26:17 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-855781a7-61ca-42bd-b3b0-af8522d869a8 tempest-SnapshotDependencyTests-1568297841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-08bd2cc8-a529-49b8-8291-ec3fdeb0abec" returned: 0 in 0.657s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:26:17 devstack cinder-volume[87747]: DEBUG cinder.image.image_utils [None req-855781a7-61ca-42bd-b3b0-af8522d869a8 tempest-SnapshotDependencyTests-1568297841 None] Image conversion details: src /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-08bd2cc8-a529-49b8-8291-ec3fdeb0abec, size 1024.00 MB, duration 5.73 sec, destination /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-6757f563-ebbe-4dd0-893a-07443ebc0172 {{(pid=87747) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 22 03:26:17 devstack cinder-volume[87747]: INFO cinder.image.image_utils [None req-855781a7-61ca-42bd-b3b0-af8522d869a8 tempest-SnapshotDependencyTests-1568297841 None] Converted 1024.00 MB image at 178.67 MB/s Jul 22 03:26:17 devstack cinder-volume[87747]: WARNING cinder.volume.drivers.remotefs [None req-855781a7-61ca-42bd-b3b0-af8522d869a8 tempest-SnapshotDependencyTests-1568297841 None] /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-6757f563-ebbe-4dd0-893a-07443ebc0172 is being set with open permissions: ugo+rw Jul 22 03:26:17 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-855781a7-61ca-42bd-b3b0-af8522d869a8 tempest-SnapshotDependencyTests-1568297841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-6757f563-ebbe-4dd0-893a-07443ebc0172 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:26:18 devstack sudo[100227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-6757f563-ebbe-4dd0-893a-07443ebc0172 Jul 22 03:26:18 devstack sudo[100227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:26:18 devstack sudo[100227]: pam_unix(sudo:session): session closed for user root Jul 22 03:26:18 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-855781a7-61ca-42bd-b3b0-af8522d869a8 tempest-SnapshotDependencyTests-1568297841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-6757f563-ebbe-4dd0-893a-07443ebc0172" returned: 0 in 0.316s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:26:18 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-855781a7-61ca-42bd-b3b0-af8522d869a8 tempest-SnapshotDependencyTests-1568297841 None] Lock "cinder-quobyte-6757f563-ebbe-4dd0-893a-07443ebc0172" released by "_copy_volume_from_snapshot" :: held 7.684s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:26:18 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-855781a7-61ca-42bd-b3b0-af8522d869a8 tempest-SnapshotDependencyTests-1568297841 None] Lock "cinder-quobyte-896bea75-bdb3-4b94-8b34-d21708d291f6-6757f563-ebbe-4dd0-893a-07443ebc0172" released by "_create_volume_from_snapshot" :: held 7.734s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:26:18 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-855781a7-61ca-42bd-b3b0-af8522d869a8 tempest-SnapshotDependencyTests-1568297841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.753s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:26:18 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-855781a7-61ca-42bd-b3b0-af8522d869a8 tempest-SnapshotDependencyTests-1568297841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cf952c8-dcaf-43a2-ab8b-d4577b30d2ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6757f563-ebbe-4dd0-893a-07443ebc0172', 'volume_size': 1, 'snapshot_id': '896bea75-bdb3-4b94-8b34-d21708d291f6'}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:26:18 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-855781a7-61ca-42bd-b3b0-af8522d869a8 tempest-SnapshotDependencyTests-1568297841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbbf58f5-8b7e-4b88-8877-bf6d432e0a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:26:18 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-855781a7-61ca-42bd-b3b0-af8522d869a8 tempest-SnapshotDependencyTests-1568297841 None] Volume volume-6757f563-ebbe-4dd0-893a-07443ebc0172 (6757f563-ebbe-4dd0-893a-07443ebc0172): created successfully Jul 22 03:26:18 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-855781a7-61ca-42bd-b3b0-af8522d869a8 tempest-SnapshotDependencyTests-1568297841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbbf58f5-8b7e-4b88-8877-bf6d432e0a1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:26:18 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-855781a7-61ca-42bd-b3b0-af8522d869a8 tempest-SnapshotDependencyTests-1568297841 None] Flow 'volume_create_manager' (3bc659d5-310d-401b-8c3c-f4e436a5341f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:26:18 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-855781a7-61ca-42bd-b3b0-af8522d869a8 tempest-SnapshotDependencyTests-1568297841 None] Created volume successfully. Jul 22 03:26:19 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-4ce4eeb8-6609-456c-acbf-d6cb53e07840 tempest-SnapshotDependencyTests-1568297841 None] Acquiring lock "cinder-896bea75-bdb3-4b94-8b34-d21708d291f6-delete_snapshot" by "delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:26:19 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-4ce4eeb8-6609-456c-acbf-d6cb53e07840 tempest-SnapshotDependencyTests-1568297841 None] Lock "cinder-896bea75-bdb3-4b94-8b34-d21708d291f6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:26:19 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-4ce4eeb8-6609-456c-acbf-d6cb53e07840 tempest-SnapshotDependencyTests-1568297841 None] Acquiring lock "cinder-quobyte-08bd2cc8-a529-49b8-8291-ec3fdeb0abec" by "delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:26:19 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-4ce4eeb8-6609-456c-acbf-d6cb53e07840 tempest-SnapshotDependencyTests-1568297841 None] Lock "cinder-quobyte-08bd2cc8-a529-49b8-8291-ec3fdeb0abec" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:26:19 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-4ce4eeb8-6609-456c-acbf-d6cb53e07840 tempest-SnapshotDependencyTests-1568297841 None] Acquiring lock "cinder-quobyte-896bea75-bdb3-4b94-8b34-d21708d291f6" by "_delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:26:19 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-4ce4eeb8-6609-456c-acbf-d6cb53e07840 tempest-SnapshotDependencyTests-1568297841 None] Lock "cinder-quobyte-896bea75-bdb3-4b94-8b34-d21708d291f6" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:26:19 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-4ce4eeb8-6609-456c-acbf-d6cb53e07840 tempest-SnapshotDependencyTests-1568297841 None] Deleting offline snapshot 896bea75-bdb3-4b94-8b34-d21708d291f6 of volume 08bd2cc8-a529-49b8-8291-ec3fdeb0abec {{(pid=87747) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 03:26:19 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-4ce4eeb8-6609-456c-acbf-d6cb53e07840 tempest-SnapshotDependencyTests-1568297841 None] snapshot_file for this snap is: volume-08bd2cc8-a529-49b8-8291-ec3fdeb0abec.896bea75-bdb3-4b94-8b34-d21708d291f6 {{(pid=87747) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 03:26:19 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4aa9cc2-adb6-44d2-a37b-92dc0eb98e10]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:26:19 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-4ce4eeb8-6609-456c-acbf-d6cb53e07840 tempest-SnapshotDependencyTests-1568297841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-08bd2cc8-a529-49b8-8291-ec3fdeb0abec.896bea75-bdb3-4b94-8b34-d21708d291f6 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:26:19 devstack sudo[100230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-08bd2cc8-a529-49b8-8291-ec3fdeb0abec.896bea75-bdb3-4b94-8b34-d21708d291f6 Jul 22 03:26:19 devstack sudo[100230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:26:20 devstack sudo[100230]: pam_unix(sudo:session): session closed for user root Jul 22 03:26:20 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-4ce4eeb8-6609-456c-acbf-d6cb53e07840 tempest-SnapshotDependencyTests-1568297841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-08bd2cc8-a529-49b8-8291-ec3fdeb0abec.896bea75-bdb3-4b94-8b34-d21708d291f6" returned: 0 in 0.435s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:26:20 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-4ce4eeb8-6609-456c-acbf-d6cb53e07840 tempest-SnapshotDependencyTests-1568297841 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-08bd2cc8-a529-49b8-8291-ec3fdeb0abec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87747) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 03:26:20 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef438ab3-b547-4217-866d-bdff9d744b6d]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:26:20 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-4ce4eeb8-6609-456c-acbf-d6cb53e07840 tempest-SnapshotDependencyTests-1568297841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-08bd2cc8-a529-49b8-8291-ec3fdeb0abec {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:26:20 devstack sudo[100236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-08bd2cc8-a529-49b8-8291-ec3fdeb0abec Jul 22 03:26:20 devstack sudo[100236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:26:20 devstack sudo[100236]: pam_unix(sudo:session): session closed for user root Jul 22 03:26:20 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-4ce4eeb8-6609-456c-acbf-d6cb53e07840 tempest-SnapshotDependencyTests-1568297841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-08bd2cc8-a529-49b8-8291-ec3fdeb0abec" returned: 0 in 0.486s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:26:20 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-4ce4eeb8-6609-456c-acbf-d6cb53e07840 tempest-SnapshotDependencyTests-1568297841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-08bd2cc8-a529-49b8-8291-ec3fdeb0abec.896bea75-bdb3-4b94-8b34-d21708d291f6 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:26:20 devstack sudo[100241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-08bd2cc8-a529-49b8-8291-ec3fdeb0abec.896bea75-bdb3-4b94-8b34-d21708d291f6 Jul 22 03:26:20 devstack sudo[100241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:26:21 devstack sudo[100241]: pam_unix(sudo:session): session closed for user root Jul 22 03:26:21 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-4ce4eeb8-6609-456c-acbf-d6cb53e07840 tempest-SnapshotDependencyTests-1568297841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-08bd2cc8-a529-49b8-8291-ec3fdeb0abec.896bea75-bdb3-4b94-8b34-d21708d291f6" returned: 0 in 0.476s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:26:21 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-4ce4eeb8-6609-456c-acbf-d6cb53e07840 tempest-SnapshotDependencyTests-1568297841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-08bd2cc8-a529-49b8-8291-ec3fdeb0abec.896bea75-bdb3-4b94-8b34-d21708d291f6 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:26:21 devstack sudo[100246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-08bd2cc8-a529-49b8-8291-ec3fdeb0abec.896bea75-bdb3-4b94-8b34-d21708d291f6 Jul 22 03:26:21 devstack sudo[100246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:26:21 devstack sudo[100246]: pam_unix(sudo:session): session closed for user root Jul 22 03:26:21 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-4ce4eeb8-6609-456c-acbf-d6cb53e07840 tempest-SnapshotDependencyTests-1568297841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-08bd2cc8-a529-49b8-8291-ec3fdeb0abec.896bea75-bdb3-4b94-8b34-d21708d291f6" returned: 0 in 0.292s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:26:21 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-4ce4eeb8-6609-456c-acbf-d6cb53e07840 tempest-SnapshotDependencyTests-1568297841 None] Lock "cinder-quobyte-896bea75-bdb3-4b94-8b34-d21708d291f6" released by "_delete_snapshot" :: held 1.817s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:26:21 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-4ce4eeb8-6609-456c-acbf-d6cb53e07840 tempest-SnapshotDependencyTests-1568297841 None] Lock "cinder-quobyte-08bd2cc8-a529-49b8-8291-ec3fdeb0abec" released by "delete_snapshot" :: held 1.838s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:26:21 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-4ce4eeb8-6609-456c-acbf-d6cb53e07840 tempest-SnapshotDependencyTests-1568297841 None] Created reservations ['c8786065-da79-4b7b-b69f-8c58d02a4389', 'a8e7ddc2-5c77-4d1b-ac2b-d9c05a7811b8', '2ed47f6b-2816-4461-8dcd-0e9ebb6287b9', '46b374db-4156-4af5-8d23-6761e3b5ff61'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:26:21 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-4ce4eeb8-6609-456c-acbf-d6cb53e07840 tempest-SnapshotDependencyTests-1568297841 None] Delete snapshot completed successfully. Jul 22 03:26:21 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-4ce4eeb8-6609-456c-acbf-d6cb53e07840 tempest-SnapshotDependencyTests-1568297841 None] Lock "cinder-896bea75-bdb3-4b94-8b34-d21708d291f6-delete_snapshot" released by "delete_snapshot" :: held 2.009s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:26:21 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-e1e08d6d-98a0-4c92-8f99-06c32914546c tempest-SnapshotDependencyTests-1568297841 None] Acquiring lock "cinder-08bd2cc8-a529-49b8-8291-ec3fdeb0abec-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:26:21 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-e1e08d6d-98a0-4c92-8f99-06c32914546c tempest-SnapshotDependencyTests-1568297841 None] Lock "cinder-08bd2cc8-a529-49b8-8291-ec3fdeb0abec-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:26:21 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-e1e08d6d-98a0-4c92-8f99-06c32914546c tempest-SnapshotDependencyTests-1568297841 None] Acquiring lock "cinder-quobyte-08bd2cc8-a529-49b8-8291-ec3fdeb0abec" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:26:21 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-e1e08d6d-98a0-4c92-8f99-06c32914546c tempest-SnapshotDependencyTests-1568297841 None] Lock "cinder-quobyte-08bd2cc8-a529-49b8-8291-ec3fdeb0abec" acquired by "delete_volume" :: waited 0.022s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:26:21 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aa548cf-035f-4611-adf1-2919f92de74b]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:26:21 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-e1e08d6d-98a0-4c92-8f99-06c32914546c tempest-SnapshotDependencyTests-1568297841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-08bd2cc8-a529-49b8-8291-ec3fdeb0abec {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:26:22 devstack sudo[100249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-08bd2cc8-a529-49b8-8291-ec3fdeb0abec Jul 22 03:26:22 devstack sudo[100249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:26:22 devstack sudo[100249]: pam_unix(sudo:session): session closed for user root Jul 22 03:26:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-e1e08d6d-98a0-4c92-8f99-06c32914546c tempest-SnapshotDependencyTests-1568297841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-08bd2cc8-a529-49b8-8291-ec3fdeb0abec" returned: 0 in 0.433s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:26:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-e1e08d6d-98a0-4c92-8f99-06c32914546c tempest-SnapshotDependencyTests-1568297841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-08bd2cc8-a529-49b8-8291-ec3fdeb0abec {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:26:22 devstack sudo[100254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-08bd2cc8-a529-49b8-8291-ec3fdeb0abec Jul 22 03:26:22 devstack sudo[100254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:26:22 devstack cinder-volume[87747]: DEBUG oslo_service.periodic_task [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87747) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 03:26:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:26:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:26:22 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:26:22 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:26:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:26:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:26:22 devstack sudo[100256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:26:22 devstack sudo[100256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:26:22 devstack sudo[100254]: pam_unix(sudo:session): session closed for user root Jul 22 03:26:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-e1e08d6d-98a0-4c92-8f99-06c32914546c tempest-SnapshotDependencyTests-1568297841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-08bd2cc8-a529-49b8-8291-ec3fdeb0abec" returned: 0 in 0.347s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:26:22 devstack sudo[100256]: pam_unix(sudo:session): session closed for user root Jul 22 03:26:22 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-e1e08d6d-98a0-4c92-8f99-06c32914546c tempest-SnapshotDependencyTests-1568297841 None] Lock "cinder-quobyte-08bd2cc8-a529-49b8-8291-ec3fdeb0abec" released by "delete_volume" :: held 0.877s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:26:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.286s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:26:22 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:26:22 devstack cinder-volume[87747]: DEBUG oslo_service.periodic_task [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Running periodic task VolumeManager._thread_info {{(pid=87747) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 03:26:22 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] thread count: 28 {{(pid=87747) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 22 03:26:22 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] thread info: [<_MainThread(MainThread, started 132775275860096)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87747) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 22 03:26:22 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-e1e08d6d-98a0-4c92-8f99-06c32914546c tempest-SnapshotDependencyTests-1568297841 None] Created reservations ['e59e700a-286f-4a4a-b73b-c92171948685', '8480b7b6-3c44-423b-8f6c-a1843e1a52ca', 'f9449aa3-f963-4b0a-b5e1-221143182a13', '157f782b-dee4-448c-9a9e-8cc9c97c6b83'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:26:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-e1e08d6d-98a0-4c92-8f99-06c32914546c tempest-SnapshotDependencyTests-1568297841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:26:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-e1e08d6d-98a0-4c92-8f99-06c32914546c tempest-SnapshotDependencyTests-1568297841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:26:22 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-e1e08d6d-98a0-4c92-8f99-06c32914546c tempest-SnapshotDependencyTests-1568297841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:26:22 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-e1e08d6d-98a0-4c92-8f99-06c32914546c tempest-SnapshotDependencyTests-1568297841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:26:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-e1e08d6d-98a0-4c92-8f99-06c32914546c tempest-SnapshotDependencyTests-1568297841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:26:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-e1e08d6d-98a0-4c92-8f99-06c32914546c tempest-SnapshotDependencyTests-1568297841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:26:22 devstack sudo[100260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:26:22 devstack sudo[100260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:26:22 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-ff2b69cf-a7f2-419b-8a7b-346773c3a9ae tempest-SnapshotDependencyTests-1568297841 None] Acquiring lock "cinder-6757f563-ebbe-4dd0-893a-07443ebc0172-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:26:23 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-ff2b69cf-a7f2-419b-8a7b-346773c3a9ae tempest-SnapshotDependencyTests-1568297841 None] Lock "cinder-6757f563-ebbe-4dd0-893a-07443ebc0172-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:26:23 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-ff2b69cf-a7f2-419b-8a7b-346773c3a9ae tempest-SnapshotDependencyTests-1568297841 None] Acquiring lock "cinder-quobyte-6757f563-ebbe-4dd0-893a-07443ebc0172" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:26:23 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-ff2b69cf-a7f2-419b-8a7b-346773c3a9ae tempest-SnapshotDependencyTests-1568297841 None] Lock "cinder-quobyte-6757f563-ebbe-4dd0-893a-07443ebc0172" acquired by "delete_volume" :: waited 0.016s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:26:23 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[93089711-6ff7-44ff-84d8-63c6ea49ca72]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:26:23 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ff2b69cf-a7f2-419b-8a7b-346773c3a9ae tempest-SnapshotDependencyTests-1568297841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-6757f563-ebbe-4dd0-893a-07443ebc0172 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:26:23 devstack sudo[100260]: pam_unix(sudo:session): session closed for user root Jul 22 03:26:23 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-e1e08d6d-98a0-4c92-8f99-06c32914546c tempest-SnapshotDependencyTests-1568297841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.300s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:26:23 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-e1e08d6d-98a0-4c92-8f99-06c32914546c tempest-SnapshotDependencyTests-1568297841 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:26:23 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-e1e08d6d-98a0-4c92-8f99-06c32914546c tempest-SnapshotDependencyTests-1568297841 None] Deleted volume successfully. Jul 22 03:26:23 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-e1e08d6d-98a0-4c92-8f99-06c32914546c tempest-SnapshotDependencyTests-1568297841 None] Lock "cinder-08bd2cc8-a529-49b8-8291-ec3fdeb0abec-delete_volume" released by "delete_volume" :: held 1.480s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:26:23 devstack sudo[100263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-6757f563-ebbe-4dd0-893a-07443ebc0172 Jul 22 03:26:23 devstack sudo[100263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:26:23 devstack sudo[100263]: pam_unix(sudo:session): session closed for user root Jul 22 03:26:23 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ff2b69cf-a7f2-419b-8a7b-346773c3a9ae tempest-SnapshotDependencyTests-1568297841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-6757f563-ebbe-4dd0-893a-07443ebc0172" returned: 0 in 0.503s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:26:23 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ff2b69cf-a7f2-419b-8a7b-346773c3a9ae tempest-SnapshotDependencyTests-1568297841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-6757f563-ebbe-4dd0-893a-07443ebc0172 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:26:23 devstack sudo[100269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-6757f563-ebbe-4dd0-893a-07443ebc0172 Jul 22 03:26:23 devstack sudo[100269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:26:23 devstack sudo[100269]: pam_unix(sudo:session): session closed for user root Jul 22 03:26:23 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ff2b69cf-a7f2-419b-8a7b-346773c3a9ae tempest-SnapshotDependencyTests-1568297841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-6757f563-ebbe-4dd0-893a-07443ebc0172" returned: 0 in 0.285s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:26:23 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-ff2b69cf-a7f2-419b-8a7b-346773c3a9ae tempest-SnapshotDependencyTests-1568297841 None] Lock "cinder-quobyte-6757f563-ebbe-4dd0-893a-07443ebc0172" released by "delete_volume" :: held 0.847s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:26:24 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-ff2b69cf-a7f2-419b-8a7b-346773c3a9ae tempest-SnapshotDependencyTests-1568297841 None] Created reservations ['fcdc36c2-8388-412b-8298-5fb7e352e9e7', '3d98826d-0cd0-4875-8603-966a8994c26d', '2f116047-15b1-4e00-835a-551dcb76f805', 'dd9f8bd4-129f-4d41-ad5e-f60d0cd01dd6'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:26:24 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-ff2b69cf-a7f2-419b-8a7b-346773c3a9ae tempest-SnapshotDependencyTests-1568297841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:26:24 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-ff2b69cf-a7f2-419b-8a7b-346773c3a9ae tempest-SnapshotDependencyTests-1568297841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:26:24 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-ff2b69cf-a7f2-419b-8a7b-346773c3a9ae tempest-SnapshotDependencyTests-1568297841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:26:24 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-ff2b69cf-a7f2-419b-8a7b-346773c3a9ae tempest-SnapshotDependencyTests-1568297841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:26:24 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-ff2b69cf-a7f2-419b-8a7b-346773c3a9ae tempest-SnapshotDependencyTests-1568297841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:26:24 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ff2b69cf-a7f2-419b-8a7b-346773c3a9ae tempest-SnapshotDependencyTests-1568297841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:26:24 devstack sudo[100272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:26:24 devstack sudo[100272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:26:24 devstack sudo[100272]: pam_unix(sudo:session): session closed for user root Jul 22 03:26:24 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ff2b69cf-a7f2-419b-8a7b-346773c3a9ae tempest-SnapshotDependencyTests-1568297841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.401s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:26:24 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-ff2b69cf-a7f2-419b-8a7b-346773c3a9ae tempest-SnapshotDependencyTests-1568297841 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:26:24 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-ff2b69cf-a7f2-419b-8a7b-346773c3a9ae tempest-SnapshotDependencyTests-1568297841 None] Deleted volume successfully. Jul 22 03:26:24 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-ff2b69cf-a7f2-419b-8a7b-346773c3a9ae tempest-SnapshotDependencyTests-1568297841 None] Lock "cinder-6757f563-ebbe-4dd0-893a-07443ebc0172-delete_volume" released by "delete_volume" :: held 1.523s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:26:25 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9a7aa11-d3c5-4636-8725-05b76d3a43b3 tempest-TestServerVolumeAttachmentScenario-1465609169 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:26:25 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f9a7aa11-d3c5-4636-8725-05b76d3a43b3 tempest-TestServerVolumeAttachmentScenario-1465609169 None] Flow 'volume_create_manager' (f1c9ab64-9c18-4c6a-bc7f-9d573c957e01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:26:25 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f9a7aa11-d3c5-4636-8725-05b76d3a43b3 tempest-TestServerVolumeAttachmentScenario-1465609169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6ee4533-6163-4b37-bbcb-7b6228d3de7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:26:25 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f9a7aa11-d3c5-4636-8725-05b76d3a43b3 tempest-TestServerVolumeAttachmentScenario-1465609169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6ee4533-6163-4b37-bbcb-7b6228d3de7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:26:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-232175391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5975d9e9-d185-45d1-85a0-986075d69208,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b662097bbb624c87b93e12f4bed04824',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:26:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:26:26Z,use_quota=True,user_id='8b308b21a09640a58dc882b753a84638',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:26:25 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f9a7aa11-d3c5-4636-8725-05b76d3a43b3 tempest-TestServerVolumeAttachmentScenario-1465609169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e69bd7b-a657-439d-8df9-268abf36771c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:26:25 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f9a7aa11-d3c5-4636-8725-05b76d3a43b3 tempest-TestServerVolumeAttachmentScenario-1465609169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e69bd7b-a657-439d-8df9-268abf36771c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:26:25 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f9a7aa11-d3c5-4636-8725-05b76d3a43b3 tempest-TestServerVolumeAttachmentScenario-1465609169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (036fe94c-a1db-4e9d-a55c-90c41ea8dcde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:26:25 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f9a7aa11-d3c5-4636-8725-05b76d3a43b3 tempest-TestServerVolumeAttachmentScenario-1465609169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (036fe94c-a1db-4e9d-a55c-90c41ea8dcde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5975d9e9-d185-45d1-85a0-986075d69208', 'volume_name': 'volume-5975d9e9-d185-45d1-85a0-986075d69208', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:26:25 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f9a7aa11-d3c5-4636-8725-05b76d3a43b3 tempest-TestServerVolumeAttachmentScenario-1465609169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21427ccd-523c-44fc-b8a8-ae187dff9b13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:26:25 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f9a7aa11-d3c5-4636-8725-05b76d3a43b3 tempest-TestServerVolumeAttachmentScenario-1465609169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21427ccd-523c-44fc-b8a8-ae187dff9b13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:26:25 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f9a7aa11-d3c5-4636-8725-05b76d3a43b3 tempest-TestServerVolumeAttachmentScenario-1465609169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38d78d36-1360-450b-aabd-eae26f3814e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:26:25 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-f9a7aa11-d3c5-4636-8725-05b76d3a43b3 tempest-TestServerVolumeAttachmentScenario-1465609169 None] Volume 5975d9e9-d185-45d1-85a0-986075d69208: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5975d9e9-d185-45d1-85a0-986075d69208', 'volume_size': 1} Jul 22 03:26:25 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-f9a7aa11-d3c5-4636-8725-05b76d3a43b3 tempest-TestServerVolumeAttachmentScenario-1465609169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:26:25 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-f9a7aa11-d3c5-4636-8725-05b76d3a43b3 tempest-TestServerVolumeAttachmentScenario-1465609169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:26:25 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-f9a7aa11-d3c5-4636-8725-05b76d3a43b3 tempest-TestServerVolumeAttachmentScenario-1465609169 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:26:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-232175391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5975d9e9-d185-45d1-85a0-986075d69208,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b662097bbb624c87b93e12f4bed04824',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:26:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:26:26Z,use_quota=True,user_id='8b308b21a09640a58dc882b753a84638',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:26:25 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-f9a7aa11-d3c5-4636-8725-05b76d3a43b3 tempest-TestServerVolumeAttachmentScenario-1465609169 None] Creating volume 5975d9e9-d185-45d1-85a0-986075d69208 {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:26:25 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-f9a7aa11-d3c5-4636-8725-05b76d3a43b3 tempest-TestServerVolumeAttachmentScenario-1465609169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:26:25 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-f9a7aa11-d3c5-4636-8725-05b76d3a43b3 tempest-TestServerVolumeAttachmentScenario-1465609169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:26:25 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-f9a7aa11-d3c5-4636-8725-05b76d3a43b3 tempest-TestServerVolumeAttachmentScenario-1465609169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:26:25 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-f9a7aa11-d3c5-4636-8725-05b76d3a43b3 tempest-TestServerVolumeAttachmentScenario-1465609169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:26:25 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-f9a7aa11-d3c5-4636-8725-05b76d3a43b3 tempest-TestServerVolumeAttachmentScenario-1465609169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:26:25 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-f9a7aa11-d3c5-4636-8725-05b76d3a43b3 tempest-TestServerVolumeAttachmentScenario-1465609169 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:26:25 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-f9a7aa11-d3c5-4636-8725-05b76d3a43b3 tempest-TestServerVolumeAttachmentScenario-1465609169 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:26:25 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f9a7aa11-d3c5-4636-8725-05b76d3a43b3 tempest-TestServerVolumeAttachmentScenario-1465609169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-5975d9e9-d185-45d1-85a0-986075d69208 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:26:25 devstack sudo[100275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-5975d9e9-d185-45d1-85a0-986075d69208 1073741824 Jul 22 03:26:25 devstack sudo[100275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:26:26 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-ade54e8a-7981-4d9f-b25c-272ee4bf50ef tempest-TestServerVolumeAttachmentScenario-1465609169 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:26:26 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-ade54e8a-7981-4d9f-b25c-272ee4bf50ef tempest-TestServerVolumeAttachmentScenario-1465609169 None] Flow 'volume_create_manager' (60b02cac-1fb0-4180-9998-acb3d351ead2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:26:26 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-ade54e8a-7981-4d9f-b25c-272ee4bf50ef tempest-TestServerVolumeAttachmentScenario-1465609169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b78ec5ba-1715-4ad5-9cae-2fc5d0610fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:26:26 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-ade54e8a-7981-4d9f-b25c-272ee4bf50ef tempest-TestServerVolumeAttachmentScenario-1465609169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b78ec5ba-1715-4ad5-9cae-2fc5d0610fce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:26:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-417516141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18d08f51-e187-4c3e-b66e-1eb402ce9fa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b662097bbb624c87b93e12f4bed04824',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:26:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:26:26Z,use_quota=True,user_id='8b308b21a09640a58dc882b753a84638',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:26:26 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-ade54e8a-7981-4d9f-b25c-272ee4bf50ef tempest-TestServerVolumeAttachmentScenario-1465609169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d875abcc-8dfa-47b6-8839-671f7db0f9c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:26:26 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-ade54e8a-7981-4d9f-b25c-272ee4bf50ef tempest-TestServerVolumeAttachmentScenario-1465609169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d875abcc-8dfa-47b6-8839-671f7db0f9c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:26:26 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-ade54e8a-7981-4d9f-b25c-272ee4bf50ef tempest-TestServerVolumeAttachmentScenario-1465609169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3bf6b51-69e3-40ab-9e4b-80657a24fdf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:26:26 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-ade54e8a-7981-4d9f-b25c-272ee4bf50ef tempest-TestServerVolumeAttachmentScenario-1465609169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3bf6b51-69e3-40ab-9e4b-80657a24fdf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18d08f51-e187-4c3e-b66e-1eb402ce9fa9', 'volume_name': 'volume-18d08f51-e187-4c3e-b66e-1eb402ce9fa9', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:26:26 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-ade54e8a-7981-4d9f-b25c-272ee4bf50ef tempest-TestServerVolumeAttachmentScenario-1465609169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ba8b738-9c55-4fb1-ae99-bf0f552e2047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:26:26 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-ade54e8a-7981-4d9f-b25c-272ee4bf50ef tempest-TestServerVolumeAttachmentScenario-1465609169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ba8b738-9c55-4fb1-ae99-bf0f552e2047) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:26:26 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-ade54e8a-7981-4d9f-b25c-272ee4bf50ef tempest-TestServerVolumeAttachmentScenario-1465609169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9472a42d-2914-420c-b15d-9a27c76d5703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:26:26 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-ade54e8a-7981-4d9f-b25c-272ee4bf50ef tempest-TestServerVolumeAttachmentScenario-1465609169 None] Volume 18d08f51-e187-4c3e-b66e-1eb402ce9fa9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18d08f51-e187-4c3e-b66e-1eb402ce9fa9', 'volume_size': 1} Jul 22 03:26:26 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-ade54e8a-7981-4d9f-b25c-272ee4bf50ef tempest-TestServerVolumeAttachmentScenario-1465609169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:26:26 devstack sudo[100275]: pam_unix(sudo:session): session closed for user root Jul 22 03:26:26 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f9a7aa11-d3c5-4636-8725-05b76d3a43b3 tempest-TestServerVolumeAttachmentScenario-1465609169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-5975d9e9-d185-45d1-85a0-986075d69208 1073741824" returned: 0 in 0.623s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:26:26 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f9a7aa11-d3c5-4636-8725-05b76d3a43b3 tempest-TestServerVolumeAttachmentScenario-1465609169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-5975d9e9-d185-45d1-85a0-986075d69208 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:26:26 devstack sudo[100281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-5975d9e9-d185-45d1-85a0-986075d69208 Jul 22 03:26:26 devstack sudo[100281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:26:26 devstack sudo[100281]: pam_unix(sudo:session): session closed for user root Jul 22 03:26:26 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f9a7aa11-d3c5-4636-8725-05b76d3a43b3 tempest-TestServerVolumeAttachmentScenario-1465609169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-5975d9e9-d185-45d1-85a0-986075d69208" returned: 0 in 0.297s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:26:26 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-f9a7aa11-d3c5-4636-8725-05b76d3a43b3 tempest-TestServerVolumeAttachmentScenario-1465609169 None] <== create_volume: return (994ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:26:26 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-f9a7aa11-d3c5-4636-8725-05b76d3a43b3 tempest-TestServerVolumeAttachmentScenario-1465609169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.997s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:26:26 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-ade54e8a-7981-4d9f-b25c-272ee4bf50ef tempest-TestServerVolumeAttachmentScenario-1465609169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.509s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:26:26 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-ade54e8a-7981-4d9f-b25c-272ee4bf50ef tempest-TestServerVolumeAttachmentScenario-1465609169 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:26:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-417516141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18d08f51-e187-4c3e-b66e-1eb402ce9fa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b662097bbb624c87b93e12f4bed04824',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:26:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:26:26Z,use_quota=True,user_id='8b308b21a09640a58dc882b753a84638',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:26:26 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-ade54e8a-7981-4d9f-b25c-272ee4bf50ef tempest-TestServerVolumeAttachmentScenario-1465609169 None] Creating volume 18d08f51-e187-4c3e-b66e-1eb402ce9fa9 {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:26:26 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-ade54e8a-7981-4d9f-b25c-272ee4bf50ef tempest-TestServerVolumeAttachmentScenario-1465609169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:26:26 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-ade54e8a-7981-4d9f-b25c-272ee4bf50ef tempest-TestServerVolumeAttachmentScenario-1465609169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:26:26 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-ade54e8a-7981-4d9f-b25c-272ee4bf50ef tempest-TestServerVolumeAttachmentScenario-1465609169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:26:26 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-ade54e8a-7981-4d9f-b25c-272ee4bf50ef tempest-TestServerVolumeAttachmentScenario-1465609169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:26:26 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-ade54e8a-7981-4d9f-b25c-272ee4bf50ef tempest-TestServerVolumeAttachmentScenario-1465609169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:26:26 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-ade54e8a-7981-4d9f-b25c-272ee4bf50ef tempest-TestServerVolumeAttachmentScenario-1465609169 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:26:26 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-ade54e8a-7981-4d9f-b25c-272ee4bf50ef tempest-TestServerVolumeAttachmentScenario-1465609169 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:26:26 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ade54e8a-7981-4d9f-b25c-272ee4bf50ef tempest-TestServerVolumeAttachmentScenario-1465609169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-18d08f51-e187-4c3e-b66e-1eb402ce9fa9 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:26:26 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f9a7aa11-d3c5-4636-8725-05b76d3a43b3 tempest-TestServerVolumeAttachmentScenario-1465609169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38d78d36-1360-450b-aabd-eae26f3814e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5975d9e9-d185-45d1-85a0-986075d69208', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:26:26 devstack sudo[100284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-18d08f51-e187-4c3e-b66e-1eb402ce9fa9 1073741824 Jul 22 03:26:26 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f9a7aa11-d3c5-4636-8725-05b76d3a43b3 tempest-TestServerVolumeAttachmentScenario-1465609169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f14c53d2-da3a-401a-8708-6326d119a79f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:26:26 devstack sudo[100284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:26:26 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-f9a7aa11-d3c5-4636-8725-05b76d3a43b3 tempest-TestServerVolumeAttachmentScenario-1465609169 None] Volume volume-5975d9e9-d185-45d1-85a0-986075d69208 (5975d9e9-d185-45d1-85a0-986075d69208): created successfully Jul 22 03:26:26 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f9a7aa11-d3c5-4636-8725-05b76d3a43b3 tempest-TestServerVolumeAttachmentScenario-1465609169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f14c53d2-da3a-401a-8708-6326d119a79f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:26:26 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f9a7aa11-d3c5-4636-8725-05b76d3a43b3 tempest-TestServerVolumeAttachmentScenario-1465609169 None] Flow 'volume_create_manager' (f1c9ab64-9c18-4c6a-bc7f-9d573c957e01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:26:26 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-f9a7aa11-d3c5-4636-8725-05b76d3a43b3 tempest-TestServerVolumeAttachmentScenario-1465609169 None] Created volume successfully. Jul 22 03:26:27 devstack sudo[100284]: pam_unix(sudo:session): session closed for user root Jul 22 03:26:27 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ade54e8a-7981-4d9f-b25c-272ee4bf50ef tempest-TestServerVolumeAttachmentScenario-1465609169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-18d08f51-e187-4c3e-b66e-1eb402ce9fa9 1073741824" returned: 0 in 0.553s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:26:27 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ade54e8a-7981-4d9f-b25c-272ee4bf50ef tempest-TestServerVolumeAttachmentScenario-1465609169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-18d08f51-e187-4c3e-b66e-1eb402ce9fa9 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:26:27 devstack sudo[100290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-18d08f51-e187-4c3e-b66e-1eb402ce9fa9 Jul 22 03:26:27 devstack sudo[100290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:26:27 devstack sudo[100290]: pam_unix(sudo:session): session closed for user root Jul 22 03:26:27 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ade54e8a-7981-4d9f-b25c-272ee4bf50ef tempest-TestServerVolumeAttachmentScenario-1465609169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-18d08f51-e187-4c3e-b66e-1eb402ce9fa9" returned: 0 in 0.258s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:26:27 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-ade54e8a-7981-4d9f-b25c-272ee4bf50ef tempest-TestServerVolumeAttachmentScenario-1465609169 None] <== create_volume: return (875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:26:27 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-ade54e8a-7981-4d9f-b25c-272ee4bf50ef tempest-TestServerVolumeAttachmentScenario-1465609169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:26:27 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-ade54e8a-7981-4d9f-b25c-272ee4bf50ef tempest-TestServerVolumeAttachmentScenario-1465609169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9472a42d-2914-420c-b15d-9a27c76d5703) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18d08f51-e187-4c3e-b66e-1eb402ce9fa9', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:26:27 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-ade54e8a-7981-4d9f-b25c-272ee4bf50ef tempest-TestServerVolumeAttachmentScenario-1465609169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c899bfba-6660-43a2-912d-a8115c6981fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:26:27 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-ade54e8a-7981-4d9f-b25c-272ee4bf50ef tempest-TestServerVolumeAttachmentScenario-1465609169 None] Volume volume-18d08f51-e187-4c3e-b66e-1eb402ce9fa9 (18d08f51-e187-4c3e-b66e-1eb402ce9fa9): created successfully Jul 22 03:26:27 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-ade54e8a-7981-4d9f-b25c-272ee4bf50ef tempest-TestServerVolumeAttachmentScenario-1465609169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c899bfba-6660-43a2-912d-a8115c6981fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:26:27 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-ade54e8a-7981-4d9f-b25c-272ee4bf50ef tempest-TestServerVolumeAttachmentScenario-1465609169 None] Flow 'volume_create_manager' (60b02cac-1fb0-4180-9998-acb3d351ead2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:26:27 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-ade54e8a-7981-4d9f-b25c-272ee4bf50ef tempest-TestServerVolumeAttachmentScenario-1465609169 None] Created volume successfully. Jul 22 03:26:37 devstack cinder-volume[87747]: DEBUG dbcounter [-] [87747] Writing DB stats cinder:UPDATE=49,cinder:SELECT=34,cinder:INSERT=13,cinder:DELETE=5 {{(pid=87747) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 03:26:37 devstack cinder-volume[87747]: DEBUG dbcounter [-] [87747] Writing DB stats cinder:SELECT=35,cinder:UPDATE=41,cinder:DELETE=4,cinder:INSERT=8 {{(pid=87747) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 03:26:55 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-87d51209-ce40-4658-b2f9-8d2b07b48b3a tempest-VolumesActionsTest-656298785 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:26:55 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-87d51209-ce40-4658-b2f9-8d2b07b48b3a tempest-VolumesActionsTest-656298785 None] Flow 'volume_create_manager' (9b4be63b-7dd0-4fff-8741-8b667c8e815a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:26:55 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-87d51209-ce40-4658-b2f9-8d2b07b48b3a tempest-VolumesActionsTest-656298785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6df839d-3b92-4ba7-81c7-8bb5e61fb0ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:26:55 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-87d51209-ce40-4658-b2f9-8d2b07b48b3a tempest-VolumesActionsTest-656298785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6df839d-3b92-4ba7-81c7-8bb5e61fb0ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:26:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1265458937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34a03c97-7b3b-46ac-857d-6f29b34c09fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1212ef82936743398cd7bb66d6b2912b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:26:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:26:55Z,use_quota=True,user_id='a8e79ab5fe9d4cc6a32ae6695ec76c83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:26:55 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-87d51209-ce40-4658-b2f9-8d2b07b48b3a tempest-VolumesActionsTest-656298785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d826a5b-59c6-4039-8273-1649deaac8a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:26:55 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-87d51209-ce40-4658-b2f9-8d2b07b48b3a tempest-VolumesActionsTest-656298785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d826a5b-59c6-4039-8273-1649deaac8a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:26:55 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-87d51209-ce40-4658-b2f9-8d2b07b48b3a tempest-VolumesActionsTest-656298785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (357232e3-24b5-4402-be56-54f7d90c2b96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:26:55 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-87d51209-ce40-4658-b2f9-8d2b07b48b3a tempest-VolumesActionsTest-656298785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (357232e3-24b5-4402-be56-54f7d90c2b96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34a03c97-7b3b-46ac-857d-6f29b34c09fb', 'volume_name': 'volume-34a03c97-7b3b-46ac-857d-6f29b34c09fb', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:26:55 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-87d51209-ce40-4658-b2f9-8d2b07b48b3a tempest-VolumesActionsTest-656298785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34c85189-8dc8-4280-a87f-0cfa23081404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:26:55 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-87d51209-ce40-4658-b2f9-8d2b07b48b3a tempest-VolumesActionsTest-656298785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34c85189-8dc8-4280-a87f-0cfa23081404) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:26:55 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-87d51209-ce40-4658-b2f9-8d2b07b48b3a tempest-VolumesActionsTest-656298785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a23af265-3062-4141-91b3-e0546c678b5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:26:55 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-87d51209-ce40-4658-b2f9-8d2b07b48b3a tempest-VolumesActionsTest-656298785 None] Volume 34a03c97-7b3b-46ac-857d-6f29b34c09fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34a03c97-7b3b-46ac-857d-6f29b34c09fb', 'volume_size': 1} Jul 22 03:26:55 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-87d51209-ce40-4658-b2f9-8d2b07b48b3a tempest-VolumesActionsTest-656298785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:26:55 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-87d51209-ce40-4658-b2f9-8d2b07b48b3a tempest-VolumesActionsTest-656298785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:26:55 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-87d51209-ce40-4658-b2f9-8d2b07b48b3a tempest-VolumesActionsTest-656298785 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:26:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1265458937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34a03c97-7b3b-46ac-857d-6f29b34c09fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1212ef82936743398cd7bb66d6b2912b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:26:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:26:55Z,use_quota=True,user_id='a8e79ab5fe9d4cc6a32ae6695ec76c83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:26:55 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-87d51209-ce40-4658-b2f9-8d2b07b48b3a tempest-VolumesActionsTest-656298785 None] Creating volume 34a03c97-7b3b-46ac-857d-6f29b34c09fb {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:26:55 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-87d51209-ce40-4658-b2f9-8d2b07b48b3a tempest-VolumesActionsTest-656298785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:26:55 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-87d51209-ce40-4658-b2f9-8d2b07b48b3a tempest-VolumesActionsTest-656298785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:26:55 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-87d51209-ce40-4658-b2f9-8d2b07b48b3a tempest-VolumesActionsTest-656298785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:26:55 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-87d51209-ce40-4658-b2f9-8d2b07b48b3a tempest-VolumesActionsTest-656298785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:26:55 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-87d51209-ce40-4658-b2f9-8d2b07b48b3a tempest-VolumesActionsTest-656298785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:26:55 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-87d51209-ce40-4658-b2f9-8d2b07b48b3a tempest-VolumesActionsTest-656298785 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:26:55 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-87d51209-ce40-4658-b2f9-8d2b07b48b3a tempest-VolumesActionsTest-656298785 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:26:55 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-87d51209-ce40-4658-b2f9-8d2b07b48b3a tempest-VolumesActionsTest-656298785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-34a03c97-7b3b-46ac-857d-6f29b34c09fb 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:26:55 devstack sudo[100520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-34a03c97-7b3b-46ac-857d-6f29b34c09fb 1073741824 Jul 22 03:26:55 devstack sudo[100520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:26:56 devstack sudo[100520]: pam_unix(sudo:session): session closed for user root Jul 22 03:26:56 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-87d51209-ce40-4658-b2f9-8d2b07b48b3a tempest-VolumesActionsTest-656298785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-34a03c97-7b3b-46ac-857d-6f29b34c09fb 1073741824" returned: 0 in 0.431s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:26:56 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-87d51209-ce40-4658-b2f9-8d2b07b48b3a tempest-VolumesActionsTest-656298785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-34a03c97-7b3b-46ac-857d-6f29b34c09fb {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:26:56 devstack sudo[100546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-34a03c97-7b3b-46ac-857d-6f29b34c09fb Jul 22 03:26:56 devstack sudo[100546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:26:56 devstack sudo[100546]: pam_unix(sudo:session): session closed for user root Jul 22 03:26:56 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-87d51209-ce40-4658-b2f9-8d2b07b48b3a tempest-VolumesActionsTest-656298785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-34a03c97-7b3b-46ac-857d-6f29b34c09fb" returned: 0 in 0.262s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:26:56 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-87d51209-ce40-4658-b2f9-8d2b07b48b3a tempest-VolumesActionsTest-656298785 None] <== create_volume: return (741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:26:56 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-87d51209-ce40-4658-b2f9-8d2b07b48b3a tempest-VolumesActionsTest-656298785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.743s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:26:56 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-87d51209-ce40-4658-b2f9-8d2b07b48b3a tempest-VolumesActionsTest-656298785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a23af265-3062-4141-91b3-e0546c678b5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34a03c97-7b3b-46ac-857d-6f29b34c09fb', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:26:56 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-87d51209-ce40-4658-b2f9-8d2b07b48b3a tempest-VolumesActionsTest-656298785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fec7d0b-a9e4-47f0-b1bd-4c5093008a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:26:56 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-87d51209-ce40-4658-b2f9-8d2b07b48b3a tempest-VolumesActionsTest-656298785 None] Volume volume-34a03c97-7b3b-46ac-857d-6f29b34c09fb (34a03c97-7b3b-46ac-857d-6f29b34c09fb): created successfully Jul 22 03:26:56 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-87d51209-ce40-4658-b2f9-8d2b07b48b3a tempest-VolumesActionsTest-656298785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fec7d0b-a9e4-47f0-b1bd-4c5093008a8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:26:56 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-87d51209-ce40-4658-b2f9-8d2b07b48b3a tempest-VolumesActionsTest-656298785 None] Flow 'volume_create_manager' (9b4be63b-7dd0-4fff-8741-8b667c8e815a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:26:56 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-87d51209-ce40-4658-b2f9-8d2b07b48b3a tempest-VolumesActionsTest-656298785 None] Created volume successfully. Jul 22 03:26:56 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-8f962031-04f0-4dce-97a5-79340391123b tempest-VolumesActionsTest-656298785 None] Acquiring lock "cinder-34a03c97-7b3b-46ac-857d-6f29b34c09fb" by "attach_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:26:56 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-8f962031-04f0-4dce-97a5-79340391123b tempest-VolumesActionsTest-656298785 None] Lock "cinder-34a03c97-7b3b-46ac-857d-6f29b34c09fb" acquired by "attach_volume" :: waited 0.018s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:26:56 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-8f962031-04f0-4dce-97a5-79340391123b tempest-VolumesActionsTest-656298785 None] Attaching volume 34a03c97-7b3b-46ac-857d-6f29b34c09fb to instance 034fcef8-bfc5-4baa-9a5e-a5071be866b7 at mountpoint /dev/vdb on host None. Jul 22 03:26:56 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-8f962031-04f0-4dce-97a5-79340391123b tempest-VolumesActionsTest-656298785 None] Attach volume completed successfully. Jul 22 03:26:56 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-8f962031-04f0-4dce-97a5-79340391123b tempest-VolumesActionsTest-656298785 None] Lock "cinder-34a03c97-7b3b-46ac-857d-6f29b34c09fb" released by "attach_volume" :: held 0.084s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:26:57 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-48e83600-23f5-4ccd-a361-cdc1f14d154a tempest-VolumesActionsTest-401209762 None] Terminate volume connection completed successfully. Jul 22 03:26:57 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-48e83600-23f5-4ccd-a361-cdc1f14d154a tempest-VolumesActionsTest-401209762 None] Acquiring lock "cinder-34a03c97-7b3b-46ac-857d-6f29b34c09fb-detach_volume" by "detach_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:26:57 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-48e83600-23f5-4ccd-a361-cdc1f14d154a tempest-VolumesActionsTest-401209762 None] Lock "cinder-34a03c97-7b3b-46ac-857d-6f29b34c09fb-detach_volume" acquired by "detach_volume" :: waited 0.015s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:26:57 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-48e83600-23f5-4ccd-a361-cdc1f14d154a tempest-VolumesActionsTest-401209762 None] Detaching volume 34a03c97-7b3b-46ac-857d-6f29b34c09fb from instance 034fcef8-bfc5-4baa-9a5e-a5071be866b7. Jul 22 03:26:57 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-48e83600-23f5-4ccd-a361-cdc1f14d154a tempest-VolumesActionsTest-401209762 None] Detach volume completed successfully. Jul 22 03:26:57 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-48e83600-23f5-4ccd-a361-cdc1f14d154a tempest-VolumesActionsTest-401209762 None] Lock "cinder-34a03c97-7b3b-46ac-857d-6f29b34c09fb-detach_volume" released by "detach_volume" :: held 0.066s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:26:57 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-4edc003c-0a10-4922-ad53-3f523a89b4b0 tempest-VolumesActionsTest-656298785 None] Acquiring lock "cinder-34a03c97-7b3b-46ac-857d-6f29b34c09fb-detach_volume" by "detach_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:26:57 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-4edc003c-0a10-4922-ad53-3f523a89b4b0 tempest-VolumesActionsTest-656298785 None] Lock "cinder-34a03c97-7b3b-46ac-857d-6f29b34c09fb-detach_volume" acquired by "detach_volume" :: waited 0.022s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:26:57 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-4edc003c-0a10-4922-ad53-3f523a89b4b0 tempest-VolumesActionsTest-656298785 None] Volume detach called, but volume not attached. Jul 22 03:26:57 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-4edc003c-0a10-4922-ad53-3f523a89b4b0 tempest-VolumesActionsTest-656298785 None] Lock "cinder-34a03c97-7b3b-46ac-857d-6f29b34c09fb-detach_volume" released by "detach_volume" :: held 0.016s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:26:57 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-47dec8d1-275e-4ddc-9303-47e0ad09edbb tempest-VolumesActionsTest-656298785 None] Acquiring lock "cinder-34a03c97-7b3b-46ac-857d-6f29b34c09fb-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:26:57 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-47dec8d1-275e-4ddc-9303-47e0ad09edbb tempest-VolumesActionsTest-656298785 None] Lock "cinder-34a03c97-7b3b-46ac-857d-6f29b34c09fb-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:26:57 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-47dec8d1-275e-4ddc-9303-47e0ad09edbb tempest-VolumesActionsTest-656298785 None] Acquiring lock "cinder-quobyte-34a03c97-7b3b-46ac-857d-6f29b34c09fb" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:26:57 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-47dec8d1-275e-4ddc-9303-47e0ad09edbb tempest-VolumesActionsTest-656298785 None] Lock "cinder-quobyte-34a03c97-7b3b-46ac-857d-6f29b34c09fb" acquired by "delete_volume" :: waited 0.018s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:26:57 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[847046ad-0d17-4f1a-a2f3-f4bc3fd092fa]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:26:57 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-47dec8d1-275e-4ddc-9303-47e0ad09edbb tempest-VolumesActionsTest-656298785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-34a03c97-7b3b-46ac-857d-6f29b34c09fb {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:26:57 devstack sudo[100549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-34a03c97-7b3b-46ac-857d-6f29b34c09fb Jul 22 03:26:57 devstack sudo[100549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:26:58 devstack sudo[100549]: pam_unix(sudo:session): session closed for user root Jul 22 03:26:58 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-47dec8d1-275e-4ddc-9303-47e0ad09edbb tempest-VolumesActionsTest-656298785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-34a03c97-7b3b-46ac-857d-6f29b34c09fb" returned: 0 in 0.358s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:26:58 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-47dec8d1-275e-4ddc-9303-47e0ad09edbb tempest-VolumesActionsTest-656298785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-34a03c97-7b3b-46ac-857d-6f29b34c09fb {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:26:58 devstack sudo[100554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-34a03c97-7b3b-46ac-857d-6f29b34c09fb Jul 22 03:26:58 devstack sudo[100554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:26:58 devstack sudo[100554]: pam_unix(sudo:session): session closed for user root Jul 22 03:26:58 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-47dec8d1-275e-4ddc-9303-47e0ad09edbb tempest-VolumesActionsTest-656298785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-34a03c97-7b3b-46ac-857d-6f29b34c09fb" returned: 0 in 0.250s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:26:58 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-47dec8d1-275e-4ddc-9303-47e0ad09edbb tempest-VolumesActionsTest-656298785 None] Lock "cinder-quobyte-34a03c97-7b3b-46ac-857d-6f29b34c09fb" released by "delete_volume" :: held 0.651s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:26:58 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-47dec8d1-275e-4ddc-9303-47e0ad09edbb tempest-VolumesActionsTest-656298785 None] Created reservations ['a9c68b3b-f0e4-4b29-9b72-ce3d51b4deaa', '34b74177-4a45-4973-b749-63a2ef0a5b94', '5532ca26-f237-4735-92ce-5324515d95b5', 'a584e7fb-f561-4ca3-8497-d97b69916dc4'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:26:58 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-47dec8d1-275e-4ddc-9303-47e0ad09edbb tempest-VolumesActionsTest-656298785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:26:58 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-47dec8d1-275e-4ddc-9303-47e0ad09edbb tempest-VolumesActionsTest-656298785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:26:58 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-47dec8d1-275e-4ddc-9303-47e0ad09edbb tempest-VolumesActionsTest-656298785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:26:58 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-47dec8d1-275e-4ddc-9303-47e0ad09edbb tempest-VolumesActionsTest-656298785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:26:58 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-47dec8d1-275e-4ddc-9303-47e0ad09edbb tempest-VolumesActionsTest-656298785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:26:58 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-47dec8d1-275e-4ddc-9303-47e0ad09edbb tempest-VolumesActionsTest-656298785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:26:58 devstack sudo[100557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:26:58 devstack sudo[100557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:26:58 devstack sudo[100557]: pam_unix(sudo:session): session closed for user root Jul 22 03:26:58 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-47dec8d1-275e-4ddc-9303-47e0ad09edbb tempest-VolumesActionsTest-656298785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.248s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:26:58 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-47dec8d1-275e-4ddc-9303-47e0ad09edbb tempest-VolumesActionsTest-656298785 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:26:58 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-47dec8d1-275e-4ddc-9303-47e0ad09edbb tempest-VolumesActionsTest-656298785 None] Deleted volume successfully. Jul 22 03:26:58 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-47dec8d1-275e-4ddc-9303-47e0ad09edbb tempest-VolumesActionsTest-656298785 None] Lock "cinder-34a03c97-7b3b-46ac-857d-6f29b34c09fb-delete_volume" released by "delete_volume" :: held 1.122s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:27:01 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-538196f7-d153-4731-9f91-1c5142ebd576 tempest-VolumesActionsTest-656298785 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:27:01 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-538196f7-d153-4731-9f91-1c5142ebd576 tempest-VolumesActionsTest-656298785 None] Flow 'volume_create_manager' (6a126ba3-7223-4e89-9568-685154514536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:27:01 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-538196f7-d153-4731-9f91-1c5142ebd576 tempest-VolumesActionsTest-656298785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85fc3589-a101-45a8-8790-55c9ce32f3a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:01 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-538196f7-d153-4731-9f91-1c5142ebd576 tempest-VolumesActionsTest-656298785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85fc3589-a101-45a8-8790-55c9ce32f3a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:27:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1586819041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b778a4f-4898-4628-be98-d1e880d920bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1212ef82936743398cd7bb66d6b2912b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:27:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:27:02Z,use_quota=True,user_id='a8e79ab5fe9d4cc6a32ae6695ec76c83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:01 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-538196f7-d153-4731-9f91-1c5142ebd576 tempest-VolumesActionsTest-656298785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dac095a-cc97-428d-9a34-11b6cee88054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:01 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-538196f7-d153-4731-9f91-1c5142ebd576 tempest-VolumesActionsTest-656298785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dac095a-cc97-428d-9a34-11b6cee88054) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:01 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-538196f7-d153-4731-9f91-1c5142ebd576 tempest-VolumesActionsTest-656298785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3205b871-edc8-4d72-bd6a-99c6a0d50234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:01 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-538196f7-d153-4731-9f91-1c5142ebd576 tempest-VolumesActionsTest-656298785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3205b871-edc8-4d72-bd6a-99c6a0d50234) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b778a4f-4898-4628-be98-d1e880d920bf', 'volume_name': 'volume-6b778a4f-4898-4628-be98-d1e880d920bf', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:01 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-538196f7-d153-4731-9f91-1c5142ebd576 tempest-VolumesActionsTest-656298785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f878e2c-cc8a-49e2-a9ee-c028c3818835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:01 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-538196f7-d153-4731-9f91-1c5142ebd576 tempest-VolumesActionsTest-656298785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f878e2c-cc8a-49e2-a9ee-c028c3818835) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:01 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-538196f7-d153-4731-9f91-1c5142ebd576 tempest-VolumesActionsTest-656298785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3a6a64d-7334-4d50-99bf-d0ec0e492577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:01 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-538196f7-d153-4731-9f91-1c5142ebd576 tempest-VolumesActionsTest-656298785 None] Volume 6b778a4f-4898-4628-be98-d1e880d920bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b778a4f-4898-4628-be98-d1e880d920bf', 'volume_size': 1} Jul 22 03:27:01 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-538196f7-d153-4731-9f91-1c5142ebd576 tempest-VolumesActionsTest-656298785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:27:01 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-538196f7-d153-4731-9f91-1c5142ebd576 tempest-VolumesActionsTest-656298785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:27:01 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-538196f7-d153-4731-9f91-1c5142ebd576 tempest-VolumesActionsTest-656298785 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:27:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1586819041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b778a4f-4898-4628-be98-d1e880d920bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1212ef82936743398cd7bb66d6b2912b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:27:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:27:02Z,use_quota=True,user_id='a8e79ab5fe9d4cc6a32ae6695ec76c83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:27:01 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-538196f7-d153-4731-9f91-1c5142ebd576 tempest-VolumesActionsTest-656298785 None] Creating volume 6b778a4f-4898-4628-be98-d1e880d920bf {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:27:01 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-538196f7-d153-4731-9f91-1c5142ebd576 tempest-VolumesActionsTest-656298785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:27:01 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-538196f7-d153-4731-9f91-1c5142ebd576 tempest-VolumesActionsTest-656298785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:27:01 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-538196f7-d153-4731-9f91-1c5142ebd576 tempest-VolumesActionsTest-656298785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:27:01 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-538196f7-d153-4731-9f91-1c5142ebd576 tempest-VolumesActionsTest-656298785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:27:01 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-538196f7-d153-4731-9f91-1c5142ebd576 tempest-VolumesActionsTest-656298785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:27:01 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-538196f7-d153-4731-9f91-1c5142ebd576 tempest-VolumesActionsTest-656298785 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:27:01 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-538196f7-d153-4731-9f91-1c5142ebd576 tempest-VolumesActionsTest-656298785 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:27:01 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-538196f7-d153-4731-9f91-1c5142ebd576 tempest-VolumesActionsTest-656298785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-6b778a4f-4898-4628-be98-d1e880d920bf 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:02 devstack sudo[100586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-6b778a4f-4898-4628-be98-d1e880d920bf 1073741824 Jul 22 03:27:02 devstack sudo[100586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:02 devstack sudo[100586]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:02 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-538196f7-d153-4731-9f91-1c5142ebd576 tempest-VolumesActionsTest-656298785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-6b778a4f-4898-4628-be98-d1e880d920bf 1073741824" returned: 0 in 0.421s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:02 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-538196f7-d153-4731-9f91-1c5142ebd576 tempest-VolumesActionsTest-656298785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-6b778a4f-4898-4628-be98-d1e880d920bf {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:02 devstack sudo[100591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-6b778a4f-4898-4628-be98-d1e880d920bf Jul 22 03:27:02 devstack sudo[100591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:02 devstack sudo[100591]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:02 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-538196f7-d153-4731-9f91-1c5142ebd576 tempest-VolumesActionsTest-656298785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-6b778a4f-4898-4628-be98-d1e880d920bf" returned: 0 in 0.241s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:02 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-538196f7-d153-4731-9f91-1c5142ebd576 tempest-VolumesActionsTest-656298785 None] <== create_volume: return (703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:27:02 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-538196f7-d153-4731-9f91-1c5142ebd576 tempest-VolumesActionsTest-656298785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.705s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:27:02 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-538196f7-d153-4731-9f91-1c5142ebd576 tempest-VolumesActionsTest-656298785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3a6a64d-7334-4d50-99bf-d0ec0e492577) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b778a4f-4898-4628-be98-d1e880d920bf', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:02 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-538196f7-d153-4731-9f91-1c5142ebd576 tempest-VolumesActionsTest-656298785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82269e85-f81a-4f70-a49c-10cd42ada8c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:02 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-538196f7-d153-4731-9f91-1c5142ebd576 tempest-VolumesActionsTest-656298785 None] Volume volume-6b778a4f-4898-4628-be98-d1e880d920bf (6b778a4f-4898-4628-be98-d1e880d920bf): created successfully Jul 22 03:27:02 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-538196f7-d153-4731-9f91-1c5142ebd576 tempest-VolumesActionsTest-656298785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82269e85-f81a-4f70-a49c-10cd42ada8c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:02 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-538196f7-d153-4731-9f91-1c5142ebd576 tempest-VolumesActionsTest-656298785 None] Flow 'volume_create_manager' (6a126ba3-7223-4e89-9568-685154514536) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:27:02 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-538196f7-d153-4731-9f91-1c5142ebd576 tempest-VolumesActionsTest-656298785 None] Created volume successfully. Jul 22 03:27:03 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-db1ea088-8fd0-4884-a66b-f6c8744c4532 tempest-VolumesActionsTest-401209762 None] Acquiring lock "cinder-6b778a4f-4898-4628-be98-d1e880d920bf-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:27:03 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-db1ea088-8fd0-4884-a66b-f6c8744c4532 tempest-VolumesActionsTest-401209762 None] Lock "cinder-6b778a4f-4898-4628-be98-d1e880d920bf-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:27:03 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-db1ea088-8fd0-4884-a66b-f6c8744c4532 tempest-VolumesActionsTest-401209762 None] Acquiring lock "cinder-quobyte-6b778a4f-4898-4628-be98-d1e880d920bf" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:27:03 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-db1ea088-8fd0-4884-a66b-f6c8744c4532 tempest-VolumesActionsTest-401209762 None] Lock "cinder-quobyte-6b778a4f-4898-4628-be98-d1e880d920bf" acquired by "delete_volume" :: waited 0.015s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:27:03 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[86c0601e-1267-4e6a-9f0c-9ddaa2770de6]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:27:03 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-db1ea088-8fd0-4884-a66b-f6c8744c4532 tempest-VolumesActionsTest-401209762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-6b778a4f-4898-4628-be98-d1e880d920bf {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:03 devstack sudo[100595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-6b778a4f-4898-4628-be98-d1e880d920bf Jul 22 03:27:03 devstack sudo[100595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:03 devstack sudo[100595]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:03 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-db1ea088-8fd0-4884-a66b-f6c8744c4532 tempest-VolumesActionsTest-401209762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-6b778a4f-4898-4628-be98-d1e880d920bf" returned: 0 in 0.393s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:03 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-db1ea088-8fd0-4884-a66b-f6c8744c4532 tempest-VolumesActionsTest-401209762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-6b778a4f-4898-4628-be98-d1e880d920bf {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:03 devstack sudo[100600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-6b778a4f-4898-4628-be98-d1e880d920bf Jul 22 03:27:03 devstack sudo[100600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:03 devstack sudo[100600]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:03 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-db1ea088-8fd0-4884-a66b-f6c8744c4532 tempest-VolumesActionsTest-401209762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-6b778a4f-4898-4628-be98-d1e880d920bf" returned: 0 in 0.253s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:03 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-db1ea088-8fd0-4884-a66b-f6c8744c4532 tempest-VolumesActionsTest-401209762 None] Lock "cinder-quobyte-6b778a4f-4898-4628-be98-d1e880d920bf" released by "delete_volume" :: held 0.693s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:27:03 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-db1ea088-8fd0-4884-a66b-f6c8744c4532 tempest-VolumesActionsTest-401209762 None] Created reservations ['53f8a3cd-a00a-4e7e-9671-8ce2c36dbcec', 'df04f087-07a1-45b4-a0c5-73e06d605db0', '985e92ec-5fc9-4735-af0e-902e80a0d7c6', 'de971a22-58a3-448e-841e-d100a381f802'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:27:03 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-db1ea088-8fd0-4884-a66b-f6c8744c4532 tempest-VolumesActionsTest-401209762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:27:03 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-db1ea088-8fd0-4884-a66b-f6c8744c4532 tempest-VolumesActionsTest-401209762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:27:03 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-db1ea088-8fd0-4884-a66b-f6c8744c4532 tempest-VolumesActionsTest-401209762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:27:03 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-db1ea088-8fd0-4884-a66b-f6c8744c4532 tempest-VolumesActionsTest-401209762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:27:03 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-db1ea088-8fd0-4884-a66b-f6c8744c4532 tempest-VolumesActionsTest-401209762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:27:03 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-db1ea088-8fd0-4884-a66b-f6c8744c4532 tempest-VolumesActionsTest-401209762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:03 devstack sudo[100603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:27:03 devstack sudo[100603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:04 devstack sudo[100603]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:04 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-db1ea088-8fd0-4884-a66b-f6c8744c4532 tempest-VolumesActionsTest-401209762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.251s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:04 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-db1ea088-8fd0-4884-a66b-f6c8744c4532 tempest-VolumesActionsTest-401209762 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:27:04 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-db1ea088-8fd0-4884-a66b-f6c8744c4532 tempest-VolumesActionsTest-401209762 None] Deleted volume successfully. Jul 22 03:27:04 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-db1ea088-8fd0-4884-a66b-f6c8744c4532 tempest-VolumesActionsTest-401209762 None] Lock "cinder-6b778a4f-4898-4628-be98-d1e880d920bf-delete_volume" released by "delete_volume" :: held 1.144s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:27:04 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cddaed2-5e68-4d78-942a-5c3440736213 tempest-VolumesActionsTest-656298785 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:27:04 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-1cddaed2-5e68-4d78-942a-5c3440736213 tempest-VolumesActionsTest-656298785 None] Flow 'volume_create_manager' (e5b5c143-e646-4ad7-8ea2-ee8f2c5afbe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:27:04 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-1cddaed2-5e68-4d78-942a-5c3440736213 tempest-VolumesActionsTest-656298785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f83dbca-8a5e-4c4c-b8f9-cd33f81c8fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:04 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-1cddaed2-5e68-4d78-942a-5c3440736213 tempest-VolumesActionsTest-656298785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f83dbca-8a5e-4c4c-b8f9-cd33f81c8fce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:27:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1700011737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21f474aa-2694-49f5-a5e8-d904bad4baff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1212ef82936743398cd7bb66d6b2912b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:27:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:27:05Z,use_quota=True,user_id='a8e79ab5fe9d4cc6a32ae6695ec76c83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:04 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-1cddaed2-5e68-4d78-942a-5c3440736213 tempest-VolumesActionsTest-656298785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b70c3f0c-2eb4-43a8-82fc-e76a44c1f11a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:04 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-1cddaed2-5e68-4d78-942a-5c3440736213 tempest-VolumesActionsTest-656298785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b70c3f0c-2eb4-43a8-82fc-e76a44c1f11a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:04 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-1cddaed2-5e68-4d78-942a-5c3440736213 tempest-VolumesActionsTest-656298785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca80f886-fd4d-456a-a1d7-19b7d8c1ee8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:04 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-1cddaed2-5e68-4d78-942a-5c3440736213 tempest-VolumesActionsTest-656298785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca80f886-fd4d-456a-a1d7-19b7d8c1ee8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21f474aa-2694-49f5-a5e8-d904bad4baff', 'volume_name': 'volume-21f474aa-2694-49f5-a5e8-d904bad4baff', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:04 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-1cddaed2-5e68-4d78-942a-5c3440736213 tempest-VolumesActionsTest-656298785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1f6e1ca-e999-41c8-b88e-36c0b9e50161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:04 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-1cddaed2-5e68-4d78-942a-5c3440736213 tempest-VolumesActionsTest-656298785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1f6e1ca-e999-41c8-b88e-36c0b9e50161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:04 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-1cddaed2-5e68-4d78-942a-5c3440736213 tempest-VolumesActionsTest-656298785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fa9053c-f682-4c41-9765-11726b4d3231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:04 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-1cddaed2-5e68-4d78-942a-5c3440736213 tempest-VolumesActionsTest-656298785 None] Volume 21f474aa-2694-49f5-a5e8-d904bad4baff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21f474aa-2694-49f5-a5e8-d904bad4baff', 'volume_size': 1} Jul 22 03:27:04 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-1cddaed2-5e68-4d78-942a-5c3440736213 tempest-VolumesActionsTest-656298785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:27:04 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-1cddaed2-5e68-4d78-942a-5c3440736213 tempest-VolumesActionsTest-656298785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:27:04 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-1cddaed2-5e68-4d78-942a-5c3440736213 tempest-VolumesActionsTest-656298785 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:27:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1700011737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21f474aa-2694-49f5-a5e8-d904bad4baff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1212ef82936743398cd7bb66d6b2912b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:27:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:27:05Z,use_quota=True,user_id='a8e79ab5fe9d4cc6a32ae6695ec76c83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:27:04 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-1cddaed2-5e68-4d78-942a-5c3440736213 tempest-VolumesActionsTest-656298785 None] Creating volume 21f474aa-2694-49f5-a5e8-d904bad4baff {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:27:04 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-1cddaed2-5e68-4d78-942a-5c3440736213 tempest-VolumesActionsTest-656298785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:27:04 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-1cddaed2-5e68-4d78-942a-5c3440736213 tempest-VolumesActionsTest-656298785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:27:04 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-1cddaed2-5e68-4d78-942a-5c3440736213 tempest-VolumesActionsTest-656298785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:27:04 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-1cddaed2-5e68-4d78-942a-5c3440736213 tempest-VolumesActionsTest-656298785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:27:04 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-1cddaed2-5e68-4d78-942a-5c3440736213 tempest-VolumesActionsTest-656298785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:27:04 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-1cddaed2-5e68-4d78-942a-5c3440736213 tempest-VolumesActionsTest-656298785 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:27:04 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-1cddaed2-5e68-4d78-942a-5c3440736213 tempest-VolumesActionsTest-656298785 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:27:04 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-1cddaed2-5e68-4d78-942a-5c3440736213 tempest-VolumesActionsTest-656298785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-21f474aa-2694-49f5-a5e8-d904bad4baff 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:04 devstack sudo[100606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-21f474aa-2694-49f5-a5e8-d904bad4baff 1073741824 Jul 22 03:27:04 devstack sudo[100606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:05 devstack sudo[100606]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:05 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-1cddaed2-5e68-4d78-942a-5c3440736213 tempest-VolumesActionsTest-656298785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-21f474aa-2694-49f5-a5e8-d904bad4baff 1073741824" returned: 0 in 0.393s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:05 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-1cddaed2-5e68-4d78-942a-5c3440736213 tempest-VolumesActionsTest-656298785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-21f474aa-2694-49f5-a5e8-d904bad4baff {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:05 devstack sudo[100611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-21f474aa-2694-49f5-a5e8-d904bad4baff Jul 22 03:27:05 devstack sudo[100611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:05 devstack sudo[100611]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:05 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-1cddaed2-5e68-4d78-942a-5c3440736213 tempest-VolumesActionsTest-656298785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-21f474aa-2694-49f5-a5e8-d904bad4baff" returned: 0 in 0.251s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:05 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-1cddaed2-5e68-4d78-942a-5c3440736213 tempest-VolumesActionsTest-656298785 None] <== create_volume: return (686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:27:05 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-1cddaed2-5e68-4d78-942a-5c3440736213 tempest-VolumesActionsTest-656298785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.688s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:27:05 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-1cddaed2-5e68-4d78-942a-5c3440736213 tempest-VolumesActionsTest-656298785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fa9053c-f682-4c41-9765-11726b4d3231) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21f474aa-2694-49f5-a5e8-d904bad4baff', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:05 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-1cddaed2-5e68-4d78-942a-5c3440736213 tempest-VolumesActionsTest-656298785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86a7c7d0-9875-44b0-a07b-92e8526f8728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:05 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-1cddaed2-5e68-4d78-942a-5c3440736213 tempest-VolumesActionsTest-656298785 None] Volume volume-21f474aa-2694-49f5-a5e8-d904bad4baff (21f474aa-2694-49f5-a5e8-d904bad4baff): created successfully Jul 22 03:27:05 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-1cddaed2-5e68-4d78-942a-5c3440736213 tempest-VolumesActionsTest-656298785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86a7c7d0-9875-44b0-a07b-92e8526f8728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:05 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-1cddaed2-5e68-4d78-942a-5c3440736213 tempest-VolumesActionsTest-656298785 None] Flow 'volume_create_manager' (e5b5c143-e646-4ad7-8ea2-ee8f2c5afbe1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:27:05 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-1cddaed2-5e68-4d78-942a-5c3440736213 tempest-VolumesActionsTest-656298785 None] Created volume successfully. Jul 22 03:27:05 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-423d77b5-b8f6-48ae-9b99-e418eb35697d tempest-VolumesActionsTest-401209762 None] Acquiring lock "cinder-21f474aa-2694-49f5-a5e8-d904bad4baff-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:27:05 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-423d77b5-b8f6-48ae-9b99-e418eb35697d tempest-VolumesActionsTest-401209762 None] Lock "cinder-21f474aa-2694-49f5-a5e8-d904bad4baff-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:27:05 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-423d77b5-b8f6-48ae-9b99-e418eb35697d tempest-VolumesActionsTest-401209762 None] Acquiring lock "cinder-quobyte-21f474aa-2694-49f5-a5e8-d904bad4baff" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:27:05 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-423d77b5-b8f6-48ae-9b99-e418eb35697d tempest-VolumesActionsTest-401209762 None] Lock "cinder-quobyte-21f474aa-2694-49f5-a5e8-d904bad4baff" acquired by "delete_volume" :: waited 0.022s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:27:05 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfa7b360-1782-41f3-bd3e-266c9ea7359d]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:27:05 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-423d77b5-b8f6-48ae-9b99-e418eb35697d tempest-VolumesActionsTest-401209762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-21f474aa-2694-49f5-a5e8-d904bad4baff {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:06 devstack sudo[100614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-21f474aa-2694-49f5-a5e8-d904bad4baff Jul 22 03:27:06 devstack sudo[100614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:06 devstack sudo[100614]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:06 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-423d77b5-b8f6-48ae-9b99-e418eb35697d tempest-VolumesActionsTest-401209762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-21f474aa-2694-49f5-a5e8-d904bad4baff" returned: 0 in 0.374s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:06 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-423d77b5-b8f6-48ae-9b99-e418eb35697d tempest-VolumesActionsTest-401209762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-21f474aa-2694-49f5-a5e8-d904bad4baff {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:06 devstack sudo[100621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-21f474aa-2694-49f5-a5e8-d904bad4baff Jul 22 03:27:06 devstack sudo[100621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:06 devstack sudo[100621]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:06 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-423d77b5-b8f6-48ae-9b99-e418eb35697d tempest-VolumesActionsTest-401209762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-21f474aa-2694-49f5-a5e8-d904bad4baff" returned: 0 in 0.275s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:06 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-423d77b5-b8f6-48ae-9b99-e418eb35697d tempest-VolumesActionsTest-401209762 None] Lock "cinder-quobyte-21f474aa-2694-49f5-a5e8-d904bad4baff" released by "delete_volume" :: held 0.692s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:27:06 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-423d77b5-b8f6-48ae-9b99-e418eb35697d tempest-VolumesActionsTest-401209762 None] Created reservations ['6f4e537b-3a91-4feb-8206-130aabdc3b87', 'cdb36328-a433-4608-9d9e-aaed07a08faa', 'd9ca18bf-55bc-4855-a9d6-6fd9f7e24e8f', '2a86993e-fce9-413d-8995-4fc709e3e2d7'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:27:06 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-423d77b5-b8f6-48ae-9b99-e418eb35697d tempest-VolumesActionsTest-401209762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:27:06 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-423d77b5-b8f6-48ae-9b99-e418eb35697d tempest-VolumesActionsTest-401209762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:27:06 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-423d77b5-b8f6-48ae-9b99-e418eb35697d tempest-VolumesActionsTest-401209762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:27:06 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-423d77b5-b8f6-48ae-9b99-e418eb35697d tempest-VolumesActionsTest-401209762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:27:06 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-423d77b5-b8f6-48ae-9b99-e418eb35697d tempest-VolumesActionsTest-401209762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:27:06 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-423d77b5-b8f6-48ae-9b99-e418eb35697d tempest-VolumesActionsTest-401209762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:06 devstack sudo[100624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:27:06 devstack sudo[100624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:07 devstack sudo[100624]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:07 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-423d77b5-b8f6-48ae-9b99-e418eb35697d tempest-VolumesActionsTest-401209762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.297s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:07 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-423d77b5-b8f6-48ae-9b99-e418eb35697d tempest-VolumesActionsTest-401209762 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:27:07 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-423d77b5-b8f6-48ae-9b99-e418eb35697d tempest-VolumesActionsTest-401209762 None] Deleted volume successfully. Jul 22 03:27:07 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-423d77b5-b8f6-48ae-9b99-e418eb35697d tempest-VolumesActionsTest-401209762 None] Lock "cinder-21f474aa-2694-49f5-a5e8-d904bad4baff-delete_volume" released by "delete_volume" :: held 1.232s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:27:07 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-dedd97a6-bdea-49e3-8bd7-b1a14952ba18 tempest-VolumesActionsTest-656298785 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:27:07 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-dedd97a6-bdea-49e3-8bd7-b1a14952ba18 tempest-VolumesActionsTest-656298785 None] Flow 'volume_create_manager' (1046911b-80f6-4748-b68c-70c9f9af27c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:27:07 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-dedd97a6-bdea-49e3-8bd7-b1a14952ba18 tempest-VolumesActionsTest-656298785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55398b90-620c-43e8-86c5-7e54334066af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:07 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-dedd97a6-bdea-49e3-8bd7-b1a14952ba18 tempest-VolumesActionsTest-656298785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55398b90-620c-43e8-86c5-7e54334066af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:27:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2005639913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=777781a7-e2ee-41a1-b177-b0b3f435dc95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1212ef82936743398cd7bb66d6b2912b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:27:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:27:08Z,use_quota=True,user_id='a8e79ab5fe9d4cc6a32ae6695ec76c83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:07 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-dedd97a6-bdea-49e3-8bd7-b1a14952ba18 tempest-VolumesActionsTest-656298785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24d9afad-63a2-4002-afcb-46e9fa4bb592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:07 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-dedd97a6-bdea-49e3-8bd7-b1a14952ba18 tempest-VolumesActionsTest-656298785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24d9afad-63a2-4002-afcb-46e9fa4bb592) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:07 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-dedd97a6-bdea-49e3-8bd7-b1a14952ba18 tempest-VolumesActionsTest-656298785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (822bcc54-5cc4-44a3-8746-db32c1997967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:07 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-dedd97a6-bdea-49e3-8bd7-b1a14952ba18 tempest-VolumesActionsTest-656298785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (822bcc54-5cc4-44a3-8746-db32c1997967) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '777781a7-e2ee-41a1-b177-b0b3f435dc95', 'volume_name': 'volume-777781a7-e2ee-41a1-b177-b0b3f435dc95', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:07 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-dedd97a6-bdea-49e3-8bd7-b1a14952ba18 tempest-VolumesActionsTest-656298785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1721e041-4680-4dde-a219-390b06b0b3a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:07 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-dedd97a6-bdea-49e3-8bd7-b1a14952ba18 tempest-VolumesActionsTest-656298785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1721e041-4680-4dde-a219-390b06b0b3a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:07 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-dedd97a6-bdea-49e3-8bd7-b1a14952ba18 tempest-VolumesActionsTest-656298785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eafac9aa-441f-48a4-af6c-c5ad3a785760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:07 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-dedd97a6-bdea-49e3-8bd7-b1a14952ba18 tempest-VolumesActionsTest-656298785 None] Volume 777781a7-e2ee-41a1-b177-b0b3f435dc95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-777781a7-e2ee-41a1-b177-b0b3f435dc95', 'volume_size': 1} Jul 22 03:27:07 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-dedd97a6-bdea-49e3-8bd7-b1a14952ba18 tempest-VolumesActionsTest-656298785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:27:07 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-dedd97a6-bdea-49e3-8bd7-b1a14952ba18 tempest-VolumesActionsTest-656298785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:27:07 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-dedd97a6-bdea-49e3-8bd7-b1a14952ba18 tempest-VolumesActionsTest-656298785 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:27:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2005639913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=777781a7-e2ee-41a1-b177-b0b3f435dc95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1212ef82936743398cd7bb66d6b2912b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:27:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:27:08Z,use_quota=True,user_id='a8e79ab5fe9d4cc6a32ae6695ec76c83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:27:07 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-dedd97a6-bdea-49e3-8bd7-b1a14952ba18 tempest-VolumesActionsTest-656298785 None] Creating volume 777781a7-e2ee-41a1-b177-b0b3f435dc95 {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:27:07 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-dedd97a6-bdea-49e3-8bd7-b1a14952ba18 tempest-VolumesActionsTest-656298785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:27:07 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-dedd97a6-bdea-49e3-8bd7-b1a14952ba18 tempest-VolumesActionsTest-656298785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:27:07 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-dedd97a6-bdea-49e3-8bd7-b1a14952ba18 tempest-VolumesActionsTest-656298785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:27:07 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-dedd97a6-bdea-49e3-8bd7-b1a14952ba18 tempest-VolumesActionsTest-656298785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:27:07 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-dedd97a6-bdea-49e3-8bd7-b1a14952ba18 tempest-VolumesActionsTest-656298785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:27:07 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-dedd97a6-bdea-49e3-8bd7-b1a14952ba18 tempest-VolumesActionsTest-656298785 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:27:07 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-dedd97a6-bdea-49e3-8bd7-b1a14952ba18 tempest-VolumesActionsTest-656298785 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:27:07 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-dedd97a6-bdea-49e3-8bd7-b1a14952ba18 tempest-VolumesActionsTest-656298785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-777781a7-e2ee-41a1-b177-b0b3f435dc95 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:07 devstack sudo[100639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-777781a7-e2ee-41a1-b177-b0b3f435dc95 1073741824 Jul 22 03:27:07 devstack sudo[100639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:07 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [req-c3d68f0d-81dc-42c2-8fd5-a296fcbff76f req-d12b3b78-54e3-4769-9321-386a302208da tempest-TestServerVolumeAttachmentScenario-1465609169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:27:08 devstack sudo[100639]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:08 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-dedd97a6-bdea-49e3-8bd7-b1a14952ba18 tempest-VolumesActionsTest-656298785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-777781a7-e2ee-41a1-b177-b0b3f435dc95 1073741824" returned: 0 in 0.408s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:08 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-dedd97a6-bdea-49e3-8bd7-b1a14952ba18 tempest-VolumesActionsTest-656298785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-777781a7-e2ee-41a1-b177-b0b3f435dc95 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:08 devstack sudo[100645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-777781a7-e2ee-41a1-b177-b0b3f435dc95 Jul 22 03:27:08 devstack sudo[100645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:08 devstack sudo[100645]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:08 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-dedd97a6-bdea-49e3-8bd7-b1a14952ba18 tempest-VolumesActionsTest-656298785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-777781a7-e2ee-41a1-b177-b0b3f435dc95" returned: 0 in 0.247s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:08 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-dedd97a6-bdea-49e3-8bd7-b1a14952ba18 tempest-VolumesActionsTest-656298785 None] <== create_volume: return (692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:27:08 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-dedd97a6-bdea-49e3-8bd7-b1a14952ba18 tempest-VolumesActionsTest-656298785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.695s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:27:08 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [req-c3d68f0d-81dc-42c2-8fd5-a296fcbff76f req-d12b3b78-54e3-4769-9321-386a302208da tempest-TestServerVolumeAttachmentScenario-1465609169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.656s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:27:08 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-dedd97a6-bdea-49e3-8bd7-b1a14952ba18 tempest-VolumesActionsTest-656298785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eafac9aa-441f-48a4-af6c-c5ad3a785760) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-777781a7-e2ee-41a1-b177-b0b3f435dc95', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:08 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-dedd97a6-bdea-49e3-8bd7-b1a14952ba18 tempest-VolumesActionsTest-656298785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11e9d123-e224-4e06-938b-c4f083d6bdaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:08 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [req-c3d68f0d-81dc-42c2-8fd5-a296fcbff76f req-d12b3b78-54e3-4769-9321-386a302208da tempest-TestServerVolumeAttachmentScenario-1465609169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:27:08 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-dedd97a6-bdea-49e3-8bd7-b1a14952ba18 tempest-VolumesActionsTest-656298785 None] Volume volume-777781a7-e2ee-41a1-b177-b0b3f435dc95 (777781a7-e2ee-41a1-b177-b0b3f435dc95): created successfully Jul 22 03:27:08 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-dedd97a6-bdea-49e3-8bd7-b1a14952ba18 tempest-VolumesActionsTest-656298785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11e9d123-e224-4e06-938b-c4f083d6bdaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:08 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-dedd97a6-bdea-49e3-8bd7-b1a14952ba18 tempest-VolumesActionsTest-656298785 None] Flow 'volume_create_manager' (1046911b-80f6-4748-b68c-70c9f9af27c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:27:08 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-dedd97a6-bdea-49e3-8bd7-b1a14952ba18 tempest-VolumesActionsTest-656298785 None] Created volume successfully. Jul 22 03:27:08 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [req-c3d68f0d-81dc-42c2-8fd5-a296fcbff76f req-d12b3b78-54e3-4769-9321-386a302208da tempest-TestServerVolumeAttachmentScenario-1465609169 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f', 'name': 'volume-5975d9e9-d185-45d1-85a0-986075d69208', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '72560a25-f166-49ff-8400-efc1b3795367', 'enforce_multipath': True} {{(pid=87747) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 22 03:27:08 devstack cinder-volume[87747]: INFO cinder.volume.manager [req-c3d68f0d-81dc-42c2-8fd5-a296fcbff76f req-d12b3b78-54e3-4769-9321-386a302208da tempest-TestServerVolumeAttachmentScenario-1465609169 None] attachment_update completed successfully. Jul 22 03:27:08 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-761cec28-67ed-42ac-98de-f3d018aaf614 tempest-VolumesActionsTest-401209762 None] Acquiring lock "cinder-777781a7-e2ee-41a1-b177-b0b3f435dc95-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:27:08 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-761cec28-67ed-42ac-98de-f3d018aaf614 tempest-VolumesActionsTest-401209762 None] Lock "cinder-777781a7-e2ee-41a1-b177-b0b3f435dc95-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:27:08 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-761cec28-67ed-42ac-98de-f3d018aaf614 tempest-VolumesActionsTest-401209762 None] Acquiring lock "cinder-quobyte-777781a7-e2ee-41a1-b177-b0b3f435dc95" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:27:08 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-761cec28-67ed-42ac-98de-f3d018aaf614 tempest-VolumesActionsTest-401209762 None] Lock "cinder-quobyte-777781a7-e2ee-41a1-b177-b0b3f435dc95" acquired by "delete_volume" :: waited 0.015s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:27:08 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f520dce-340f-47ac-97ad-c386e32b7246]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:27:08 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-761cec28-67ed-42ac-98de-f3d018aaf614 tempest-VolumesActionsTest-401209762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-777781a7-e2ee-41a1-b177-b0b3f435dc95 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:08 devstack sudo[101030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-777781a7-e2ee-41a1-b177-b0b3f435dc95 Jul 22 03:27:08 devstack sudo[101030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:09 devstack sudo[101030]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:09 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-761cec28-67ed-42ac-98de-f3d018aaf614 tempest-VolumesActionsTest-401209762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-777781a7-e2ee-41a1-b177-b0b3f435dc95" returned: 0 in 0.362s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:09 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-761cec28-67ed-42ac-98de-f3d018aaf614 tempest-VolumesActionsTest-401209762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-777781a7-e2ee-41a1-b177-b0b3f435dc95 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:09 devstack sudo[101036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-777781a7-e2ee-41a1-b177-b0b3f435dc95 Jul 22 03:27:09 devstack sudo[101036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:09 devstack sudo[101036]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:09 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-761cec28-67ed-42ac-98de-f3d018aaf614 tempest-VolumesActionsTest-401209762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-777781a7-e2ee-41a1-b177-b0b3f435dc95" returned: 0 in 0.259s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:09 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-761cec28-67ed-42ac-98de-f3d018aaf614 tempest-VolumesActionsTest-401209762 None] Lock "cinder-quobyte-777781a7-e2ee-41a1-b177-b0b3f435dc95" released by "delete_volume" :: held 0.662s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:27:09 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-761cec28-67ed-42ac-98de-f3d018aaf614 tempest-VolumesActionsTest-401209762 None] Created reservations ['00bf3cf1-7905-404b-affd-1827b9e286fa', '55e1d9e2-c653-4428-a03d-84e1dbc247de', '56e4cd9c-d939-487c-ba3a-4b65ae08a12f', '48935a2f-7962-4d30-8f75-4888eabdd99b'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:27:09 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-761cec28-67ed-42ac-98de-f3d018aaf614 tempest-VolumesActionsTest-401209762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:27:09 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-761cec28-67ed-42ac-98de-f3d018aaf614 tempest-VolumesActionsTest-401209762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:27:09 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-761cec28-67ed-42ac-98de-f3d018aaf614 tempest-VolumesActionsTest-401209762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:27:09 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-761cec28-67ed-42ac-98de-f3d018aaf614 tempest-VolumesActionsTest-401209762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:27:09 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-761cec28-67ed-42ac-98de-f3d018aaf614 tempest-VolumesActionsTest-401209762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:27:09 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-761cec28-67ed-42ac-98de-f3d018aaf614 tempest-VolumesActionsTest-401209762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:09 devstack sudo[101039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:27:09 devstack sudo[101039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:09 devstack sudo[101039]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:09 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-761cec28-67ed-42ac-98de-f3d018aaf614 tempest-VolumesActionsTest-401209762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.241s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:09 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-761cec28-67ed-42ac-98de-f3d018aaf614 tempest-VolumesActionsTest-401209762 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:27:09 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-761cec28-67ed-42ac-98de-f3d018aaf614 tempest-VolumesActionsTest-401209762 None] Deleted volume successfully. Jul 22 03:27:09 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-761cec28-67ed-42ac-98de-f3d018aaf614 tempest-VolumesActionsTest-401209762 None] Lock "cinder-777781a7-e2ee-41a1-b177-b0b3f435dc95-delete_volume" released by "delete_volume" :: held 1.118s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:27:10 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-3926888d-ef2c-4d08-b916-d61ec2de1e2a tempest-VolumesActionsTest-656298785 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:27:10 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-3926888d-ef2c-4d08-b916-d61ec2de1e2a tempest-VolumesActionsTest-656298785 None] Flow 'volume_create_manager' (49a9e4f7-be20-4873-a7fc-3614f60b6821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:27:10 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-3926888d-ef2c-4d08-b916-d61ec2de1e2a tempest-VolumesActionsTest-656298785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27693947-b4e9-4005-8dc6-2073bba42168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:10 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-3926888d-ef2c-4d08-b916-d61ec2de1e2a tempest-VolumesActionsTest-656298785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27693947-b4e9-4005-8dc6-2073bba42168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:27:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2033770615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebf72c34-d8a9-4167-8e9a-2e382f337c9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1212ef82936743398cd7bb66d6b2912b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:27:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:27:10Z,use_quota=True,user_id='a8e79ab5fe9d4cc6a32ae6695ec76c83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:10 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-3926888d-ef2c-4d08-b916-d61ec2de1e2a tempest-VolumesActionsTest-656298785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a9b38ce-1f07-40ca-867a-75cd3aacec3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:10 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-3926888d-ef2c-4d08-b916-d61ec2de1e2a tempest-VolumesActionsTest-656298785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a9b38ce-1f07-40ca-867a-75cd3aacec3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:10 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-3926888d-ef2c-4d08-b916-d61ec2de1e2a tempest-VolumesActionsTest-656298785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3ccc3d4-954c-4ca0-b691-82f7af9aa0a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:10 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-3926888d-ef2c-4d08-b916-d61ec2de1e2a tempest-VolumesActionsTest-656298785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3ccc3d4-954c-4ca0-b691-82f7af9aa0a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebf72c34-d8a9-4167-8e9a-2e382f337c9c', 'volume_name': 'volume-ebf72c34-d8a9-4167-8e9a-2e382f337c9c', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:10 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-3926888d-ef2c-4d08-b916-d61ec2de1e2a tempest-VolumesActionsTest-656298785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (698852c4-3b4e-4f8d-bf24-e273da1af195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:10 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-3926888d-ef2c-4d08-b916-d61ec2de1e2a tempest-VolumesActionsTest-656298785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (698852c4-3b4e-4f8d-bf24-e273da1af195) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:10 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-3926888d-ef2c-4d08-b916-d61ec2de1e2a tempest-VolumesActionsTest-656298785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a074fc4-d72c-48f0-8204-328984863260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:10 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-3926888d-ef2c-4d08-b916-d61ec2de1e2a tempest-VolumesActionsTest-656298785 None] Volume ebf72c34-d8a9-4167-8e9a-2e382f337c9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebf72c34-d8a9-4167-8e9a-2e382f337c9c', 'volume_size': 1} Jul 22 03:27:10 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-3926888d-ef2c-4d08-b916-d61ec2de1e2a tempest-VolumesActionsTest-656298785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:27:10 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-3926888d-ef2c-4d08-b916-d61ec2de1e2a tempest-VolumesActionsTest-656298785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:27:10 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-3926888d-ef2c-4d08-b916-d61ec2de1e2a tempest-VolumesActionsTest-656298785 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:27:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2033770615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebf72c34-d8a9-4167-8e9a-2e382f337c9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1212ef82936743398cd7bb66d6b2912b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:27:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:27:10Z,use_quota=True,user_id='a8e79ab5fe9d4cc6a32ae6695ec76c83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:27:10 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-3926888d-ef2c-4d08-b916-d61ec2de1e2a tempest-VolumesActionsTest-656298785 None] Creating volume ebf72c34-d8a9-4167-8e9a-2e382f337c9c {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:27:10 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-3926888d-ef2c-4d08-b916-d61ec2de1e2a tempest-VolumesActionsTest-656298785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:27:10 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-3926888d-ef2c-4d08-b916-d61ec2de1e2a tempest-VolumesActionsTest-656298785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:27:10 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-3926888d-ef2c-4d08-b916-d61ec2de1e2a tempest-VolumesActionsTest-656298785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:27:10 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-3926888d-ef2c-4d08-b916-d61ec2de1e2a tempest-VolumesActionsTest-656298785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:27:10 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-3926888d-ef2c-4d08-b916-d61ec2de1e2a tempest-VolumesActionsTest-656298785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:27:10 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-3926888d-ef2c-4d08-b916-d61ec2de1e2a tempest-VolumesActionsTest-656298785 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:27:10 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-3926888d-ef2c-4d08-b916-d61ec2de1e2a tempest-VolumesActionsTest-656298785 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:27:10 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-3926888d-ef2c-4d08-b916-d61ec2de1e2a tempest-VolumesActionsTest-656298785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ebf72c34-d8a9-4167-8e9a-2e382f337c9c 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:10 devstack sudo[101042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ebf72c34-d8a9-4167-8e9a-2e382f337c9c 1073741824 Jul 22 03:27:10 devstack sudo[101042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:10 devstack sudo[101042]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:10 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-3926888d-ef2c-4d08-b916-d61ec2de1e2a tempest-VolumesActionsTest-656298785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ebf72c34-d8a9-4167-8e9a-2e382f337c9c 1073741824" returned: 0 in 0.458s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:11 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-3926888d-ef2c-4d08-b916-d61ec2de1e2a tempest-VolumesActionsTest-656298785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ebf72c34-d8a9-4167-8e9a-2e382f337c9c {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:11 devstack sudo[101048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ebf72c34-d8a9-4167-8e9a-2e382f337c9c Jul 22 03:27:11 devstack sudo[101048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:11 devstack sudo[101048]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:11 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-3926888d-ef2c-4d08-b916-d61ec2de1e2a tempest-VolumesActionsTest-656298785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ebf72c34-d8a9-4167-8e9a-2e382f337c9c" returned: 0 in 0.243s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:11 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-3926888d-ef2c-4d08-b916-d61ec2de1e2a tempest-VolumesActionsTest-656298785 None] <== create_volume: return (749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:27:11 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-3926888d-ef2c-4d08-b916-d61ec2de1e2a tempest-VolumesActionsTest-656298785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.751s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:27:11 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-3926888d-ef2c-4d08-b916-d61ec2de1e2a tempest-VolumesActionsTest-656298785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a074fc4-d72c-48f0-8204-328984863260) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebf72c34-d8a9-4167-8e9a-2e382f337c9c', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:11 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-3926888d-ef2c-4d08-b916-d61ec2de1e2a tempest-VolumesActionsTest-656298785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c8f9b84-d9cf-41f1-b8f8-04e23af84b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:11 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-3926888d-ef2c-4d08-b916-d61ec2de1e2a tempest-VolumesActionsTest-656298785 None] Volume volume-ebf72c34-d8a9-4167-8e9a-2e382f337c9c (ebf72c34-d8a9-4167-8e9a-2e382f337c9c): created successfully Jul 22 03:27:11 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-3926888d-ef2c-4d08-b916-d61ec2de1e2a tempest-VolumesActionsTest-656298785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c8f9b84-d9cf-41f1-b8f8-04e23af84b89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:11 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-3926888d-ef2c-4d08-b916-d61ec2de1e2a tempest-VolumesActionsTest-656298785 None] Flow 'volume_create_manager' (49a9e4f7-be20-4873-a7fc-3614f60b6821) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:27:11 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-3926888d-ef2c-4d08-b916-d61ec2de1e2a tempest-VolumesActionsTest-656298785 None] Created volume successfully. Jul 22 03:27:11 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-011c4803-9a9f-4775-ab3c-3f498328ed3e tempest-VolumesActionsTest-401209762 None] Acquiring lock "cinder-ebf72c34-d8a9-4167-8e9a-2e382f337c9c-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:27:11 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-011c4803-9a9f-4775-ab3c-3f498328ed3e tempest-VolumesActionsTest-401209762 None] Lock "cinder-ebf72c34-d8a9-4167-8e9a-2e382f337c9c-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:27:11 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-011c4803-9a9f-4775-ab3c-3f498328ed3e tempest-VolumesActionsTest-401209762 None] Acquiring lock "cinder-quobyte-ebf72c34-d8a9-4167-8e9a-2e382f337c9c" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:27:11 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-011c4803-9a9f-4775-ab3c-3f498328ed3e tempest-VolumesActionsTest-401209762 None] Lock "cinder-quobyte-ebf72c34-d8a9-4167-8e9a-2e382f337c9c" acquired by "delete_volume" :: waited 0.017s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:27:11 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[a630e190-0aa8-4767-9649-9572b24d6bd0]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:27:11 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-011c4803-9a9f-4775-ab3c-3f498328ed3e tempest-VolumesActionsTest-401209762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ebf72c34-d8a9-4167-8e9a-2e382f337c9c {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:11 devstack sudo[101051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ebf72c34-d8a9-4167-8e9a-2e382f337c9c Jul 22 03:27:11 devstack sudo[101051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:12 devstack sudo[101051]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:12 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-011c4803-9a9f-4775-ab3c-3f498328ed3e tempest-VolumesActionsTest-401209762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ebf72c34-d8a9-4167-8e9a-2e382f337c9c" returned: 0 in 0.386s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:12 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-011c4803-9a9f-4775-ab3c-3f498328ed3e tempest-VolumesActionsTest-401209762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ebf72c34-d8a9-4167-8e9a-2e382f337c9c {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:12 devstack sudo[101060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ebf72c34-d8a9-4167-8e9a-2e382f337c9c Jul 22 03:27:12 devstack sudo[101060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:12 devstack sudo[101060]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:12 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-011c4803-9a9f-4775-ab3c-3f498328ed3e tempest-VolumesActionsTest-401209762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ebf72c34-d8a9-4167-8e9a-2e382f337c9c" returned: 0 in 0.276s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:12 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-011c4803-9a9f-4775-ab3c-3f498328ed3e tempest-VolumesActionsTest-401209762 None] Lock "cinder-quobyte-ebf72c34-d8a9-4167-8e9a-2e382f337c9c" released by "delete_volume" :: held 0.709s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:27:12 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [req-ec2ce7db-bf3f-4c89-826f-6197c0b5fb7b req-f954372d-11a6-466e-9ab5-a737a6067991 tempest-TestServerVolumeAttachmentScenario-1465609169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:27:12 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [req-ec2ce7db-bf3f-4c89-826f-6197c0b5fb7b req-f954372d-11a6-466e-9ab5-a737a6067991 tempest-TestServerVolumeAttachmentScenario-1465609169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:27:12 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-011c4803-9a9f-4775-ab3c-3f498328ed3e tempest-VolumesActionsTest-401209762 None] Created reservations ['a5025112-2a8c-403e-974a-790ca6cacb28', 'e382a8a0-1964-4a7e-80d0-006e86d31f10', 'd16f6af0-1c09-48bd-b407-c4e90a255226', 'a8a38e39-ceac-4d79-8000-83cde995fca6'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:27:12 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [req-ec2ce7db-bf3f-4c89-826f-6197c0b5fb7b req-f954372d-11a6-466e-9ab5-a737a6067991 tempest-TestServerVolumeAttachmentScenario-1465609169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:27:12 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [req-ec2ce7db-bf3f-4c89-826f-6197c0b5fb7b req-f954372d-11a6-466e-9ab5-a737a6067991 tempest-TestServerVolumeAttachmentScenario-1465609169 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f', 'name': 'volume-18d08f51-e187-4c3e-b66e-1eb402ce9fa9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ee7cf20d-f0a8-4e48-8b46-4f29b375abbb', 'enforce_multipath': True} {{(pid=87747) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 22 03:27:12 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-011c4803-9a9f-4775-ab3c-3f498328ed3e tempest-VolumesActionsTest-401209762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:27:12 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-011c4803-9a9f-4775-ab3c-3f498328ed3e tempest-VolumesActionsTest-401209762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:27:12 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-011c4803-9a9f-4775-ab3c-3f498328ed3e tempest-VolumesActionsTest-401209762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:27:12 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-011c4803-9a9f-4775-ab3c-3f498328ed3e tempest-VolumesActionsTest-401209762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:27:12 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-011c4803-9a9f-4775-ab3c-3f498328ed3e tempest-VolumesActionsTest-401209762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:27:12 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-011c4803-9a9f-4775-ab3c-3f498328ed3e tempest-VolumesActionsTest-401209762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:12 devstack sudo[101071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:27:12 devstack sudo[101071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:12 devstack cinder-volume[87747]: INFO cinder.volume.manager [req-ec2ce7db-bf3f-4c89-826f-6197c0b5fb7b req-f954372d-11a6-466e-9ab5-a737a6067991 tempest-TestServerVolumeAttachmentScenario-1465609169 None] attachment_update completed successfully. Jul 22 03:27:12 devstack sudo[101071]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:12 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-011c4803-9a9f-4775-ab3c-3f498328ed3e tempest-VolumesActionsTest-401209762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.283s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:12 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-011c4803-9a9f-4775-ab3c-3f498328ed3e tempest-VolumesActionsTest-401209762 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:27:12 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-011c4803-9a9f-4775-ab3c-3f498328ed3e tempest-VolumesActionsTest-401209762 None] Deleted volume successfully. Jul 22 03:27:12 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-011c4803-9a9f-4775-ab3c-3f498328ed3e tempest-VolumesActionsTest-401209762 None] Lock "cinder-ebf72c34-d8a9-4167-8e9a-2e382f337c9c-delete_volume" released by "delete_volume" :: held 1.280s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:27:13 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-00d99014-894e-49d9-bd6f-f30ff1e49f82 tempest-VolumesActionsTest-656298785 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:27:13 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-00d99014-894e-49d9-bd6f-f30ff1e49f82 tempest-VolumesActionsTest-656298785 None] Flow 'volume_create_manager' (931c98d0-258b-4558-859f-dc13cd69dd5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:27:13 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-00d99014-894e-49d9-bd6f-f30ff1e49f82 tempest-VolumesActionsTest-656298785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f25e91c0-6c5f-4c68-89dd-224b885fc4fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:13 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-00d99014-894e-49d9-bd6f-f30ff1e49f82 tempest-VolumesActionsTest-656298785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f25e91c0-6c5f-4c68-89dd-224b885fc4fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:27:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1529041297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78ece532-d6b9-467d-9bff-fb637b68cf14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1212ef82936743398cd7bb66d6b2912b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:27:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:27:13Z,use_quota=True,user_id='a8e79ab5fe9d4cc6a32ae6695ec76c83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:13 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-00d99014-894e-49d9-bd6f-f30ff1e49f82 tempest-VolumesActionsTest-656298785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (367458c4-0d6d-438e-8ba1-5224e5732771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:13 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-00d99014-894e-49d9-bd6f-f30ff1e49f82 tempest-VolumesActionsTest-656298785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (367458c4-0d6d-438e-8ba1-5224e5732771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:13 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-00d99014-894e-49d9-bd6f-f30ff1e49f82 tempest-VolumesActionsTest-656298785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (969af035-9998-4dec-951c-c5bc1b504d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:13 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-00d99014-894e-49d9-bd6f-f30ff1e49f82 tempest-VolumesActionsTest-656298785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (969af035-9998-4dec-951c-c5bc1b504d4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78ece532-d6b9-467d-9bff-fb637b68cf14', 'volume_name': 'volume-78ece532-d6b9-467d-9bff-fb637b68cf14', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:13 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-00d99014-894e-49d9-bd6f-f30ff1e49f82 tempest-VolumesActionsTest-656298785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47ed0668-bbfa-4ba2-99d8-0b222bda231d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:13 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-00d99014-894e-49d9-bd6f-f30ff1e49f82 tempest-VolumesActionsTest-656298785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47ed0668-bbfa-4ba2-99d8-0b222bda231d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:13 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-00d99014-894e-49d9-bd6f-f30ff1e49f82 tempest-VolumesActionsTest-656298785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d0f28a2-221c-4b11-bc54-4a27d99e5f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:13 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-00d99014-894e-49d9-bd6f-f30ff1e49f82 tempest-VolumesActionsTest-656298785 None] Volume 78ece532-d6b9-467d-9bff-fb637b68cf14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78ece532-d6b9-467d-9bff-fb637b68cf14', 'volume_size': 1} Jul 22 03:27:13 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-00d99014-894e-49d9-bd6f-f30ff1e49f82 tempest-VolumesActionsTest-656298785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:27:13 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-00d99014-894e-49d9-bd6f-f30ff1e49f82 tempest-VolumesActionsTest-656298785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:27:13 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-00d99014-894e-49d9-bd6f-f30ff1e49f82 tempest-VolumesActionsTest-656298785 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:27:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1529041297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78ece532-d6b9-467d-9bff-fb637b68cf14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1212ef82936743398cd7bb66d6b2912b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:27:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:27:13Z,use_quota=True,user_id='a8e79ab5fe9d4cc6a32ae6695ec76c83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:27:13 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-00d99014-894e-49d9-bd6f-f30ff1e49f82 tempest-VolumesActionsTest-656298785 None] Creating volume 78ece532-d6b9-467d-9bff-fb637b68cf14 {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:27:13 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-00d99014-894e-49d9-bd6f-f30ff1e49f82 tempest-VolumesActionsTest-656298785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:27:13 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-00d99014-894e-49d9-bd6f-f30ff1e49f82 tempest-VolumesActionsTest-656298785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:27:13 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-00d99014-894e-49d9-bd6f-f30ff1e49f82 tempest-VolumesActionsTest-656298785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:27:13 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-00d99014-894e-49d9-bd6f-f30ff1e49f82 tempest-VolumesActionsTest-656298785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:27:13 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-00d99014-894e-49d9-bd6f-f30ff1e49f82 tempest-VolumesActionsTest-656298785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:27:13 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-00d99014-894e-49d9-bd6f-f30ff1e49f82 tempest-VolumesActionsTest-656298785 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:27:13 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-00d99014-894e-49d9-bd6f-f30ff1e49f82 tempest-VolumesActionsTest-656298785 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:27:13 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-00d99014-894e-49d9-bd6f-f30ff1e49f82 tempest-VolumesActionsTest-656298785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-78ece532-d6b9-467d-9bff-fb637b68cf14 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:13 devstack sudo[101077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-78ece532-d6b9-467d-9bff-fb637b68cf14 1073741824 Jul 22 03:27:13 devstack sudo[101077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:13 devstack sudo[101077]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:13 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-00d99014-894e-49d9-bd6f-f30ff1e49f82 tempest-VolumesActionsTest-656298785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-78ece532-d6b9-467d-9bff-fb637b68cf14 1073741824" returned: 0 in 0.469s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:13 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-00d99014-894e-49d9-bd6f-f30ff1e49f82 tempest-VolumesActionsTest-656298785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-78ece532-d6b9-467d-9bff-fb637b68cf14 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:13 devstack sudo[101083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-78ece532-d6b9-467d-9bff-fb637b68cf14 Jul 22 03:27:13 devstack sudo[101083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:14 devstack cinder-volume[87747]: INFO cinder.volume.manager [req-0ef1c52b-32a3-4e8b-b565-fc37ce57b422 req-5f2856d3-33a3-4fd3-976e-f642db3b47b3 tempest-TestServerVolumeAttachmentScenario-1465609169 None] Terminate volume connection completed successfully. Jul 22 03:27:14 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [req-0ef1c52b-32a3-4e8b-b565-fc37ce57b422 req-5f2856d3-33a3-4fd3-976e-f642db3b47b3 tempest-TestServerVolumeAttachmentScenario-1465609169 None] Deleting attachment ee7cf20d-f0a8-4e48-8b46-4f29b375abbb. {{(pid=87747) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 22 03:27:14 devstack sudo[101083]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:14 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-00d99014-894e-49d9-bd6f-f30ff1e49f82 tempest-VolumesActionsTest-656298785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-78ece532-d6b9-467d-9bff-fb637b68cf14" returned: 0 in 0.255s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:14 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-00d99014-894e-49d9-bd6f-f30ff1e49f82 tempest-VolumesActionsTest-656298785 None] <== create_volume: return (766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:27:14 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-00d99014-894e-49d9-bd6f-f30ff1e49f82 tempest-VolumesActionsTest-656298785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.768s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:27:14 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-00d99014-894e-49d9-bd6f-f30ff1e49f82 tempest-VolumesActionsTest-656298785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d0f28a2-221c-4b11-bc54-4a27d99e5f5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78ece532-d6b9-467d-9bff-fb637b68cf14', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:14 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-00d99014-894e-49d9-bd6f-f30ff1e49f82 tempest-VolumesActionsTest-656298785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (759de794-b42a-42e7-9f72-a2c4e88a1b77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:14 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-00d99014-894e-49d9-bd6f-f30ff1e49f82 tempest-VolumesActionsTest-656298785 None] Volume volume-78ece532-d6b9-467d-9bff-fb637b68cf14 (78ece532-d6b9-467d-9bff-fb637b68cf14): created successfully Jul 22 03:27:14 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-00d99014-894e-49d9-bd6f-f30ff1e49f82 tempest-VolumesActionsTest-656298785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (759de794-b42a-42e7-9f72-a2c4e88a1b77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:14 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-00d99014-894e-49d9-bd6f-f30ff1e49f82 tempest-VolumesActionsTest-656298785 None] Flow 'volume_create_manager' (931c98d0-258b-4558-859f-dc13cd69dd5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:27:14 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-00d99014-894e-49d9-bd6f-f30ff1e49f82 tempest-VolumesActionsTest-656298785 None] Created volume successfully. Jul 22 03:27:14 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-0729371a-08ba-4767-8260-709cb641517c tempest-VolumesActionsTest-656298785 None] Acquiring lock "cinder-78ece532-d6b9-467d-9bff-fb637b68cf14-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:27:14 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-0729371a-08ba-4767-8260-709cb641517c tempest-VolumesActionsTest-656298785 None] Lock "cinder-78ece532-d6b9-467d-9bff-fb637b68cf14-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:27:14 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-0729371a-08ba-4767-8260-709cb641517c tempest-VolumesActionsTest-656298785 None] Acquiring lock "cinder-quobyte-78ece532-d6b9-467d-9bff-fb637b68cf14" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:27:15 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-0729371a-08ba-4767-8260-709cb641517c tempest-VolumesActionsTest-656298785 None] Lock "cinder-quobyte-78ece532-d6b9-467d-9bff-fb637b68cf14" acquired by "delete_volume" :: waited 0.015s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:27:15 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[e61ff745-3446-45c8-93fe-3d40240d05bb]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:27:15 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-0729371a-08ba-4767-8260-709cb641517c tempest-VolumesActionsTest-656298785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-78ece532-d6b9-467d-9bff-fb637b68cf14 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:15 devstack sudo[101090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-78ece532-d6b9-467d-9bff-fb637b68cf14 Jul 22 03:27:15 devstack sudo[101090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:15 devstack sudo[101090]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:15 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-0729371a-08ba-4767-8260-709cb641517c tempest-VolumesActionsTest-656298785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-78ece532-d6b9-467d-9bff-fb637b68cf14" returned: 0 in 0.383s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:15 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-0729371a-08ba-4767-8260-709cb641517c tempest-VolumesActionsTest-656298785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-78ece532-d6b9-467d-9bff-fb637b68cf14 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:15 devstack sudo[101096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-78ece532-d6b9-467d-9bff-fb637b68cf14 Jul 22 03:27:15 devstack sudo[101096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:15 devstack cinder-volume[87747]: INFO cinder.volume.manager [req-82ffb137-a274-4413-bfd3-2b7fc1c29fe8 req-2a90b036-c8c7-45f6-927a-b444af99d202 tempest-TestServerVolumeAttachmentScenario-1465609169 None] Terminate volume connection completed successfully. Jul 22 03:27:15 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [req-82ffb137-a274-4413-bfd3-2b7fc1c29fe8 req-2a90b036-c8c7-45f6-927a-b444af99d202 tempest-TestServerVolumeAttachmentScenario-1465609169 None] Deleting attachment 72560a25-f166-49ff-8400-efc1b3795367. {{(pid=87747) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 22 03:27:15 devstack sudo[101096]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:15 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-0729371a-08ba-4767-8260-709cb641517c tempest-VolumesActionsTest-656298785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-78ece532-d6b9-467d-9bff-fb637b68cf14" returned: 0 in 0.270s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:15 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-0729371a-08ba-4767-8260-709cb641517c tempest-VolumesActionsTest-656298785 None] Lock "cinder-quobyte-78ece532-d6b9-467d-9bff-fb637b68cf14" released by "delete_volume" :: held 0.703s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:27:15 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-0729371a-08ba-4767-8260-709cb641517c tempest-VolumesActionsTest-656298785 None] Created reservations ['32db4069-f0d8-43b2-a406-eaa417e142f0', '5d8e77b3-54f4-4005-bd9c-9cb09543770c', 'adda6f7f-6729-4f57-b9db-9e2081ba4463', 'c81b2b7d-0aba-40f9-b13d-12a8265f0a99'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:27:15 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-0729371a-08ba-4767-8260-709cb641517c tempest-VolumesActionsTest-656298785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:27:15 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-0729371a-08ba-4767-8260-709cb641517c tempest-VolumesActionsTest-656298785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:27:15 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-0729371a-08ba-4767-8260-709cb641517c tempest-VolumesActionsTest-656298785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:27:15 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-0729371a-08ba-4767-8260-709cb641517c tempest-VolumesActionsTest-656298785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:27:15 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-0729371a-08ba-4767-8260-709cb641517c tempest-VolumesActionsTest-656298785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:27:15 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-0729371a-08ba-4767-8260-709cb641517c tempest-VolumesActionsTest-656298785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:15 devstack sudo[101126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:27:15 devstack sudo[101126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:16 devstack sudo[101126]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:16 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-0729371a-08ba-4767-8260-709cb641517c tempest-VolumesActionsTest-656298785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.243s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:16 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-0729371a-08ba-4767-8260-709cb641517c tempest-VolumesActionsTest-656298785 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:27:16 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-0729371a-08ba-4767-8260-709cb641517c tempest-VolumesActionsTest-656298785 None] Deleted volume successfully. Jul 22 03:27:16 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-0729371a-08ba-4767-8260-709cb641517c tempest-VolumesActionsTest-656298785 None] Lock "cinder-78ece532-d6b9-467d-9bff-fb637b68cf14-delete_volume" released by "delete_volume" :: held 1.197s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:27:20 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-c58012a8-2296-475e-aa7c-557da4824670 tempest-TestServerVolumeAttachmentScenario-1465609169 None] Acquiring lock "cinder-18d08f51-e187-4c3e-b66e-1eb402ce9fa9-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:27:20 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-c58012a8-2296-475e-aa7c-557da4824670 tempest-TestServerVolumeAttachmentScenario-1465609169 None] Lock "cinder-18d08f51-e187-4c3e-b66e-1eb402ce9fa9-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:27:20 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-c58012a8-2296-475e-aa7c-557da4824670 tempest-TestServerVolumeAttachmentScenario-1465609169 None] Acquiring lock "cinder-quobyte-18d08f51-e187-4c3e-b66e-1eb402ce9fa9" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:27:20 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-c58012a8-2296-475e-aa7c-557da4824670 tempest-TestServerVolumeAttachmentScenario-1465609169 None] Lock "cinder-quobyte-18d08f51-e187-4c3e-b66e-1eb402ce9fa9" acquired by "delete_volume" :: waited 0.018s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:27:20 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[085c9e08-1ac5-46c8-9420-60e141c3bc9f]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:27:20 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-c58012a8-2296-475e-aa7c-557da4824670 tempest-TestServerVolumeAttachmentScenario-1465609169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-18d08f51-e187-4c3e-b66e-1eb402ce9fa9 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:20 devstack sudo[101156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-18d08f51-e187-4c3e-b66e-1eb402ce9fa9 Jul 22 03:27:20 devstack sudo[101156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:21 devstack sudo[101156]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:21 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-c58012a8-2296-475e-aa7c-557da4824670 tempest-TestServerVolumeAttachmentScenario-1465609169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-18d08f51-e187-4c3e-b66e-1eb402ce9fa9" returned: 0 in 0.361s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:21 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-c58012a8-2296-475e-aa7c-557da4824670 tempest-TestServerVolumeAttachmentScenario-1465609169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-18d08f51-e187-4c3e-b66e-1eb402ce9fa9 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:21 devstack sudo[101161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-18d08f51-e187-4c3e-b66e-1eb402ce9fa9 Jul 22 03:27:21 devstack sudo[101161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:21 devstack sudo[101161]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:21 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-c58012a8-2296-475e-aa7c-557da4824670 tempest-TestServerVolumeAttachmentScenario-1465609169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-18d08f51-e187-4c3e-b66e-1eb402ce9fa9" returned: 0 in 0.279s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:21 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-c58012a8-2296-475e-aa7c-557da4824670 tempest-TestServerVolumeAttachmentScenario-1465609169 None] Lock "cinder-quobyte-18d08f51-e187-4c3e-b66e-1eb402ce9fa9" released by "delete_volume" :: held 0.686s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:27:21 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-c58012a8-2296-475e-aa7c-557da4824670 tempest-TestServerVolumeAttachmentScenario-1465609169 None] Created reservations ['7bc8d9ff-9c10-4eca-a6a1-75fb0a9a4dcf', 'a5e358c7-7db1-4fe8-a9c0-db53d4297472', 'b88e0560-8cd9-46c3-b43d-a7ee8775d4d6', 'c88f3685-6566-4856-8410-8fd3da29bfcb'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:27:21 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-c58012a8-2296-475e-aa7c-557da4824670 tempest-TestServerVolumeAttachmentScenario-1465609169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:27:21 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-c58012a8-2296-475e-aa7c-557da4824670 tempest-TestServerVolumeAttachmentScenario-1465609169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:27:21 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-c58012a8-2296-475e-aa7c-557da4824670 tempest-TestServerVolumeAttachmentScenario-1465609169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:27:21 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-c58012a8-2296-475e-aa7c-557da4824670 tempest-TestServerVolumeAttachmentScenario-1465609169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:27:21 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-c58012a8-2296-475e-aa7c-557da4824670 tempest-TestServerVolumeAttachmentScenario-1465609169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:27:21 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-c58012a8-2296-475e-aa7c-557da4824670 tempest-TestServerVolumeAttachmentScenario-1465609169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:21 devstack sudo[101165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:27:21 devstack sudo[101165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:21 devstack sudo[101165]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:21 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-c58012a8-2296-475e-aa7c-557da4824670 tempest-TestServerVolumeAttachmentScenario-1465609169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.261s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:21 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-c58012a8-2296-475e-aa7c-557da4824670 tempest-TestServerVolumeAttachmentScenario-1465609169 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:27:21 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-c58012a8-2296-475e-aa7c-557da4824670 tempest-TestServerVolumeAttachmentScenario-1465609169 None] Deleted volume successfully. Jul 22 03:27:21 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-c58012a8-2296-475e-aa7c-557da4824670 tempest-TestServerVolumeAttachmentScenario-1465609169 None] Lock "cinder-18d08f51-e187-4c3e-b66e-1eb402ce9fa9-delete_volume" released by "delete_volume" :: held 1.184s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:27:21 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-9d720496-a738-4ac2-b985-914f5a00b124 tempest-TestServerVolumeAttachmentScenario-1465609169 None] Acquiring lock "cinder-5975d9e9-d185-45d1-85a0-986075d69208-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:27:21 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-9d720496-a738-4ac2-b985-914f5a00b124 tempest-TestServerVolumeAttachmentScenario-1465609169 None] Lock "cinder-5975d9e9-d185-45d1-85a0-986075d69208-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:27:21 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-9d720496-a738-4ac2-b985-914f5a00b124 tempest-TestServerVolumeAttachmentScenario-1465609169 None] Acquiring lock "cinder-quobyte-5975d9e9-d185-45d1-85a0-986075d69208" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:27:21 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-9d720496-a738-4ac2-b985-914f5a00b124 tempest-TestServerVolumeAttachmentScenario-1465609169 None] Lock "cinder-quobyte-5975d9e9-d185-45d1-85a0-986075d69208" acquired by "delete_volume" :: waited 0.015s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:27:21 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e66317c-c490-4b83-a528-a2b8a62b266d]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:27:21 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-9d720496-a738-4ac2-b985-914f5a00b124 tempest-TestServerVolumeAttachmentScenario-1465609169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-5975d9e9-d185-45d1-85a0-986075d69208 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:22 devstack sudo[101168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-5975d9e9-d185-45d1-85a0-986075d69208 Jul 22 03:27:22 devstack sudo[101168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:22 devstack sudo[101168]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-9d720496-a738-4ac2-b985-914f5a00b124 tempest-TestServerVolumeAttachmentScenario-1465609169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-5975d9e9-d185-45d1-85a0-986075d69208" returned: 0 in 0.371s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-9d720496-a738-4ac2-b985-914f5a00b124 tempest-TestServerVolumeAttachmentScenario-1465609169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-5975d9e9-d185-45d1-85a0-986075d69208 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:22 devstack sudo[101173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-5975d9e9-d185-45d1-85a0-986075d69208 Jul 22 03:27:22 devstack sudo[101173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:22 devstack cinder-volume[87747]: DEBUG oslo_service.periodic_task [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87747) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 03:27:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:27:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:27:22 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:27:22 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:27:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:27:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:22 devstack sudo[101175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:27:22 devstack sudo[101175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:22 devstack sudo[101173]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-9d720496-a738-4ac2-b985-914f5a00b124 tempest-TestServerVolumeAttachmentScenario-1465609169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-5975d9e9-d185-45d1-85a0-986075d69208" returned: 0 in 0.273s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:22 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-9d720496-a738-4ac2-b985-914f5a00b124 tempest-TestServerVolumeAttachmentScenario-1465609169 None] Lock "cinder-quobyte-5975d9e9-d185-45d1-85a0-986075d69208" released by "delete_volume" :: held 0.719s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:27:22 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-9d720496-a738-4ac2-b985-914f5a00b124 tempest-TestServerVolumeAttachmentScenario-1465609169 None] Created reservations ['85e6f049-75b9-4b4c-89cb-ba370da60c89', '070ab885-8c67-4fe4-861a-1e3fb57eebff', '6cd52881-d15e-4538-ac23-8159c186dfee', '6327479f-b68b-4408-8dbe-34a4ca59a92c'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:27:22 devstack sudo[101175]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.309s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:22 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:27:22 devstack cinder-volume[87747]: DEBUG oslo_service.periodic_task [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Running periodic task VolumeManager._thread_info {{(pid=87747) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 03:27:22 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] thread count: 28 {{(pid=87747) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 22 03:27:22 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] thread info: [<_MainThread(MainThread, started 132775275860096)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87747) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 22 03:27:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-9d720496-a738-4ac2-b985-914f5a00b124 tempest-TestServerVolumeAttachmentScenario-1465609169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:27:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-9d720496-a738-4ac2-b985-914f5a00b124 tempest-TestServerVolumeAttachmentScenario-1465609169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:27:22 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-9d720496-a738-4ac2-b985-914f5a00b124 tempest-TestServerVolumeAttachmentScenario-1465609169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:27:22 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-9d720496-a738-4ac2-b985-914f5a00b124 tempest-TestServerVolumeAttachmentScenario-1465609169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:27:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-9d720496-a738-4ac2-b985-914f5a00b124 tempest-TestServerVolumeAttachmentScenario-1465609169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:27:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-9d720496-a738-4ac2-b985-914f5a00b124 tempest-TestServerVolumeAttachmentScenario-1465609169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:22 devstack sudo[101179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:27:22 devstack sudo[101179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:23 devstack sudo[101179]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:23 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-9d720496-a738-4ac2-b985-914f5a00b124 tempest-TestServerVolumeAttachmentScenario-1465609169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.283s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:23 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-9d720496-a738-4ac2-b985-914f5a00b124 tempest-TestServerVolumeAttachmentScenario-1465609169 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:27:23 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-9d720496-a738-4ac2-b985-914f5a00b124 tempest-TestServerVolumeAttachmentScenario-1465609169 None] Deleted volume successfully. Jul 22 03:27:23 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-9d720496-a738-4ac2-b985-914f5a00b124 tempest-TestServerVolumeAttachmentScenario-1465609169 None] Lock "cinder-5975d9e9-d185-45d1-85a0-986075d69208-delete_volume" released by "delete_volume" :: held 1.230s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:27:27 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-3de30358-4c41-4e25-8096-9e8b13728781 tempest-VolumesImageMetadata-2078187035 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:27:27 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-3de30358-4c41-4e25-8096-9e8b13728781 tempest-VolumesImageMetadata-2078187035 None] Flow 'volume_create_manager' (df221c5d-012e-4083-9e73-b4b2a18b70f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:27:27 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-3de30358-4c41-4e25-8096-9e8b13728781 tempest-VolumesImageMetadata-2078187035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fc38ab5-dab6-4691-b6fc-0b807ce5f2d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:27 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-3de30358-4c41-4e25-8096-9e8b13728781 tempest-VolumesImageMetadata-2078187035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fc38ab5-dab6-4691-b6fc-0b807ce5f2d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:27:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-2053725843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da352ef4-4f5d-4bff-8d68-b3aa77a29621,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cee89be0cc984297bf8d4d50fd4f4cc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:27:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:27:27Z,use_quota=True,user_id='dedd871130874d80944e3fec6386d626',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:27 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-3de30358-4c41-4e25-8096-9e8b13728781 tempest-VolumesImageMetadata-2078187035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a42e3299-4ae3-401b-88fb-ad873afff55e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:27 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-3de30358-4c41-4e25-8096-9e8b13728781 tempest-VolumesImageMetadata-2078187035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a42e3299-4ae3-401b-88fb-ad873afff55e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:27 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-3de30358-4c41-4e25-8096-9e8b13728781 tempest-VolumesImageMetadata-2078187035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c27b3fd6-c762-44f0-a6ec-75f92ffdab1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:27 devstack cinder-volume[87747]: DEBUG cinder.image.glance [None req-3de30358-4c41-4e25-8096-9e8b13728781 tempest-VolumesImageMetadata-2078187035 None] Creating Keystone auth plugin from conf {{(pid=87747) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 22 03:27:27 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-3de30358-4c41-4e25-8096-9e8b13728781 tempest-VolumesImageMetadata-2078187035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c27b3fd6-c762-44f0-a6ec-75f92ffdab1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'da352ef4-4f5d-4bff-8d68-b3aa77a29621', 'volume_name': 'volume-da352ef4-4f5d-4bff-8d68-b3aa77a29621', 'volume_size': 1, 'image_id': 'a3efde48-babd-4b04-b205-71cd843dec16', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a3efde48-babd-4b04-b205-71cd843dec16', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '37328413017b49c4b4fe75bae83dd2ac', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a3efde48-babd-4b04-b205-71cd843dec16', 'created_at': datetime.datetime(2026, 7, 22, 1, 8, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 22, 1, 8, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a3efde48-babd-4b04-b205-71cd843dec16/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:27 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-3de30358-4c41-4e25-8096-9e8b13728781 tempest-VolumesImageMetadata-2078187035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (383ec917-b31f-4bc9-8c8c-88e47f2b7ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:27 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-3de30358-4c41-4e25-8096-9e8b13728781 tempest-VolumesImageMetadata-2078187035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (383ec917-b31f-4bc9-8c8c-88e47f2b7ee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:27 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-3de30358-4c41-4e25-8096-9e8b13728781 tempest-VolumesImageMetadata-2078187035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f31a3a3-c500-413b-8e69-619762563383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:27 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-3de30358-4c41-4e25-8096-9e8b13728781 tempest-VolumesImageMetadata-2078187035 None] Volume da352ef4-4f5d-4bff-8d68-b3aa77a29621: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-da352ef4-4f5d-4bff-8d68-b3aa77a29621', 'volume_size': 1, 'image_id': 'a3efde48-babd-4b04-b205-71cd843dec16', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a3efde48-babd-4b04-b205-71cd843dec16', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '37328413017b49c4b4fe75bae83dd2ac', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a3efde48-babd-4b04-b205-71cd843dec16', 'created_at': datetime.datetime(2026, 7, 22, 1, 8, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 22, 1, 8, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a3efde48-babd-4b04-b205-71cd843dec16/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 22 03:27:27 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-3de30358-4c41-4e25-8096-9e8b13728781 tempest-VolumesImageMetadata-2078187035 None] Trying to clone da352ef4-4f5d-4bff-8d68-b3aa77a29621 from image a3efde48-babd-4b04-b205-71cd843dec16 at location (None, [{'url': 'file:///opt/stack/data/glance/images/a3efde48-babd-4b04-b205-71cd843dec16', 'metadata': {}}]). {{(pid=87747) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 22 03:27:28 devstack cinder-volume[87747]: DEBUG cinder.image.image_utils [None req-3de30358-4c41-4e25-8096-9e8b13728781 tempest-VolumesImageMetadata-2078187035 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a3efde48-babd-4b04-b205-71cd843dec16_054r12wwdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87747) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 22 03:27:28 devstack cinder-volume[87747]: INFO cinder.image.image_utils [None req-3de30358-4c41-4e25-8096-9e8b13728781 tempest-VolumesImageMetadata-2078187035 None] Image download 20.69 MB at 20.69 MB/s Jul 22 03:27:28 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbba16dc-f5b5-48ca-ade7-849ec41ec6c6]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:27:28 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-3de30358-4c41-4e25-8096-9e8b13728781 tempest-VolumesImageMetadata-2078187035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a3efde48-babd-4b04-b205-71cd843dec16_054r12wwdevstack@QuobyteHD {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:28 devstack sudo[101187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a3efde48-babd-4b04-b205-71cd843dec16_054r12wwdevstack@QuobyteHD Jul 22 03:27:28 devstack sudo[101187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:28 devstack sudo[101187]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:28 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-3de30358-4c41-4e25-8096-9e8b13728781 tempest-VolumesImageMetadata-2078187035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a3efde48-babd-4b04-b205-71cd843dec16_054r12wwdevstack@QuobyteHD" returned: 0 in 0.352s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:28 devstack cinder-volume[87747]: DEBUG cinder.image.image_utils [None req-3de30358-4c41-4e25-8096-9e8b13728781 tempest-VolumesImageMetadata-2078187035 None] Temporary image a3efde48-babd-4b04-b205-71cd843dec16 is fetched for user dedd871130874d80944e3fec6386d626. {{(pid=87747) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 22 03:27:28 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[66627e14-853c-419e-8dea-afdf2ba3fd90]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:27:28 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-3de30358-4c41-4e25-8096-9e8b13728781 tempest-VolumesImageMetadata-2078187035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a3efde48-babd-4b04-b205-71cd843dec16_054r12wwdevstack@QuobyteHD {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:28 devstack sudo[101193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a3efde48-babd-4b04-b205-71cd843dec16_054r12wwdevstack@QuobyteHD Jul 22 03:27:28 devstack sudo[101193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:28 devstack sudo[101193]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:28 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-3de30358-4c41-4e25-8096-9e8b13728781 tempest-VolumesImageMetadata-2078187035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a3efde48-babd-4b04-b205-71cd843dec16_054r12wwdevstack@QuobyteHD" returned: 0 in 0.337s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:28 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-3de30358-4c41-4e25-8096-9e8b13728781 tempest-VolumesImageMetadata-2078187035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:27:28 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-3de30358-4c41-4e25-8096-9e8b13728781 tempest-VolumesImageMetadata-2078187035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:27:28 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-3de30358-4c41-4e25-8096-9e8b13728781 tempest-VolumesImageMetadata-2078187035 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:27:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-2053725843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da352ef4-4f5d-4bff-8d68-b3aa77a29621,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cee89be0cc984297bf8d4d50fd4f4cc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:27:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:27:27Z,use_quota=True,user_id='dedd871130874d80944e3fec6386d626',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:27:28 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-3de30358-4c41-4e25-8096-9e8b13728781 tempest-VolumesImageMetadata-2078187035 None] Creating volume da352ef4-4f5d-4bff-8d68-b3aa77a29621 {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:27:28 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-3de30358-4c41-4e25-8096-9e8b13728781 tempest-VolumesImageMetadata-2078187035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:27:28 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-3de30358-4c41-4e25-8096-9e8b13728781 tempest-VolumesImageMetadata-2078187035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:27:28 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-3de30358-4c41-4e25-8096-9e8b13728781 tempest-VolumesImageMetadata-2078187035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:27:28 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-3de30358-4c41-4e25-8096-9e8b13728781 tempest-VolumesImageMetadata-2078187035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:27:28 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-3de30358-4c41-4e25-8096-9e8b13728781 tempest-VolumesImageMetadata-2078187035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:27:28 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-3de30358-4c41-4e25-8096-9e8b13728781 tempest-VolumesImageMetadata-2078187035 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:27:28 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-3de30358-4c41-4e25-8096-9e8b13728781 tempest-VolumesImageMetadata-2078187035 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:27:28 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-3de30358-4c41-4e25-8096-9e8b13728781 tempest-VolumesImageMetadata-2078187035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-da352ef4-4f5d-4bff-8d68-b3aa77a29621 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:28 devstack sudo[101198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-da352ef4-4f5d-4bff-8d68-b3aa77a29621 1073741824 Jul 22 03:27:28 devstack sudo[101198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:29 devstack sudo[101198]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:29 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-3de30358-4c41-4e25-8096-9e8b13728781 tempest-VolumesImageMetadata-2078187035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-da352ef4-4f5d-4bff-8d68-b3aa77a29621 1073741824" returned: 0 in 0.447s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:29 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-3de30358-4c41-4e25-8096-9e8b13728781 tempest-VolumesImageMetadata-2078187035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-da352ef4-4f5d-4bff-8d68-b3aa77a29621 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:29 devstack sudo[101204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-da352ef4-4f5d-4bff-8d68-b3aa77a29621 Jul 22 03:27:29 devstack sudo[101204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:29 devstack sudo[101204]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:29 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-3de30358-4c41-4e25-8096-9e8b13728781 tempest-VolumesImageMetadata-2078187035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-da352ef4-4f5d-4bff-8d68-b3aa77a29621" returned: 0 in 0.246s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:29 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-3de30358-4c41-4e25-8096-9e8b13728781 tempest-VolumesImageMetadata-2078187035 None] <== create_volume: return (736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:27:29 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-3de30358-4c41-4e25-8096-9e8b13728781 tempest-VolumesImageMetadata-2078187035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.739s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:27:29 devstack cinder-volume[87747]: DEBUG cinder.volume.volume_utils [None req-3de30358-4c41-4e25-8096-9e8b13728781 tempest-VolumesImageMetadata-2078187035 None] Attempting download of a3efde48-babd-4b04-b205-71cd843dec16 ((None, [{'url': 'file:///opt/stack/data/glance/images/a3efde48-babd-4b04-b205-71cd843dec16', 'metadata': {}}])) to volume da352ef4-4f5d-4bff-8d68-b3aa77a29621. {{(pid=87747) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 22 03:27:29 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[75ed09b9-2d85-4677-a308-9c275f092202]: (4, 'raw') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:27:29 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-3de30358-4c41-4e25-8096-9e8b13728781 tempest-VolumesImageMetadata-2078187035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a3efde48-babd-4b04-b205-71cd843dec16_f2z3m4me {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:29 devstack sudo[101207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a3efde48-babd-4b04-b205-71cd843dec16_f2z3m4me Jul 22 03:27:29 devstack sudo[101207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:29 devstack sudo[101207]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:29 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-3de30358-4c41-4e25-8096-9e8b13728781 tempest-VolumesImageMetadata-2078187035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a3efde48-babd-4b04-b205-71cd843dec16_f2z3m4me" returned: 0 in 0.337s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:29 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-3de30358-4c41-4e25-8096-9e8b13728781 tempest-VolumesImageMetadata-2078187035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a3efde48-babd-4b04-b205-71cd843dec16_f2z3m4me {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:30 devstack sudo[101211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a3efde48-babd-4b04-b205-71cd843dec16_f2z3m4me Jul 22 03:27:30 devstack sudo[101211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:30 devstack sudo[101211]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:30 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-3de30358-4c41-4e25-8096-9e8b13728781 tempest-VolumesImageMetadata-2078187035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a3efde48-babd-4b04-b205-71cd843dec16_f2z3m4me" returned: 1 in 0.349s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:30 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-3de30358-4c41-4e25-8096-9e8b13728781 tempest-VolumesImageMetadata-2078187035 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a3efde48-babd-4b04-b205-71cd843dec16_f2z3m4me' failed. Not Retrying. {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 22 03:27:30 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[db79ec00-f6aa-4db9-882d-015f658a857f]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:27:30 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-3de30358-4c41-4e25-8096-9e8b13728781 tempest-VolumesImageMetadata-2078187035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a3efde48-babd-4b04-b205-71cd843dec16_054r12wwdevstack@QuobyteHD {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:30 devstack sudo[101215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a3efde48-babd-4b04-b205-71cd843dec16_054r12wwdevstack@QuobyteHD Jul 22 03:27:30 devstack sudo[101215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:30 devstack sudo[101215]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:30 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-3de30358-4c41-4e25-8096-9e8b13728781 tempest-VolumesImageMetadata-2078187035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a3efde48-babd-4b04-b205-71cd843dec16_054r12wwdevstack@QuobyteHD" returned: 0 in 0.364s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:30 devstack cinder-volume[87747]: DEBUG cinder.image.image_utils [None req-3de30358-4c41-4e25-8096-9e8b13728781 tempest-VolumesImageMetadata-2078187035 None] a3efde48-babd-4b04-b205-71cd843dec16 was qcow2, converting to qcow2 {{(pid=87747) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 22 03:27:30 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-3de30358-4c41-4e25-8096-9e8b13728781 tempest-VolumesImageMetadata-2078187035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a3efde48-babd-4b04-b205-71cd843dec16_054r12wwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-da352ef4-4f5d-4bff-8d68-b3aa77a29621 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:30 devstack sudo[101220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a3efde48-babd-4b04-b205-71cd843dec16_054r12wwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-da352ef4-4f5d-4bff-8d68-b3aa77a29621 Jul 22 03:27:30 devstack sudo[101220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:32 devstack sudo[101220]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:32 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-3de30358-4c41-4e25-8096-9e8b13728781 tempest-VolumesImageMetadata-2078187035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a3efde48-babd-4b04-b205-71cd843dec16_054r12wwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-da352ef4-4f5d-4bff-8d68-b3aa77a29621" returned: 0 in 1.716s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:32 devstack cinder-volume[87747]: DEBUG cinder.image.image_utils [None req-3de30358-4c41-4e25-8096-9e8b13728781 tempest-VolumesImageMetadata-2078187035 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a3efde48-babd-4b04-b205-71cd843dec16_054r12wwdevstack@QuobyteHD, size 112.00 MB, duration 1.72 sec, destination /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-da352ef4-4f5d-4bff-8d68-b3aa77a29621 {{(pid=87747) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 22 03:27:32 devstack cinder-volume[87747]: INFO cinder.image.image_utils [None req-3de30358-4c41-4e25-8096-9e8b13728781 tempest-VolumesImageMetadata-2078187035 None] Converted 112.00 MB image at 65.20 MB/s Jul 22 03:27:32 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-3de30358-4c41-4e25-8096-9e8b13728781 tempest-VolumesImageMetadata-2078187035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-da352ef4-4f5d-4bff-8d68-b3aa77a29621 1G {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:32 devstack sudo[101229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-da352ef4-4f5d-4bff-8d68-b3aa77a29621 1G Jul 22 03:27:32 devstack sudo[101229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:32 devstack sudo[101229]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:32 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-3de30358-4c41-4e25-8096-9e8b13728781 tempest-VolumesImageMetadata-2078187035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-da352ef4-4f5d-4bff-8d68-b3aa77a29621 1G" returned: 0 in 0.343s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:32 devstack cinder-volume[87747]: DEBUG cinder.volume.volume_utils [None req-3de30358-4c41-4e25-8096-9e8b13728781 tempest-VolumesImageMetadata-2078187035 None] Downloaded image a3efde48-babd-4b04-b205-71cd843dec16 ((None, [{'url': 'file:///opt/stack/data/glance/images/a3efde48-babd-4b04-b205-71cd843dec16', 'metadata': {}}])) to volume da352ef4-4f5d-4bff-8d68-b3aa77a29621 successfully. {{(pid=87747) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 22 03:27:32 devstack cinder-volume[87747]: DEBUG cinder.image.image_utils [None req-3de30358-4c41-4e25-8096-9e8b13728781 tempest-VolumesImageMetadata-2078187035 None] Temporary image a3efde48-babd-4b04-b205-71cd843dec16 for user dedd871130874d80944e3fec6386d626 is deleted. {{(pid=87747) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 22 03:27:32 devstack cinder-volume[87747]: DEBUG cinder.volume.volume_utils [None req-3de30358-4c41-4e25-8096-9e8b13728781 tempest-VolumesImageMetadata-2078187035 None] Marking volume da352ef4-4f5d-4bff-8d68-b3aa77a29621 as bootable. {{(pid=87747) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 22 03:27:32 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-3de30358-4c41-4e25-8096-9e8b13728781 tempest-VolumesImageMetadata-2078187035 None] Copying metadata from image a3efde48-babd-4b04-b205-71cd843dec16 to da352ef4-4f5d-4bff-8d68-b3aa77a29621. {{(pid=87747) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 22 03:27:32 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-3de30358-4c41-4e25-8096-9e8b13728781 tempest-VolumesImageMetadata-2078187035 None] Creating volume glance metadata for volume da352ef4-4f5d-4bff-8d68-b3aa77a29621 backed by image a3efde48-babd-4b04-b205-71cd843dec16 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'a3efde48-babd-4b04-b205-71cd843dec16', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87747) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 22 03:27:32 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-3de30358-4c41-4e25-8096-9e8b13728781 tempest-VolumesImageMetadata-2078187035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f31a3a3-c500-413b-8e69-619762563383) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da352ef4-4f5d-4bff-8d68-b3aa77a29621', 'volume_size': 1, 'image_id': 'a3efde48-babd-4b04-b205-71cd843dec16', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a3efde48-babd-4b04-b205-71cd843dec16', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '37328413017b49c4b4fe75bae83dd2ac', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a3efde48-babd-4b04-b205-71cd843dec16', 'created_at': datetime.datetime(2026, 7, 22, 1, 8, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 22, 1, 8, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a3efde48-babd-4b04-b205-71cd843dec16/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:32 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-3de30358-4c41-4e25-8096-9e8b13728781 tempest-VolumesImageMetadata-2078187035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c568c6e6-f4ca-45e3-9e4c-5c091bba3a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:32 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-3de30358-4c41-4e25-8096-9e8b13728781 tempest-VolumesImageMetadata-2078187035 None] Volume volume-da352ef4-4f5d-4bff-8d68-b3aa77a29621 (da352ef4-4f5d-4bff-8d68-b3aa77a29621): created successfully Jul 22 03:27:32 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-3de30358-4c41-4e25-8096-9e8b13728781 tempest-VolumesImageMetadata-2078187035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c568c6e6-f4ca-45e3-9e4c-5c091bba3a42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:32 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-3de30358-4c41-4e25-8096-9e8b13728781 tempest-VolumesImageMetadata-2078187035 None] Flow 'volume_create_manager' (df221c5d-012e-4083-9e73-b4b2a18b70f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:27:32 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-3de30358-4c41-4e25-8096-9e8b13728781 tempest-VolumesImageMetadata-2078187035 None] Created volume successfully. Jul 22 03:27:33 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-8c124d1d-7cb0-4309-a882-8004907730f3 tempest-VolumesImageMetadata-2078187035 None] Acquiring lock "cinder-da352ef4-4f5d-4bff-8d68-b3aa77a29621-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:27:33 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-8c124d1d-7cb0-4309-a882-8004907730f3 tempest-VolumesImageMetadata-2078187035 None] Lock "cinder-da352ef4-4f5d-4bff-8d68-b3aa77a29621-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:27:33 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-8c124d1d-7cb0-4309-a882-8004907730f3 tempest-VolumesImageMetadata-2078187035 None] Acquiring lock "cinder-quobyte-da352ef4-4f5d-4bff-8d68-b3aa77a29621" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:27:33 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-8c124d1d-7cb0-4309-a882-8004907730f3 tempest-VolumesImageMetadata-2078187035 None] Lock "cinder-quobyte-da352ef4-4f5d-4bff-8d68-b3aa77a29621" acquired by "delete_volume" :: waited 0.022s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:27:33 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[478b2829-6741-4117-aea9-a72b1de7b481]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:27:33 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-8c124d1d-7cb0-4309-a882-8004907730f3 tempest-VolumesImageMetadata-2078187035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-da352ef4-4f5d-4bff-8d68-b3aa77a29621 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:34 devstack sudo[101236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-da352ef4-4f5d-4bff-8d68-b3aa77a29621 Jul 22 03:27:34 devstack sudo[101236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:34 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-7870df7b-0da8-4887-9e00-88650e67b538 tempest-CreateVolumesFromImageTest-713888814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:27:34 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-7870df7b-0da8-4887-9e00-88650e67b538 tempest-CreateVolumesFromImageTest-713888814 None] Flow 'volume_create_manager' (09dab160-4a74-4101-90d8-78f7780ee586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:27:34 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-7870df7b-0da8-4887-9e00-88650e67b538 tempest-CreateVolumesFromImageTest-713888814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3dbcc76-82b1-4a0b-a781-07c7f8dd624d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:34 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-7870df7b-0da8-4887-9e00-88650e67b538 tempest-CreateVolumesFromImageTest-713888814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3dbcc76-82b1-4a0b-a781-07c7f8dd624d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:27:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1559738028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=885f9ea1-ad78-475e-8225-aae0a2eddda2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aeeb5a0b15ad430695d9d43bd60e109d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:27:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:27:34Z,use_quota=True,user_id='03651e83a48e4c6687774c258ab4cb99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:34 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-7870df7b-0da8-4887-9e00-88650e67b538 tempest-CreateVolumesFromImageTest-713888814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb22b71b-fb69-4dd5-8f13-cae59cc297b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:34 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-7870df7b-0da8-4887-9e00-88650e67b538 tempest-CreateVolumesFromImageTest-713888814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb22b71b-fb69-4dd5-8f13-cae59cc297b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:34 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-7870df7b-0da8-4887-9e00-88650e67b538 tempest-CreateVolumesFromImageTest-713888814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29cd0232-c468-4920-bf81-de427b803701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:34 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-7870df7b-0da8-4887-9e00-88650e67b538 tempest-CreateVolumesFromImageTest-713888814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29cd0232-c468-4920-bf81-de427b803701) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '885f9ea1-ad78-475e-8225-aae0a2eddda2', 'volume_name': 'volume-885f9ea1-ad78-475e-8225-aae0a2eddda2', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:34 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-7870df7b-0da8-4887-9e00-88650e67b538 tempest-CreateVolumesFromImageTest-713888814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (612128e2-1d1e-495b-9004-bff2227ca32a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:34 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-7870df7b-0da8-4887-9e00-88650e67b538 tempest-CreateVolumesFromImageTest-713888814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (612128e2-1d1e-495b-9004-bff2227ca32a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:34 devstack sudo[101236]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:34 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-7870df7b-0da8-4887-9e00-88650e67b538 tempest-CreateVolumesFromImageTest-713888814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (541ae970-db5c-4fc6-ab73-e4e73c547e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:34 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-7870df7b-0da8-4887-9e00-88650e67b538 tempest-CreateVolumesFromImageTest-713888814 None] Volume 885f9ea1-ad78-475e-8225-aae0a2eddda2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-885f9ea1-ad78-475e-8225-aae0a2eddda2', 'volume_size': 1} Jul 22 03:27:34 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-7870df7b-0da8-4887-9e00-88650e67b538 tempest-CreateVolumesFromImageTest-713888814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:27:34 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-7870df7b-0da8-4887-9e00-88650e67b538 tempest-CreateVolumesFromImageTest-713888814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:27:34 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-7870df7b-0da8-4887-9e00-88650e67b538 tempest-CreateVolumesFromImageTest-713888814 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:27:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1559738028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=885f9ea1-ad78-475e-8225-aae0a2eddda2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aeeb5a0b15ad430695d9d43bd60e109d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:27:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:27:34Z,use_quota=True,user_id='03651e83a48e4c6687774c258ab4cb99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:27:34 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-7870df7b-0da8-4887-9e00-88650e67b538 tempest-CreateVolumesFromImageTest-713888814 None] Creating volume 885f9ea1-ad78-475e-8225-aae0a2eddda2 {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:27:34 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-7870df7b-0da8-4887-9e00-88650e67b538 tempest-CreateVolumesFromImageTest-713888814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:27:34 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-7870df7b-0da8-4887-9e00-88650e67b538 tempest-CreateVolumesFromImageTest-713888814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:27:34 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-7870df7b-0da8-4887-9e00-88650e67b538 tempest-CreateVolumesFromImageTest-713888814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:27:34 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-7870df7b-0da8-4887-9e00-88650e67b538 tempest-CreateVolumesFromImageTest-713888814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:27:34 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-7870df7b-0da8-4887-9e00-88650e67b538 tempest-CreateVolumesFromImageTest-713888814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:27:34 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-7870df7b-0da8-4887-9e00-88650e67b538 tempest-CreateVolumesFromImageTest-713888814 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:27:34 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-7870df7b-0da8-4887-9e00-88650e67b538 tempest-CreateVolumesFromImageTest-713888814 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:27:34 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-7870df7b-0da8-4887-9e00-88650e67b538 tempest-CreateVolumesFromImageTest-713888814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-885f9ea1-ad78-475e-8225-aae0a2eddda2 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:34 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-8c124d1d-7cb0-4309-a882-8004907730f3 tempest-VolumesImageMetadata-2078187035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-da352ef4-4f5d-4bff-8d68-b3aa77a29621" returned: 0 in 0.429s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:34 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-8c124d1d-7cb0-4309-a882-8004907730f3 tempest-VolumesImageMetadata-2078187035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-da352ef4-4f5d-4bff-8d68-b3aa77a29621 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:34 devstack sudo[101241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-885f9ea1-ad78-475e-8225-aae0a2eddda2 1073741824 Jul 22 03:27:34 devstack sudo[101241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:34 devstack sudo[101242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-da352ef4-4f5d-4bff-8d68-b3aa77a29621 Jul 22 03:27:34 devstack sudo[101242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:34 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd110cac-67a1-4d2f-9ad0-fb9b40cedacd tempest-CreateVolumesFromImageTest-713888814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:27:34 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-dd110cac-67a1-4d2f-9ad0-fb9b40cedacd tempest-CreateVolumesFromImageTest-713888814 None] Flow 'volume_create_manager' (345f8bb5-39aa-44a3-aca1-edde5628e675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:27:34 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-dd110cac-67a1-4d2f-9ad0-fb9b40cedacd tempest-CreateVolumesFromImageTest-713888814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e3f1fb1-607d-42a6-b017-ae393515f220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:34 devstack sudo[101242]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:34 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-8c124d1d-7cb0-4309-a882-8004907730f3 tempest-VolumesImageMetadata-2078187035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-da352ef4-4f5d-4bff-8d68-b3aa77a29621" returned: 0 in 0.296s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:34 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-dd110cac-67a1-4d2f-9ad0-fb9b40cedacd tempest-CreateVolumesFromImageTest-713888814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e3f1fb1-607d-42a6-b017-ae393515f220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:27:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-203021934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9084e0c0-c5a7-4a01-bf7f-1793f0b1f67d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aeeb5a0b15ad430695d9d43bd60e109d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:27:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:27:35Z,use_quota=True,user_id='03651e83a48e4c6687774c258ab4cb99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:34 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-dd110cac-67a1-4d2f-9ad0-fb9b40cedacd tempest-CreateVolumesFromImageTest-713888814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db5f1d4b-6ffb-4c97-880f-a81f2fdc0b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:34 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-dd110cac-67a1-4d2f-9ad0-fb9b40cedacd tempest-CreateVolumesFromImageTest-713888814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db5f1d4b-6ffb-4c97-880f-a81f2fdc0b32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:34 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-dd110cac-67a1-4d2f-9ad0-fb9b40cedacd tempest-CreateVolumesFromImageTest-713888814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fabd808-6e23-4274-9172-37dc7acc1ab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:34 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-dd110cac-67a1-4d2f-9ad0-fb9b40cedacd tempest-CreateVolumesFromImageTest-713888814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fabd808-6e23-4274-9172-37dc7acc1ab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9084e0c0-c5a7-4a01-bf7f-1793f0b1f67d', 'volume_name': 'volume-9084e0c0-c5a7-4a01-bf7f-1793f0b1f67d', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:34 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-dd110cac-67a1-4d2f-9ad0-fb9b40cedacd tempest-CreateVolumesFromImageTest-713888814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ec3909f-dd72-4dd7-844d-3d3ef5710b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:34 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-dd110cac-67a1-4d2f-9ad0-fb9b40cedacd tempest-CreateVolumesFromImageTest-713888814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ec3909f-dd72-4dd7-844d-3d3ef5710b4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:34 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-dd110cac-67a1-4d2f-9ad0-fb9b40cedacd tempest-CreateVolumesFromImageTest-713888814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e023026d-33cf-4b2e-80e1-376ceb9a9774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:34 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-dd110cac-67a1-4d2f-9ad0-fb9b40cedacd tempest-CreateVolumesFromImageTest-713888814 None] Volume 9084e0c0-c5a7-4a01-bf7f-1793f0b1f67d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9084e0c0-c5a7-4a01-bf7f-1793f0b1f67d', 'volume_size': 1} Jul 22 03:27:34 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-dd110cac-67a1-4d2f-9ad0-fb9b40cedacd tempest-CreateVolumesFromImageTest-713888814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:27:34 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-8c124d1d-7cb0-4309-a882-8004907730f3 tempest-VolumesImageMetadata-2078187035 None] Lock "cinder-quobyte-da352ef4-4f5d-4bff-8d68-b3aa77a29621" released by "delete_volume" :: held 0.819s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:27:34 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-8c124d1d-7cb0-4309-a882-8004907730f3 tempest-VolumesImageMetadata-2078187035 None] Created reservations ['e0e42d6c-4c2b-4dd4-a6f9-4c233be41d09', '3c68ba9b-a488-43d9-a210-07b5c7bb648a', '60e2079d-acc5-43e0-affb-0420f2d8c976', '7fb1a4ce-eef4-4e52-9404-a1dcf776ccaa'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:27:34 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-8c124d1d-7cb0-4309-a882-8004907730f3 tempest-VolumesImageMetadata-2078187035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:27:34 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-8c124d1d-7cb0-4309-a882-8004907730f3 tempest-VolumesImageMetadata-2078187035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:27:34 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-8c124d1d-7cb0-4309-a882-8004907730f3 tempest-VolumesImageMetadata-2078187035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:27:34 devstack sudo[101241]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:34 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-8c124d1d-7cb0-4309-a882-8004907730f3 tempest-VolumesImageMetadata-2078187035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:27:34 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-8c124d1d-7cb0-4309-a882-8004907730f3 tempest-VolumesImageMetadata-2078187035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:27:34 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-8c124d1d-7cb0-4309-a882-8004907730f3 tempest-VolumesImageMetadata-2078187035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:34 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-7870df7b-0da8-4887-9e00-88650e67b538 tempest-CreateVolumesFromImageTest-713888814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-885f9ea1-ad78-475e-8225-aae0a2eddda2 1073741824" returned: 0 in 0.555s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:34 devstack sudo[101250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:27:34 devstack sudo[101250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:35 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-7870df7b-0da8-4887-9e00-88650e67b538 tempest-CreateVolumesFromImageTest-713888814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-885f9ea1-ad78-475e-8225-aae0a2eddda2 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:35 devstack sudo[101252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-885f9ea1-ad78-475e-8225-aae0a2eddda2 Jul 22 03:27:35 devstack sudo[101252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:35 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-6dac4ed5-b599-4c1b-b8df-79b97d3d4690 tempest-CreateVolumesFromImageTest-713888814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:27:35 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-6dac4ed5-b599-4c1b-b8df-79b97d3d4690 tempest-CreateVolumesFromImageTest-713888814 None] Flow 'volume_create_manager' (c59d4401-b698-48c5-9d4d-361a12d2f037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:27:35 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-6dac4ed5-b599-4c1b-b8df-79b97d3d4690 tempest-CreateVolumesFromImageTest-713888814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7498620f-83be-4e67-be8a-79ad3af43b04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:35 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-6dac4ed5-b599-4c1b-b8df-79b97d3d4690 tempest-CreateVolumesFromImageTest-713888814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7498620f-83be-4e67-be8a-79ad3af43b04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:27:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1194371590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd169255-2d22-4a79-bd91-aa83aee7c52f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aeeb5a0b15ad430695d9d43bd60e109d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:27:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:27:35Z,use_quota=True,user_id='03651e83a48e4c6687774c258ab4cb99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:35 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-6dac4ed5-b599-4c1b-b8df-79b97d3d4690 tempest-CreateVolumesFromImageTest-713888814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6b9a857-f46e-4fff-93d0-8b39a1574a60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:35 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-6dac4ed5-b599-4c1b-b8df-79b97d3d4690 tempest-CreateVolumesFromImageTest-713888814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6b9a857-f46e-4fff-93d0-8b39a1574a60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:35 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-6dac4ed5-b599-4c1b-b8df-79b97d3d4690 tempest-CreateVolumesFromImageTest-713888814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (056b3b62-a8d8-4b69-a4a2-3051e6b0add9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:35 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-6dac4ed5-b599-4c1b-b8df-79b97d3d4690 tempest-CreateVolumesFromImageTest-713888814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (056b3b62-a8d8-4b69-a4a2-3051e6b0add9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd169255-2d22-4a79-bd91-aa83aee7c52f', 'volume_name': 'volume-bd169255-2d22-4a79-bd91-aa83aee7c52f', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:35 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-6dac4ed5-b599-4c1b-b8df-79b97d3d4690 tempest-CreateVolumesFromImageTest-713888814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8b53bdd-c000-4d2e-ad24-c04fcba19226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:35 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-6dac4ed5-b599-4c1b-b8df-79b97d3d4690 tempest-CreateVolumesFromImageTest-713888814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8b53bdd-c000-4d2e-ad24-c04fcba19226) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:35 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-6dac4ed5-b599-4c1b-b8df-79b97d3d4690 tempest-CreateVolumesFromImageTest-713888814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbb0a042-1c42-440c-8142-94f57d9fa085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:35 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-6dac4ed5-b599-4c1b-b8df-79b97d3d4690 tempest-CreateVolumesFromImageTest-713888814 None] Volume bd169255-2d22-4a79-bd91-aa83aee7c52f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd169255-2d22-4a79-bd91-aa83aee7c52f', 'volume_size': 1} Jul 22 03:27:35 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-6dac4ed5-b599-4c1b-b8df-79b97d3d4690 tempest-CreateVolumesFromImageTest-713888814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:27:35 devstack sudo[101250]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:35 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-8c124d1d-7cb0-4309-a882-8004907730f3 tempest-VolumesImageMetadata-2078187035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.357s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:35 devstack sudo[101252]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:35 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-8c124d1d-7cb0-4309-a882-8004907730f3 tempest-VolumesImageMetadata-2078187035 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:27:35 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-8c124d1d-7cb0-4309-a882-8004907730f3 tempest-VolumesImageMetadata-2078187035 None] Deleted volume successfully. Jul 22 03:27:35 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-7870df7b-0da8-4887-9e00-88650e67b538 tempest-CreateVolumesFromImageTest-713888814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-885f9ea1-ad78-475e-8225-aae0a2eddda2" returned: 0 in 0.315s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:35 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-7870df7b-0da8-4887-9e00-88650e67b538 tempest-CreateVolumesFromImageTest-713888814 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:27:35 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-7870df7b-0da8-4887-9e00-88650e67b538 tempest-CreateVolumesFromImageTest-713888814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.929s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:27:35 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-dd110cac-67a1-4d2f-9ad0-fb9b40cedacd tempest-CreateVolumesFromImageTest-713888814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.553s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:27:35 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-dd110cac-67a1-4d2f-9ad0-fb9b40cedacd tempest-CreateVolumesFromImageTest-713888814 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:27:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-203021934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9084e0c0-c5a7-4a01-bf7f-1793f0b1f67d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aeeb5a0b15ad430695d9d43bd60e109d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:27:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:27:35Z,use_quota=True,user_id='03651e83a48e4c6687774c258ab4cb99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:27:35 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-dd110cac-67a1-4d2f-9ad0-fb9b40cedacd tempest-CreateVolumesFromImageTest-713888814 None] Creating volume 9084e0c0-c5a7-4a01-bf7f-1793f0b1f67d {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:27:35 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-dd110cac-67a1-4d2f-9ad0-fb9b40cedacd tempest-CreateVolumesFromImageTest-713888814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:27:35 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-dd110cac-67a1-4d2f-9ad0-fb9b40cedacd tempest-CreateVolumesFromImageTest-713888814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:27:35 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-dd110cac-67a1-4d2f-9ad0-fb9b40cedacd tempest-CreateVolumesFromImageTest-713888814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:27:35 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-dd110cac-67a1-4d2f-9ad0-fb9b40cedacd tempest-CreateVolumesFromImageTest-713888814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:27:35 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-dd110cac-67a1-4d2f-9ad0-fb9b40cedacd tempest-CreateVolumesFromImageTest-713888814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:27:35 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-dd110cac-67a1-4d2f-9ad0-fb9b40cedacd tempest-CreateVolumesFromImageTest-713888814 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:27:35 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-dd110cac-67a1-4d2f-9ad0-fb9b40cedacd tempest-CreateVolumesFromImageTest-713888814 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:27:35 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-dd110cac-67a1-4d2f-9ad0-fb9b40cedacd tempest-CreateVolumesFromImageTest-713888814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9084e0c0-c5a7-4a01-bf7f-1793f0b1f67d 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:35 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-7870df7b-0da8-4887-9e00-88650e67b538 tempest-CreateVolumesFromImageTest-713888814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (541ae970-db5c-4fc6-ab73-e4e73c547e5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-885f9ea1-ad78-475e-8225-aae0a2eddda2', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:35 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-7870df7b-0da8-4887-9e00-88650e67b538 tempest-CreateVolumesFromImageTest-713888814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09ea69af-21bc-4673-8116-02f7c546eaa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:35 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-8c124d1d-7cb0-4309-a882-8004907730f3 tempest-VolumesImageMetadata-2078187035 None] Lock "cinder-da352ef4-4f5d-4bff-8d68-b3aa77a29621-delete_volume" released by "delete_volume" :: held 1.485s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:27:35 devstack sudo[101256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9084e0c0-c5a7-4a01-bf7f-1793f0b1f67d 1073741824 Jul 22 03:27:35 devstack sudo[101256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:35 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-7870df7b-0da8-4887-9e00-88650e67b538 tempest-CreateVolumesFromImageTest-713888814 None] Volume volume-885f9ea1-ad78-475e-8225-aae0a2eddda2 (885f9ea1-ad78-475e-8225-aae0a2eddda2): created successfully Jul 22 03:27:35 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-7870df7b-0da8-4887-9e00-88650e67b538 tempest-CreateVolumesFromImageTest-713888814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09ea69af-21bc-4673-8116-02f7c546eaa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:35 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-7870df7b-0da8-4887-9e00-88650e67b538 tempest-CreateVolumesFromImageTest-713888814 None] Flow 'volume_create_manager' (09dab160-4a74-4101-90d8-78f7780ee586) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:27:35 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-7870df7b-0da8-4887-9e00-88650e67b538 tempest-CreateVolumesFromImageTest-713888814 None] Created volume successfully. Jul 22 03:27:35 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-5862b7f6-dd86-4c05-a4ce-e05aa4e98cc3 tempest-CreateVolumesFromImageTest-713888814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:27:35 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-5862b7f6-dd86-4c05-a4ce-e05aa4e98cc3 tempest-CreateVolumesFromImageTest-713888814 None] Flow 'volume_create_manager' (b90b376e-f803-4548-8369-ddb96b54387b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:27:35 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-5862b7f6-dd86-4c05-a4ce-e05aa4e98cc3 tempest-CreateVolumesFromImageTest-713888814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c4226ac-4b2b-4181-b727-e72db57f9f4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:35 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-5862b7f6-dd86-4c05-a4ce-e05aa4e98cc3 tempest-CreateVolumesFromImageTest-713888814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c4226ac-4b2b-4181-b727-e72db57f9f4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:27:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-327040819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=932cecaa-263c-43c2-9b2d-585550daaf57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aeeb5a0b15ad430695d9d43bd60e109d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:27:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:27:36Z,use_quota=True,user_id='03651e83a48e4c6687774c258ab4cb99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:35 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-5862b7f6-dd86-4c05-a4ce-e05aa4e98cc3 tempest-CreateVolumesFromImageTest-713888814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (681e9abc-11c7-41d4-b921-00c44e8e49f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:35 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-5862b7f6-dd86-4c05-a4ce-e05aa4e98cc3 tempest-CreateVolumesFromImageTest-713888814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (681e9abc-11c7-41d4-b921-00c44e8e49f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:35 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-5862b7f6-dd86-4c05-a4ce-e05aa4e98cc3 tempest-CreateVolumesFromImageTest-713888814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fad922b8-a5ff-4908-829b-b6738eb2d71d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:35 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-5862b7f6-dd86-4c05-a4ce-e05aa4e98cc3 tempest-CreateVolumesFromImageTest-713888814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fad922b8-a5ff-4908-829b-b6738eb2d71d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '932cecaa-263c-43c2-9b2d-585550daaf57', 'volume_name': 'volume-932cecaa-263c-43c2-9b2d-585550daaf57', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:35 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-5862b7f6-dd86-4c05-a4ce-e05aa4e98cc3 tempest-CreateVolumesFromImageTest-713888814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e2c363f-ae1e-4968-8525-1ccbc0927530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:35 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-5862b7f6-dd86-4c05-a4ce-e05aa4e98cc3 tempest-CreateVolumesFromImageTest-713888814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e2c363f-ae1e-4968-8525-1ccbc0927530) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:35 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-5862b7f6-dd86-4c05-a4ce-e05aa4e98cc3 tempest-CreateVolumesFromImageTest-713888814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7eb259cd-0862-4130-9436-45604749d22f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:35 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-5862b7f6-dd86-4c05-a4ce-e05aa4e98cc3 tempest-CreateVolumesFromImageTest-713888814 None] Volume 932cecaa-263c-43c2-9b2d-585550daaf57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-932cecaa-263c-43c2-9b2d-585550daaf57', 'volume_size': 1} Jul 22 03:27:35 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-5862b7f6-dd86-4c05-a4ce-e05aa4e98cc3 tempest-CreateVolumesFromImageTest-713888814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:27:36 devstack sudo[101256]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:36 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-dd110cac-67a1-4d2f-9ad0-fb9b40cedacd tempest-CreateVolumesFromImageTest-713888814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9084e0c0-c5a7-4a01-bf7f-1793f0b1f67d 1073741824" returned: 0 in 0.689s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:36 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-dd110cac-67a1-4d2f-9ad0-fb9b40cedacd tempest-CreateVolumesFromImageTest-713888814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9084e0c0-c5a7-4a01-bf7f-1793f0b1f67d {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:36 devstack sudo[101296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9084e0c0-c5a7-4a01-bf7f-1793f0b1f67d Jul 22 03:27:36 devstack sudo[101296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:36 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-2632041e-8f41-4fc3-b886-b1c73597409b tempest-CreateVolumesFromImageTest-713888814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:27:36 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2632041e-8f41-4fc3-b886-b1c73597409b tempest-CreateVolumesFromImageTest-713888814 None] Flow 'volume_create_manager' (9e7b78db-fb62-43d2-9c37-5c855ff5e485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:27:36 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2632041e-8f41-4fc3-b886-b1c73597409b tempest-CreateVolumesFromImageTest-713888814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2322215-3768-45cc-80ef-b03ca5e75e80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:36 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2632041e-8f41-4fc3-b886-b1c73597409b tempest-CreateVolumesFromImageTest-713888814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2322215-3768-45cc-80ef-b03ca5e75e80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:27:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1388719772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f08644d7-1667-497d-a672-ee7171aa39cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aeeb5a0b15ad430695d9d43bd60e109d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:27:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:27:36Z,use_quota=True,user_id='03651e83a48e4c6687774c258ab4cb99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:36 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2632041e-8f41-4fc3-b886-b1c73597409b tempest-CreateVolumesFromImageTest-713888814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64fa9593-0080-499f-915a-b1a0ae325f1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:36 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2632041e-8f41-4fc3-b886-b1c73597409b tempest-CreateVolumesFromImageTest-713888814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64fa9593-0080-499f-915a-b1a0ae325f1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:36 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2632041e-8f41-4fc3-b886-b1c73597409b tempest-CreateVolumesFromImageTest-713888814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77d83aad-8d28-4258-aa07-bbb9285c563b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:36 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2632041e-8f41-4fc3-b886-b1c73597409b tempest-CreateVolumesFromImageTest-713888814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77d83aad-8d28-4258-aa07-bbb9285c563b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f08644d7-1667-497d-a672-ee7171aa39cd', 'volume_name': 'volume-f08644d7-1667-497d-a672-ee7171aa39cd', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:36 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2632041e-8f41-4fc3-b886-b1c73597409b tempest-CreateVolumesFromImageTest-713888814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5eb0ac7b-66f6-4396-897a-18e3b08da709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:36 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2632041e-8f41-4fc3-b886-b1c73597409b tempest-CreateVolumesFromImageTest-713888814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5eb0ac7b-66f6-4396-897a-18e3b08da709) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:36 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2632041e-8f41-4fc3-b886-b1c73597409b tempest-CreateVolumesFromImageTest-713888814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92aba6a8-eb56-41e0-a80b-9625d08f22c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:36 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-2632041e-8f41-4fc3-b886-b1c73597409b tempest-CreateVolumesFromImageTest-713888814 None] Volume f08644d7-1667-497d-a672-ee7171aa39cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f08644d7-1667-497d-a672-ee7171aa39cd', 'volume_size': 1} Jul 22 03:27:36 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-2632041e-8f41-4fc3-b886-b1c73597409b tempest-CreateVolumesFromImageTest-713888814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:27:36 devstack sudo[101296]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:36 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-dd110cac-67a1-4d2f-9ad0-fb9b40cedacd tempest-CreateVolumesFromImageTest-713888814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9084e0c0-c5a7-4a01-bf7f-1793f0b1f67d" returned: 0 in 0.281s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:36 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-dd110cac-67a1-4d2f-9ad0-fb9b40cedacd tempest-CreateVolumesFromImageTest-713888814 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:27:36 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-dd110cac-67a1-4d2f-9ad0-fb9b40cedacd tempest-CreateVolumesFromImageTest-713888814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.028s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:27:36 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-6dac4ed5-b599-4c1b-b8df-79b97d3d4690 tempest-CreateVolumesFromImageTest-713888814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.188s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:27:36 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-6dac4ed5-b599-4c1b-b8df-79b97d3d4690 tempest-CreateVolumesFromImageTest-713888814 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:27:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1194371590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd169255-2d22-4a79-bd91-aa83aee7c52f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aeeb5a0b15ad430695d9d43bd60e109d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:27:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:27:35Z,use_quota=True,user_id='03651e83a48e4c6687774c258ab4cb99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:27:36 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-6dac4ed5-b599-4c1b-b8df-79b97d3d4690 tempest-CreateVolumesFromImageTest-713888814 None] Creating volume bd169255-2d22-4a79-bd91-aa83aee7c52f {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:27:36 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-6dac4ed5-b599-4c1b-b8df-79b97d3d4690 tempest-CreateVolumesFromImageTest-713888814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:27:36 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-6dac4ed5-b599-4c1b-b8df-79b97d3d4690 tempest-CreateVolumesFromImageTest-713888814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:27:36 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-6dac4ed5-b599-4c1b-b8df-79b97d3d4690 tempest-CreateVolumesFromImageTest-713888814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:27:36 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-6dac4ed5-b599-4c1b-b8df-79b97d3d4690 tempest-CreateVolumesFromImageTest-713888814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:27:36 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-6dac4ed5-b599-4c1b-b8df-79b97d3d4690 tempest-CreateVolumesFromImageTest-713888814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:27:36 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-6dac4ed5-b599-4c1b-b8df-79b97d3d4690 tempest-CreateVolumesFromImageTest-713888814 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:27:36 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-6dac4ed5-b599-4c1b-b8df-79b97d3d4690 tempest-CreateVolumesFromImageTest-713888814 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:27:36 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-6dac4ed5-b599-4c1b-b8df-79b97d3d4690 tempest-CreateVolumesFromImageTest-713888814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-bd169255-2d22-4a79-bd91-aa83aee7c52f 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:36 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-dd110cac-67a1-4d2f-9ad0-fb9b40cedacd tempest-CreateVolumesFromImageTest-713888814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e023026d-33cf-4b2e-80e1-376ceb9a9774) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9084e0c0-c5a7-4a01-bf7f-1793f0b1f67d', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:36 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-dd110cac-67a1-4d2f-9ad0-fb9b40cedacd tempest-CreateVolumesFromImageTest-713888814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5876ebc9-0439-439f-99f4-6574869fdcaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:36 devstack sudo[101301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-bd169255-2d22-4a79-bd91-aa83aee7c52f 1073741824 Jul 22 03:27:36 devstack sudo[101301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:36 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-dd110cac-67a1-4d2f-9ad0-fb9b40cedacd tempest-CreateVolumesFromImageTest-713888814 None] Volume volume-9084e0c0-c5a7-4a01-bf7f-1793f0b1f67d (9084e0c0-c5a7-4a01-bf7f-1793f0b1f67d): created successfully Jul 22 03:27:36 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-dd110cac-67a1-4d2f-9ad0-fb9b40cedacd tempest-CreateVolumesFromImageTest-713888814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5876ebc9-0439-439f-99f4-6574869fdcaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:36 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-dd110cac-67a1-4d2f-9ad0-fb9b40cedacd tempest-CreateVolumesFromImageTest-713888814 None] Flow 'volume_create_manager' (345f8bb5-39aa-44a3-aca1-edde5628e675) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:27:36 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-dd110cac-67a1-4d2f-9ad0-fb9b40cedacd tempest-CreateVolumesFromImageTest-713888814 None] Created volume successfully. Jul 22 03:27:36 devstack sudo[101301]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:36 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-6dac4ed5-b599-4c1b-b8df-79b97d3d4690 tempest-CreateVolumesFromImageTest-713888814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-bd169255-2d22-4a79-bd91-aa83aee7c52f 1073741824" returned: 0 in 0.486s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:36 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-6dac4ed5-b599-4c1b-b8df-79b97d3d4690 tempest-CreateVolumesFromImageTest-713888814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-bd169255-2d22-4a79-bd91-aa83aee7c52f {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:36 devstack sudo[101307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-bd169255-2d22-4a79-bd91-aa83aee7c52f Jul 22 03:27:36 devstack sudo[101307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:37 devstack sudo[101307]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:37 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-6dac4ed5-b599-4c1b-b8df-79b97d3d4690 tempest-CreateVolumesFromImageTest-713888814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-bd169255-2d22-4a79-bd91-aa83aee7c52f" returned: 0 in 0.264s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:37 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-6dac4ed5-b599-4c1b-b8df-79b97d3d4690 tempest-CreateVolumesFromImageTest-713888814 None] <== create_volume: return (794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:27:37 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-6dac4ed5-b599-4c1b-b8df-79b97d3d4690 tempest-CreateVolumesFromImageTest-713888814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.798s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:27:37 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-5862b7f6-dd86-4c05-a4ce-e05aa4e98cc3 tempest-CreateVolumesFromImageTest-713888814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.314s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:27:37 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-5862b7f6-dd86-4c05-a4ce-e05aa4e98cc3 tempest-CreateVolumesFromImageTest-713888814 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:27:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-327040819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=932cecaa-263c-43c2-9b2d-585550daaf57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aeeb5a0b15ad430695d9d43bd60e109d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:27:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:27:36Z,use_quota=True,user_id='03651e83a48e4c6687774c258ab4cb99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:27:37 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-5862b7f6-dd86-4c05-a4ce-e05aa4e98cc3 tempest-CreateVolumesFromImageTest-713888814 None] Creating volume 932cecaa-263c-43c2-9b2d-585550daaf57 {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:27:37 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-5862b7f6-dd86-4c05-a4ce-e05aa4e98cc3 tempest-CreateVolumesFromImageTest-713888814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:27:37 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-5862b7f6-dd86-4c05-a4ce-e05aa4e98cc3 tempest-CreateVolumesFromImageTest-713888814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:27:37 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-5862b7f6-dd86-4c05-a4ce-e05aa4e98cc3 tempest-CreateVolumesFromImageTest-713888814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:27:37 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-5862b7f6-dd86-4c05-a4ce-e05aa4e98cc3 tempest-CreateVolumesFromImageTest-713888814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:27:37 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-5862b7f6-dd86-4c05-a4ce-e05aa4e98cc3 tempest-CreateVolumesFromImageTest-713888814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:27:37 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-5862b7f6-dd86-4c05-a4ce-e05aa4e98cc3 tempest-CreateVolumesFromImageTest-713888814 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:27:37 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-5862b7f6-dd86-4c05-a4ce-e05aa4e98cc3 tempest-CreateVolumesFromImageTest-713888814 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:27:37 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5862b7f6-dd86-4c05-a4ce-e05aa4e98cc3 tempest-CreateVolumesFromImageTest-713888814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-932cecaa-263c-43c2-9b2d-585550daaf57 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:37 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-6dac4ed5-b599-4c1b-b8df-79b97d3d4690 tempest-CreateVolumesFromImageTest-713888814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbb0a042-1c42-440c-8142-94f57d9fa085) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd169255-2d22-4a79-bd91-aa83aee7c52f', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:37 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-6dac4ed5-b599-4c1b-b8df-79b97d3d4690 tempest-CreateVolumesFromImageTest-713888814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67e7c4a2-809a-4507-8127-193cd2be1849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:37 devstack sudo[101310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-932cecaa-263c-43c2-9b2d-585550daaf57 1073741824 Jul 22 03:27:37 devstack sudo[101310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:37 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-6dac4ed5-b599-4c1b-b8df-79b97d3d4690 tempest-CreateVolumesFromImageTest-713888814 None] Volume volume-bd169255-2d22-4a79-bd91-aa83aee7c52f (bd169255-2d22-4a79-bd91-aa83aee7c52f): created successfully Jul 22 03:27:37 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-6dac4ed5-b599-4c1b-b8df-79b97d3d4690 tempest-CreateVolumesFromImageTest-713888814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67e7c4a2-809a-4507-8127-193cd2be1849) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:37 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-6dac4ed5-b599-4c1b-b8df-79b97d3d4690 tempest-CreateVolumesFromImageTest-713888814 None] Flow 'volume_create_manager' (c59d4401-b698-48c5-9d4d-361a12d2f037) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:27:37 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-6dac4ed5-b599-4c1b-b8df-79b97d3d4690 tempest-CreateVolumesFromImageTest-713888814 None] Created volume successfully. Jul 22 03:27:37 devstack sudo[101310]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:37 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5862b7f6-dd86-4c05-a4ce-e05aa4e98cc3 tempest-CreateVolumesFromImageTest-713888814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-932cecaa-263c-43c2-9b2d-585550daaf57 1073741824" returned: 0 in 0.436s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:37 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5862b7f6-dd86-4c05-a4ce-e05aa4e98cc3 tempest-CreateVolumesFromImageTest-713888814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-932cecaa-263c-43c2-9b2d-585550daaf57 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:37 devstack sudo[101316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-932cecaa-263c-43c2-9b2d-585550daaf57 Jul 22 03:27:37 devstack sudo[101316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:37 devstack sudo[101316]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:37 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5862b7f6-dd86-4c05-a4ce-e05aa4e98cc3 tempest-CreateVolumesFromImageTest-713888814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-932cecaa-263c-43c2-9b2d-585550daaf57" returned: 0 in 0.257s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:37 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-5862b7f6-dd86-4c05-a4ce-e05aa4e98cc3 tempest-CreateVolumesFromImageTest-713888814 None] <== create_volume: return (735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:27:37 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-5862b7f6-dd86-4c05-a4ce-e05aa4e98cc3 tempest-CreateVolumesFromImageTest-713888814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.738s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:27:37 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-2632041e-8f41-4fc3-b886-b1c73597409b tempest-CreateVolumesFromImageTest-713888814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.622s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:27:37 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-2632041e-8f41-4fc3-b886-b1c73597409b tempest-CreateVolumesFromImageTest-713888814 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:27:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1388719772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f08644d7-1667-497d-a672-ee7171aa39cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aeeb5a0b15ad430695d9d43bd60e109d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:27:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:27:36Z,use_quota=True,user_id='03651e83a48e4c6687774c258ab4cb99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:27:37 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-2632041e-8f41-4fc3-b886-b1c73597409b tempest-CreateVolumesFromImageTest-713888814 None] Creating volume f08644d7-1667-497d-a672-ee7171aa39cd {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:27:37 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-2632041e-8f41-4fc3-b886-b1c73597409b tempest-CreateVolumesFromImageTest-713888814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:27:37 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-2632041e-8f41-4fc3-b886-b1c73597409b tempest-CreateVolumesFromImageTest-713888814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:27:37 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-2632041e-8f41-4fc3-b886-b1c73597409b tempest-CreateVolumesFromImageTest-713888814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:27:37 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-2632041e-8f41-4fc3-b886-b1c73597409b tempest-CreateVolumesFromImageTest-713888814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:27:37 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-2632041e-8f41-4fc3-b886-b1c73597409b tempest-CreateVolumesFromImageTest-713888814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:27:37 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-2632041e-8f41-4fc3-b886-b1c73597409b tempest-CreateVolumesFromImageTest-713888814 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:27:37 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-2632041e-8f41-4fc3-b886-b1c73597409b tempest-CreateVolumesFromImageTest-713888814 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:27:37 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2632041e-8f41-4fc3-b886-b1c73597409b tempest-CreateVolumesFromImageTest-713888814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-f08644d7-1667-497d-a672-ee7171aa39cd 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:37 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-5862b7f6-dd86-4c05-a4ce-e05aa4e98cc3 tempest-CreateVolumesFromImageTest-713888814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7eb259cd-0862-4130-9436-45604749d22f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-932cecaa-263c-43c2-9b2d-585550daaf57', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:37 devstack sudo[101319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-f08644d7-1667-497d-a672-ee7171aa39cd 1073741824 Jul 22 03:27:37 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-5862b7f6-dd86-4c05-a4ce-e05aa4e98cc3 tempest-CreateVolumesFromImageTest-713888814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a521c97a-13a3-4c5b-8eae-7ac2f5286615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:37 devstack sudo[101319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:37 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-5862b7f6-dd86-4c05-a4ce-e05aa4e98cc3 tempest-CreateVolumesFromImageTest-713888814 None] Volume volume-932cecaa-263c-43c2-9b2d-585550daaf57 (932cecaa-263c-43c2-9b2d-585550daaf57): created successfully Jul 22 03:27:37 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-5862b7f6-dd86-4c05-a4ce-e05aa4e98cc3 tempest-CreateVolumesFromImageTest-713888814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a521c97a-13a3-4c5b-8eae-7ac2f5286615) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:37 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-5862b7f6-dd86-4c05-a4ce-e05aa4e98cc3 tempest-CreateVolumesFromImageTest-713888814 None] Flow 'volume_create_manager' (b90b376e-f803-4548-8369-ddb96b54387b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:27:37 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-5862b7f6-dd86-4c05-a4ce-e05aa4e98cc3 tempest-CreateVolumesFromImageTest-713888814 None] Created volume successfully. Jul 22 03:27:38 devstack sudo[101319]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:38 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2632041e-8f41-4fc3-b886-b1c73597409b tempest-CreateVolumesFromImageTest-713888814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-f08644d7-1667-497d-a672-ee7171aa39cd 1073741824" returned: 0 in 0.509s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:38 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1bbbf3b-439e-4afc-b0a2-c631004d9bd9 tempest-VolumesDeleteCascade-1905403258 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:27:38 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-e1bbbf3b-439e-4afc-b0a2-c631004d9bd9 tempest-VolumesDeleteCascade-1905403258 None] Flow 'volume_create_manager' (b04bd18d-7144-4fa3-b8d9-3b90957417cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:27:38 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-e1bbbf3b-439e-4afc-b0a2-c631004d9bd9 tempest-VolumesDeleteCascade-1905403258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4599c65e-29c1-4e2e-8111-6f09bdef1686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:38 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-e1bbbf3b-439e-4afc-b0a2-c631004d9bd9 tempest-VolumesDeleteCascade-1905403258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4599c65e-29c1-4e2e-8111-6f09bdef1686) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:27:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-47721652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f905460-f466-4596-9136-5da0aa080886,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='957aeedd8a754e4988fe8ab5da853939',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:27:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:27:38Z,use_quota=True,user_id='107a6cab1dac4b9aac8d7b405ace1249',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:38 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-e1bbbf3b-439e-4afc-b0a2-c631004d9bd9 tempest-VolumesDeleteCascade-1905403258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bc59cbf-4fd6-43d6-b67f-36767010fd17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:38 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-e1bbbf3b-439e-4afc-b0a2-c631004d9bd9 tempest-VolumesDeleteCascade-1905403258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bc59cbf-4fd6-43d6-b67f-36767010fd17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:38 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-e1bbbf3b-439e-4afc-b0a2-c631004d9bd9 tempest-VolumesDeleteCascade-1905403258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4191b50e-dc8f-45bf-8aa0-e48cb536378e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:38 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-e1bbbf3b-439e-4afc-b0a2-c631004d9bd9 tempest-VolumesDeleteCascade-1905403258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4191b50e-dc8f-45bf-8aa0-e48cb536378e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f905460-f466-4596-9136-5da0aa080886', 'volume_name': 'volume-3f905460-f466-4596-9136-5da0aa080886', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:38 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-e1bbbf3b-439e-4afc-b0a2-c631004d9bd9 tempest-VolumesDeleteCascade-1905403258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11fff00c-b8f0-4328-b589-768131044c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:38 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-e1bbbf3b-439e-4afc-b0a2-c631004d9bd9 tempest-VolumesDeleteCascade-1905403258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11fff00c-b8f0-4328-b589-768131044c30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:38 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-e1bbbf3b-439e-4afc-b0a2-c631004d9bd9 tempest-VolumesDeleteCascade-1905403258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (798bb1c8-de01-4938-8161-4de9d35b17e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:38 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-e1bbbf3b-439e-4afc-b0a2-c631004d9bd9 tempest-VolumesDeleteCascade-1905403258 None] Volume 3f905460-f466-4596-9136-5da0aa080886: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f905460-f466-4596-9136-5da0aa080886', 'volume_size': 1} Jul 22 03:27:38 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-e1bbbf3b-439e-4afc-b0a2-c631004d9bd9 tempest-VolumesDeleteCascade-1905403258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:27:38 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2632041e-8f41-4fc3-b886-b1c73597409b tempest-CreateVolumesFromImageTest-713888814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-f08644d7-1667-497d-a672-ee7171aa39cd {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:38 devstack sudo[101324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-f08644d7-1667-497d-a672-ee7171aa39cd Jul 22 03:27:38 devstack sudo[101324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:38 devstack sudo[101324]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:38 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2632041e-8f41-4fc3-b886-b1c73597409b tempest-CreateVolumesFromImageTest-713888814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-f08644d7-1667-497d-a672-ee7171aa39cd" returned: 0 in 0.234s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:38 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-2632041e-8f41-4fc3-b886-b1c73597409b tempest-CreateVolumesFromImageTest-713888814 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:27:38 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-2632041e-8f41-4fc3-b886-b1c73597409b tempest-CreateVolumesFromImageTest-713888814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:27:38 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-e1bbbf3b-439e-4afc-b0a2-c631004d9bd9 tempest-VolumesDeleteCascade-1905403258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.252s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:27:38 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-e1bbbf3b-439e-4afc-b0a2-c631004d9bd9 tempest-VolumesDeleteCascade-1905403258 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:27:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-47721652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f905460-f466-4596-9136-5da0aa080886,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='957aeedd8a754e4988fe8ab5da853939',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:27:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:27:38Z,use_quota=True,user_id='107a6cab1dac4b9aac8d7b405ace1249',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:27:38 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-e1bbbf3b-439e-4afc-b0a2-c631004d9bd9 tempest-VolumesDeleteCascade-1905403258 None] Creating volume 3f905460-f466-4596-9136-5da0aa080886 {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:27:38 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-e1bbbf3b-439e-4afc-b0a2-c631004d9bd9 tempest-VolumesDeleteCascade-1905403258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:27:38 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-e1bbbf3b-439e-4afc-b0a2-c631004d9bd9 tempest-VolumesDeleteCascade-1905403258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:27:38 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-e1bbbf3b-439e-4afc-b0a2-c631004d9bd9 tempest-VolumesDeleteCascade-1905403258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:27:38 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-e1bbbf3b-439e-4afc-b0a2-c631004d9bd9 tempest-VolumesDeleteCascade-1905403258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:27:38 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-e1bbbf3b-439e-4afc-b0a2-c631004d9bd9 tempest-VolumesDeleteCascade-1905403258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:27:38 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-e1bbbf3b-439e-4afc-b0a2-c631004d9bd9 tempest-VolumesDeleteCascade-1905403258 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:27:38 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-e1bbbf3b-439e-4afc-b0a2-c631004d9bd9 tempest-VolumesDeleteCascade-1905403258 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:27:38 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-e1bbbf3b-439e-4afc-b0a2-c631004d9bd9 tempest-VolumesDeleteCascade-1905403258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3f905460-f466-4596-9136-5da0aa080886 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:38 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2632041e-8f41-4fc3-b886-b1c73597409b tempest-CreateVolumesFromImageTest-713888814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92aba6a8-eb56-41e0-a80b-9625d08f22c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f08644d7-1667-497d-a672-ee7171aa39cd', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:38 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2632041e-8f41-4fc3-b886-b1c73597409b tempest-CreateVolumesFromImageTest-713888814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0648893-7a53-4d9c-ac2e-a762b2226266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:38 devstack sudo[101327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3f905460-f466-4596-9136-5da0aa080886 1073741824 Jul 22 03:27:38 devstack sudo[101327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:38 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-2632041e-8f41-4fc3-b886-b1c73597409b tempest-CreateVolumesFromImageTest-713888814 None] Volume volume-f08644d7-1667-497d-a672-ee7171aa39cd (f08644d7-1667-497d-a672-ee7171aa39cd): created successfully Jul 22 03:27:38 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2632041e-8f41-4fc3-b886-b1c73597409b tempest-CreateVolumesFromImageTest-713888814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0648893-7a53-4d9c-ac2e-a762b2226266) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:38 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2632041e-8f41-4fc3-b886-b1c73597409b tempest-CreateVolumesFromImageTest-713888814 None] Flow 'volume_create_manager' (9e7b78db-fb62-43d2-9c37-5c855ff5e485) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:27:38 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-2632041e-8f41-4fc3-b886-b1c73597409b tempest-CreateVolumesFromImageTest-713888814 None] Created volume successfully. Jul 22 03:27:39 devstack sudo[101327]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:39 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-e1bbbf3b-439e-4afc-b0a2-c631004d9bd9 tempest-VolumesDeleteCascade-1905403258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3f905460-f466-4596-9136-5da0aa080886 1073741824" returned: 0 in 0.394s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:39 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-e1bbbf3b-439e-4afc-b0a2-c631004d9bd9 tempest-VolumesDeleteCascade-1905403258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3f905460-f466-4596-9136-5da0aa080886 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:39 devstack sudo[101333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3f905460-f466-4596-9136-5da0aa080886 Jul 22 03:27:39 devstack sudo[101333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:39 devstack sudo[101333]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:39 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-e1bbbf3b-439e-4afc-b0a2-c631004d9bd9 tempest-VolumesDeleteCascade-1905403258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3f905460-f466-4596-9136-5da0aa080886" returned: 0 in 0.245s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:39 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-e1bbbf3b-439e-4afc-b0a2-c631004d9bd9 tempest-VolumesDeleteCascade-1905403258 None] <== create_volume: return (675ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:27:39 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-e1bbbf3b-439e-4afc-b0a2-c631004d9bd9 tempest-VolumesDeleteCascade-1905403258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.679s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:27:39 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-e1bbbf3b-439e-4afc-b0a2-c631004d9bd9 tempest-VolumesDeleteCascade-1905403258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (798bb1c8-de01-4938-8161-4de9d35b17e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f905460-f466-4596-9136-5da0aa080886', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:39 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-e1bbbf3b-439e-4afc-b0a2-c631004d9bd9 tempest-VolumesDeleteCascade-1905403258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3f13d2f-cf05-47b2-8526-7e8f1a7f759b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:39 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-e1bbbf3b-439e-4afc-b0a2-c631004d9bd9 tempest-VolumesDeleteCascade-1905403258 None] Volume volume-3f905460-f466-4596-9136-5da0aa080886 (3f905460-f466-4596-9136-5da0aa080886): created successfully Jul 22 03:27:39 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-e1bbbf3b-439e-4afc-b0a2-c631004d9bd9 tempest-VolumesDeleteCascade-1905403258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3f13d2f-cf05-47b2-8526-7e8f1a7f759b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:39 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-e1bbbf3b-439e-4afc-b0a2-c631004d9bd9 tempest-VolumesDeleteCascade-1905403258 None] Flow 'volume_create_manager' (b04bd18d-7144-4fa3-b8d9-3b90957417cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:27:39 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-51bf4663-1358-40a3-b537-2dd922948afe tempest-CreateVolumesFromImageTest-713888814 None] Acquiring lock "cinder-f08644d7-1667-497d-a672-ee7171aa39cd-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:27:39 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-e1bbbf3b-439e-4afc-b0a2-c631004d9bd9 tempest-VolumesDeleteCascade-1905403258 None] Created volume successfully. Jul 22 03:27:39 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-51bf4663-1358-40a3-b537-2dd922948afe tempest-CreateVolumesFromImageTest-713888814 None] Lock "cinder-f08644d7-1667-497d-a672-ee7171aa39cd-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:27:39 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-51bf4663-1358-40a3-b537-2dd922948afe tempest-CreateVolumesFromImageTest-713888814 None] Acquiring lock "cinder-quobyte-f08644d7-1667-497d-a672-ee7171aa39cd" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:27:39 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-51bf4663-1358-40a3-b537-2dd922948afe tempest-CreateVolumesFromImageTest-713888814 None] Lock "cinder-quobyte-f08644d7-1667-497d-a672-ee7171aa39cd" acquired by "delete_volume" :: waited 0.014s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:27:39 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc10f029-f1ac-4275-9fac-0e943097f72f]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:27:39 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-51bf4663-1358-40a3-b537-2dd922948afe tempest-CreateVolumesFromImageTest-713888814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-f08644d7-1667-497d-a672-ee7171aa39cd {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:39 devstack sudo[101336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-f08644d7-1667-497d-a672-ee7171aa39cd Jul 22 03:27:39 devstack sudo[101336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:39 devstack sudo[101336]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:39 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-51bf4663-1358-40a3-b537-2dd922948afe tempest-CreateVolumesFromImageTest-713888814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-f08644d7-1667-497d-a672-ee7171aa39cd" returned: 0 in 0.355s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:39 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-51bf4663-1358-40a3-b537-2dd922948afe tempest-CreateVolumesFromImageTest-713888814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-f08644d7-1667-497d-a672-ee7171aa39cd {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:39 devstack sudo[101342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-f08644d7-1667-497d-a672-ee7171aa39cd Jul 22 03:27:39 devstack sudo[101342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:40 devstack sudo[101342]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:40 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-51bf4663-1358-40a3-b537-2dd922948afe tempest-CreateVolumesFromImageTest-713888814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-f08644d7-1667-497d-a672-ee7171aa39cd" returned: 0 in 0.246s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:40 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-51bf4663-1358-40a3-b537-2dd922948afe tempest-CreateVolumesFromImageTest-713888814 None] Lock "cinder-quobyte-f08644d7-1667-497d-a672-ee7171aa39cd" released by "delete_volume" :: held 0.637s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:27:40 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-51bf4663-1358-40a3-b537-2dd922948afe tempest-CreateVolumesFromImageTest-713888814 None] Created reservations ['3f4ccce0-1c50-477b-b818-03ca645f9ebd', 'b8f43fb8-49ec-468b-a2bd-81ef058d1c3a', '20db49a7-d7fa-4540-8c34-c37467ef5525', '5707e811-8f2b-47f2-a15e-654f1c0556d0'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:27:40 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-51bf4663-1358-40a3-b537-2dd922948afe tempest-CreateVolumesFromImageTest-713888814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:27:40 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-51bf4663-1358-40a3-b537-2dd922948afe tempest-CreateVolumesFromImageTest-713888814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:27:40 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-51bf4663-1358-40a3-b537-2dd922948afe tempest-CreateVolumesFromImageTest-713888814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:27:40 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-51bf4663-1358-40a3-b537-2dd922948afe tempest-CreateVolumesFromImageTest-713888814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:27:40 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-51bf4663-1358-40a3-b537-2dd922948afe tempest-CreateVolumesFromImageTest-713888814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:27:40 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-51bf4663-1358-40a3-b537-2dd922948afe tempest-CreateVolumesFromImageTest-713888814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:40 devstack sudo[101345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:27:40 devstack sudo[101345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:40 devstack sudo[101345]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:40 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-51bf4663-1358-40a3-b537-2dd922948afe tempest-CreateVolumesFromImageTest-713888814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.253s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:40 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-51bf4663-1358-40a3-b537-2dd922948afe tempest-CreateVolumesFromImageTest-713888814 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:27:40 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-51bf4663-1358-40a3-b537-2dd922948afe tempest-CreateVolumesFromImageTest-713888814 None] Deleted volume successfully. Jul 22 03:27:40 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-51bf4663-1358-40a3-b537-2dd922948afe tempest-CreateVolumesFromImageTest-713888814 None] Lock "cinder-f08644d7-1667-497d-a672-ee7171aa39cd-delete_volume" released by "delete_volume" :: held 1.089s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:27:40 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-b13bbffe-0293-45a0-b978-068e1db1eeec tempest-CreateVolumesFromImageTest-713888814 None] Acquiring lock "cinder-932cecaa-263c-43c2-9b2d-585550daaf57-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:27:40 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-b13bbffe-0293-45a0-b978-068e1db1eeec tempest-CreateVolumesFromImageTest-713888814 None] Lock "cinder-932cecaa-263c-43c2-9b2d-585550daaf57-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:27:40 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-f5bb525a-9562-4972-a9f5-7d5a5f720ee9 tempest-VolumesDeleteCascade-1905403258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:27:40 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-f5bb525a-9562-4972-a9f5-7d5a5f720ee9 tempest-VolumesDeleteCascade-1905403258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:27:40 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-b13bbffe-0293-45a0-b978-068e1db1eeec tempest-CreateVolumesFromImageTest-713888814 None] Acquiring lock "cinder-quobyte-932cecaa-263c-43c2-9b2d-585550daaf57" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:27:40 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-f5bb525a-9562-4972-a9f5-7d5a5f720ee9 tempest-VolumesDeleteCascade-1905403258 None] Creating offline snapshot 6818b007-d773-4907-89c1-cd2acf15129e of volume 3f905460-f466-4596-9136-5da0aa080886 {{(pid=87747) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 03:27:40 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-b13bbffe-0293-45a0-b978-068e1db1eeec tempest-CreateVolumesFromImageTest-713888814 None] Lock "cinder-quobyte-932cecaa-263c-43c2-9b2d-585550daaf57" acquired by "delete_volume" :: waited 0.023s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:27:40 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e4da9a3-6f83-43e8-bb5a-a0932518cb27]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:27:40 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f5bb525a-9562-4972-a9f5-7d5a5f720ee9 tempest-VolumesDeleteCascade-1905403258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3f905460-f466-4596-9136-5da0aa080886 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:40 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd1b65d8-f8fd-4429-a802-eb16a4dc399d]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:27:40 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b13bbffe-0293-45a0-b978-068e1db1eeec tempest-CreateVolumesFromImageTest-713888814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-932cecaa-263c-43c2-9b2d-585550daaf57 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:40 devstack sudo[101348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3f905460-f466-4596-9136-5da0aa080886 Jul 22 03:27:40 devstack sudo[101348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:40 devstack sudo[101349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-932cecaa-263c-43c2-9b2d-585550daaf57 Jul 22 03:27:40 devstack sudo[101349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:41 devstack sudo[101348]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:41 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f5bb525a-9562-4972-a9f5-7d5a5f720ee9 tempest-VolumesDeleteCascade-1905403258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3f905460-f466-4596-9136-5da0aa080886" returned: 0 in 0.365s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:41 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f5bb525a-9562-4972-a9f5-7d5a5f720ee9 tempest-VolumesDeleteCascade-1905403258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3f905460-f466-4596-9136-5da0aa080886,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3f905460-f466-4596-9136-5da0aa080886.6818b007-d773-4907-89c1-cd2acf15129e 1G {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:41 devstack sudo[101349]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:41 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b13bbffe-0293-45a0-b978-068e1db1eeec tempest-CreateVolumesFromImageTest-713888814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-932cecaa-263c-43c2-9b2d-585550daaf57" returned: 0 in 0.373s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:41 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b13bbffe-0293-45a0-b978-068e1db1eeec tempest-CreateVolumesFromImageTest-713888814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-932cecaa-263c-43c2-9b2d-585550daaf57 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:41 devstack sudo[101358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3f905460-f466-4596-9136-5da0aa080886,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3f905460-f466-4596-9136-5da0aa080886.6818b007-d773-4907-89c1-cd2acf15129e 1G Jul 22 03:27:41 devstack sudo[101358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:41 devstack sudo[101360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-932cecaa-263c-43c2-9b2d-585550daaf57 Jul 22 03:27:41 devstack sudo[101360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:41 devstack sudo[101360]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:41 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b13bbffe-0293-45a0-b978-068e1db1eeec tempest-CreateVolumesFromImageTest-713888814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-932cecaa-263c-43c2-9b2d-585550daaf57" returned: 0 in 0.247s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:41 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-b13bbffe-0293-45a0-b978-068e1db1eeec tempest-CreateVolumesFromImageTest-713888814 None] Lock "cinder-quobyte-932cecaa-263c-43c2-9b2d-585550daaf57" released by "delete_volume" :: held 0.664s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:27:41 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-b13bbffe-0293-45a0-b978-068e1db1eeec tempest-CreateVolumesFromImageTest-713888814 None] Created reservations ['5aecbb6a-bef9-4bd2-b1af-08f5ba8141ff', 'b629a616-1f00-4a59-a8ac-9a2f4857981b', '3e1bacfe-7fa8-4014-8158-ca1fd1f75fad', 'd1b9d6ea-64b2-47ec-a8eb-b846f16da9ae'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:27:41 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b13bbffe-0293-45a0-b978-068e1db1eeec tempest-CreateVolumesFromImageTest-713888814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:27:41 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b13bbffe-0293-45a0-b978-068e1db1eeec tempest-CreateVolumesFromImageTest-713888814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:27:41 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-b13bbffe-0293-45a0-b978-068e1db1eeec tempest-CreateVolumesFromImageTest-713888814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:27:41 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-b13bbffe-0293-45a0-b978-068e1db1eeec tempest-CreateVolumesFromImageTest-713888814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:27:41 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b13bbffe-0293-45a0-b978-068e1db1eeec tempest-CreateVolumesFromImageTest-713888814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:27:41 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b13bbffe-0293-45a0-b978-068e1db1eeec tempest-CreateVolumesFromImageTest-713888814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:41 devstack sudo[101358]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:41 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f5bb525a-9562-4972-a9f5-7d5a5f720ee9 tempest-VolumesDeleteCascade-1905403258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3f905460-f466-4596-9136-5da0aa080886,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3f905460-f466-4596-9136-5da0aa080886.6818b007-d773-4907-89c1-cd2acf15129e 1G" returned: 0 in 0.411s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:41 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f5bb525a-9562-4972-a9f5-7d5a5f720ee9 tempest-VolumesDeleteCascade-1905403258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f905460-f466-4596-9136-5da0aa080886 -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3f905460-f466-4596-9136-5da0aa080886.6818b007-d773-4907-89c1-cd2acf15129e {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:41 devstack sudo[101367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:27:41 devstack sudo[101367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:41 devstack sudo[101368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f905460-f466-4596-9136-5da0aa080886 -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3f905460-f466-4596-9136-5da0aa080886.6818b007-d773-4907-89c1-cd2acf15129e Jul 22 03:27:41 devstack sudo[101368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:41 devstack sudo[101367]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:41 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b13bbffe-0293-45a0-b978-068e1db1eeec tempest-CreateVolumesFromImageTest-713888814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.252s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:41 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-b13bbffe-0293-45a0-b978-068e1db1eeec tempest-CreateVolumesFromImageTest-713888814 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:27:41 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-b13bbffe-0293-45a0-b978-068e1db1eeec tempest-CreateVolumesFromImageTest-713888814 None] Deleted volume successfully. Jul 22 03:27:41 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-b13bbffe-0293-45a0-b978-068e1db1eeec tempest-CreateVolumesFromImageTest-713888814 None] Lock "cinder-932cecaa-263c-43c2-9b2d-585550daaf57-delete_volume" released by "delete_volume" :: held 1.135s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:27:41 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-59585704-179d-4d77-b710-d75fe9302f94 tempest-CreateVolumesFromImageTest-713888814 None] Acquiring lock "cinder-bd169255-2d22-4a79-bd91-aa83aee7c52f-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:27:41 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-59585704-179d-4d77-b710-d75fe9302f94 tempest-CreateVolumesFromImageTest-713888814 None] Lock "cinder-bd169255-2d22-4a79-bd91-aa83aee7c52f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:27:41 devstack sudo[101368]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:41 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f5bb525a-9562-4972-a9f5-7d5a5f720ee9 tempest-VolumesDeleteCascade-1905403258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f905460-f466-4596-9136-5da0aa080886 -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3f905460-f466-4596-9136-5da0aa080886.6818b007-d773-4907-89c1-cd2acf15129e" returned: 0 in 0.339s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:41 devstack cinder-volume[87747]: WARNING cinder.volume.drivers.remotefs [None req-f5bb525a-9562-4972-a9f5-7d5a5f720ee9 tempest-VolumesDeleteCascade-1905403258 None] /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3f905460-f466-4596-9136-5da0aa080886.6818b007-d773-4907-89c1-cd2acf15129e is being set with open permissions: ugo+rw Jul 22 03:27:41 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f5bb525a-9562-4972-a9f5-7d5a5f720ee9 tempest-VolumesDeleteCascade-1905403258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3f905460-f466-4596-9136-5da0aa080886.6818b007-d773-4907-89c1-cd2acf15129e {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:41 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-59585704-179d-4d77-b710-d75fe9302f94 tempest-CreateVolumesFromImageTest-713888814 None] Acquiring lock "cinder-quobyte-bd169255-2d22-4a79-bd91-aa83aee7c52f" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:27:41 devstack sudo[101376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3f905460-f466-4596-9136-5da0aa080886.6818b007-d773-4907-89c1-cd2acf15129e Jul 22 03:27:41 devstack sudo[101376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:41 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-59585704-179d-4d77-b710-d75fe9302f94 tempest-CreateVolumesFromImageTest-713888814 None] Lock "cinder-quobyte-bd169255-2d22-4a79-bd91-aa83aee7c52f" acquired by "delete_volume" :: waited 0.021s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:27:41 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b6a534-1444-4a9b-b6f4-d30da2797185]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:27:41 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-59585704-179d-4d77-b710-d75fe9302f94 tempest-CreateVolumesFromImageTest-713888814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-bd169255-2d22-4a79-bd91-aa83aee7c52f {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:42 devstack sudo[101378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-bd169255-2d22-4a79-bd91-aa83aee7c52f Jul 22 03:27:42 devstack sudo[101378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:42 devstack sudo[101376]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:42 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f5bb525a-9562-4972-a9f5-7d5a5f720ee9 tempest-VolumesDeleteCascade-1905403258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3f905460-f466-4596-9136-5da0aa080886.6818b007-d773-4907-89c1-cd2acf15129e" returned: 0 in 0.247s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:42 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f5bb525a-9562-4972-a9f5-7d5a5f720ee9 tempest-VolumesDeleteCascade-1905403258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3f905460-f466-4596-9136-5da0aa080886.info {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:42 devstack sudo[101381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3f905460-f466-4596-9136-5da0aa080886.info Jul 22 03:27:42 devstack sudo[101381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:42 devstack sudo[101378]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:42 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-59585704-179d-4d77-b710-d75fe9302f94 tempest-CreateVolumesFromImageTest-713888814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-bd169255-2d22-4a79-bd91-aa83aee7c52f" returned: 0 in 0.365s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:42 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-59585704-179d-4d77-b710-d75fe9302f94 tempest-CreateVolumesFromImageTest-713888814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-bd169255-2d22-4a79-bd91-aa83aee7c52f {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:42 devstack sudo[101387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-bd169255-2d22-4a79-bd91-aa83aee7c52f Jul 22 03:27:42 devstack sudo[101387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:42 devstack sudo[101381]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:42 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f5bb525a-9562-4972-a9f5-7d5a5f720ee9 tempest-VolumesDeleteCascade-1905403258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3f905460-f466-4596-9136-5da0aa080886.info" returned: 0 in 0.253s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:42 devstack cinder-volume[87747]: WARNING cinder.volume.drivers.remotefs [None req-f5bb525a-9562-4972-a9f5-7d5a5f720ee9 tempest-VolumesDeleteCascade-1905403258 None] /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3f905460-f466-4596-9136-5da0aa080886.info is being set with open permissions: ugo+rw Jul 22 03:27:42 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f5bb525a-9562-4972-a9f5-7d5a5f720ee9 tempest-VolumesDeleteCascade-1905403258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3f905460-f466-4596-9136-5da0aa080886.info {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:42 devstack sudo[101390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3f905460-f466-4596-9136-5da0aa080886.info Jul 22 03:27:42 devstack sudo[101390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:42 devstack sudo[101387]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:42 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-59585704-179d-4d77-b710-d75fe9302f94 tempest-CreateVolumesFromImageTest-713888814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-bd169255-2d22-4a79-bd91-aa83aee7c52f" returned: 0 in 0.259s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:42 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-59585704-179d-4d77-b710-d75fe9302f94 tempest-CreateVolumesFromImageTest-713888814 None] Lock "cinder-quobyte-bd169255-2d22-4a79-bd91-aa83aee7c52f" released by "delete_volume" :: held 0.664s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:27:42 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-59585704-179d-4d77-b710-d75fe9302f94 tempest-CreateVolumesFromImageTest-713888814 None] Created reservations ['e36a00db-3962-4de9-8644-f83fc1e274f8', 'b2f4abde-47cc-4b02-9c11-bc55e3585d94', '959bbee7-7f12-4db1-a123-c6761f7372a5', '856404bc-0f95-4d3b-a853-2a1737eebd3c'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:27:42 devstack sudo[101390]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:42 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f5bb525a-9562-4972-a9f5-7d5a5f720ee9 tempest-VolumesDeleteCascade-1905403258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3f905460-f466-4596-9136-5da0aa080886.info" returned: 0 in 0.249s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:42 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-f5bb525a-9562-4972-a9f5-7d5a5f720ee9 tempest-VolumesDeleteCascade-1905403258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.962s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:27:42 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-f5bb525a-9562-4972-a9f5-7d5a5f720ee9 tempest-VolumesDeleteCascade-1905403258 None] Create snapshot completed successfully Jul 22 03:27:42 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-59585704-179d-4d77-b710-d75fe9302f94 tempest-CreateVolumesFromImageTest-713888814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:27:42 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-59585704-179d-4d77-b710-d75fe9302f94 tempest-CreateVolumesFromImageTest-713888814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:27:42 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-59585704-179d-4d77-b710-d75fe9302f94 tempest-CreateVolumesFromImageTest-713888814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:27:42 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-59585704-179d-4d77-b710-d75fe9302f94 tempest-CreateVolumesFromImageTest-713888814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:27:42 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-59585704-179d-4d77-b710-d75fe9302f94 tempest-CreateVolumesFromImageTest-713888814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:27:42 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-59585704-179d-4d77-b710-d75fe9302f94 tempest-CreateVolumesFromImageTest-713888814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:42 devstack sudo[101394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:27:42 devstack sudo[101394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:43 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-677e074f-0b3b-46e7-a8d1-5efcf9372931 tempest-VolumesDeleteCascade-1905403258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:27:43 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-677e074f-0b3b-46e7-a8d1-5efcf9372931 tempest-VolumesDeleteCascade-1905403258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:27:43 devstack sudo[101394]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:43 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-677e074f-0b3b-46e7-a8d1-5efcf9372931 tempest-VolumesDeleteCascade-1905403258 None] Creating offline snapshot 6f5ce50d-2ef0-4923-8e2d-d94e5b13bb01 of volume 3f905460-f466-4596-9136-5da0aa080886 {{(pid=87747) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 03:27:43 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-399b38d1-8aa9-4070-94de-7f4be87371b3 tempest-CreateVolumesFromImageTest-713888814 None] Acquiring lock "cinder-9084e0c0-c5a7-4a01-bf7f-1793f0b1f67d-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:27:43 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-59585704-179d-4d77-b710-d75fe9302f94 tempest-CreateVolumesFromImageTest-713888814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.324s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:43 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-59585704-179d-4d77-b710-d75fe9302f94 tempest-CreateVolumesFromImageTest-713888814 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:27:43 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f6e9cba-c372-47a1-9b32-6c5c44a8571d]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:27:43 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-677e074f-0b3b-46e7-a8d1-5efcf9372931 tempest-VolumesDeleteCascade-1905403258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3f905460-f466-4596-9136-5da0aa080886.6818b007-d773-4907-89c1-cd2acf15129e {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:43 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-399b38d1-8aa9-4070-94de-7f4be87371b3 tempest-CreateVolumesFromImageTest-713888814 None] Lock "cinder-9084e0c0-c5a7-4a01-bf7f-1793f0b1f67d-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:27:43 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-59585704-179d-4d77-b710-d75fe9302f94 tempest-CreateVolumesFromImageTest-713888814 None] Deleted volume successfully. Jul 22 03:27:43 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-59585704-179d-4d77-b710-d75fe9302f94 tempest-CreateVolumesFromImageTest-713888814 None] Lock "cinder-bd169255-2d22-4a79-bd91-aa83aee7c52f-delete_volume" released by "delete_volume" :: held 1.268s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:27:43 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-399b38d1-8aa9-4070-94de-7f4be87371b3 tempest-CreateVolumesFromImageTest-713888814 None] Acquiring lock "cinder-quobyte-9084e0c0-c5a7-4a01-bf7f-1793f0b1f67d" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:27:43 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-399b38d1-8aa9-4070-94de-7f4be87371b3 tempest-CreateVolumesFromImageTest-713888814 None] Lock "cinder-quobyte-9084e0c0-c5a7-4a01-bf7f-1793f0b1f67d" acquired by "delete_volume" :: waited 0.014s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:27:43 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[888845b5-8e08-4adf-ad9c-aa78aba6dc64]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:27:43 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-399b38d1-8aa9-4070-94de-7f4be87371b3 tempest-CreateVolumesFromImageTest-713888814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9084e0c0-c5a7-4a01-bf7f-1793f0b1f67d {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:43 devstack sudo[101397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3f905460-f466-4596-9136-5da0aa080886.6818b007-d773-4907-89c1-cd2acf15129e Jul 22 03:27:43 devstack sudo[101397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:43 devstack sudo[101399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9084e0c0-c5a7-4a01-bf7f-1793f0b1f67d Jul 22 03:27:43 devstack sudo[101399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:43 devstack sudo[101397]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:43 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-677e074f-0b3b-46e7-a8d1-5efcf9372931 tempest-VolumesDeleteCascade-1905403258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3f905460-f466-4596-9136-5da0aa080886.6818b007-d773-4907-89c1-cd2acf15129e" returned: 0 in 0.362s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:43 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-677e074f-0b3b-46e7-a8d1-5efcf9372931 tempest-VolumesDeleteCascade-1905403258 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f905460-f466-4596-9136-5da0aa080886(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87747) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 03:27:43 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-677e074f-0b3b-46e7-a8d1-5efcf9372931 tempest-VolumesDeleteCascade-1905403258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3f905460-f466-4596-9136-5da0aa080886.6818b007-d773-4907-89c1-cd2acf15129e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3f905460-f466-4596-9136-5da0aa080886.6f5ce50d-2ef0-4923-8e2d-d94e5b13bb01 1G {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:43 devstack sudo[101405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3f905460-f466-4596-9136-5da0aa080886.6818b007-d773-4907-89c1-cd2acf15129e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3f905460-f466-4596-9136-5da0aa080886.6f5ce50d-2ef0-4923-8e2d-d94e5b13bb01 1G Jul 22 03:27:43 devstack sudo[101405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:43 devstack sudo[101399]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:43 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-399b38d1-8aa9-4070-94de-7f4be87371b3 tempest-CreateVolumesFromImageTest-713888814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9084e0c0-c5a7-4a01-bf7f-1793f0b1f67d" returned: 0 in 0.364s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:43 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-399b38d1-8aa9-4070-94de-7f4be87371b3 tempest-CreateVolumesFromImageTest-713888814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9084e0c0-c5a7-4a01-bf7f-1793f0b1f67d {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:43 devstack sudo[101410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9084e0c0-c5a7-4a01-bf7f-1793f0b1f67d Jul 22 03:27:43 devstack sudo[101410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:43 devstack sudo[101410]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:43 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-399b38d1-8aa9-4070-94de-7f4be87371b3 tempest-CreateVolumesFromImageTest-713888814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9084e0c0-c5a7-4a01-bf7f-1793f0b1f67d" returned: 0 in 0.269s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:43 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-399b38d1-8aa9-4070-94de-7f4be87371b3 tempest-CreateVolumesFromImageTest-713888814 None] Lock "cinder-quobyte-9084e0c0-c5a7-4a01-bf7f-1793f0b1f67d" released by "delete_volume" :: held 0.678s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:27:43 devstack sudo[101405]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:43 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-677e074f-0b3b-46e7-a8d1-5efcf9372931 tempest-VolumesDeleteCascade-1905403258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3f905460-f466-4596-9136-5da0aa080886.6818b007-d773-4907-89c1-cd2acf15129e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3f905460-f466-4596-9136-5da0aa080886.6f5ce50d-2ef0-4923-8e2d-d94e5b13bb01 1G" returned: 0 in 0.424s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:43 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-677e074f-0b3b-46e7-a8d1-5efcf9372931 tempest-VolumesDeleteCascade-1905403258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f905460-f466-4596-9136-5da0aa080886.6818b007-d773-4907-89c1-cd2acf15129e -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3f905460-f466-4596-9136-5da0aa080886.6f5ce50d-2ef0-4923-8e2d-d94e5b13bb01 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:43 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-399b38d1-8aa9-4070-94de-7f4be87371b3 tempest-CreateVolumesFromImageTest-713888814 None] Created reservations ['2902fbf4-e5b0-4f23-b21b-7cbf68249363', '10495144-6c79-402f-afd3-12f75142a87e', '93831b71-42be-495a-b904-ffc5c15931fb', '2ce945e1-7b2d-4071-bf4c-6a14d19d23d4'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:27:43 devstack sudo[101416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f905460-f466-4596-9136-5da0aa080886.6818b007-d773-4907-89c1-cd2acf15129e -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3f905460-f466-4596-9136-5da0aa080886.6f5ce50d-2ef0-4923-8e2d-d94e5b13bb01 Jul 22 03:27:43 devstack sudo[101416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:43 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-399b38d1-8aa9-4070-94de-7f4be87371b3 tempest-CreateVolumesFromImageTest-713888814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:27:43 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-399b38d1-8aa9-4070-94de-7f4be87371b3 tempest-CreateVolumesFromImageTest-713888814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:27:43 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-399b38d1-8aa9-4070-94de-7f4be87371b3 tempest-CreateVolumesFromImageTest-713888814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:27:43 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-399b38d1-8aa9-4070-94de-7f4be87371b3 tempest-CreateVolumesFromImageTest-713888814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:27:43 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-399b38d1-8aa9-4070-94de-7f4be87371b3 tempest-CreateVolumesFromImageTest-713888814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:27:43 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-399b38d1-8aa9-4070-94de-7f4be87371b3 tempest-CreateVolumesFromImageTest-713888814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:44 devstack sudo[101418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:27:44 devstack sudo[101418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:44 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-70857c18-e231-4580-94db-7c792887f8fd tempest-CreateVolumesFromImageTest-713888814 None] Acquiring lock "cinder-885f9ea1-ad78-475e-8225-aae0a2eddda2-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:27:44 devstack sudo[101418]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:44 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-70857c18-e231-4580-94db-7c792887f8fd tempest-CreateVolumesFromImageTest-713888814 None] Lock "cinder-885f9ea1-ad78-475e-8225-aae0a2eddda2-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:27:44 devstack sudo[101416]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:44 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-399b38d1-8aa9-4070-94de-7f4be87371b3 tempest-CreateVolumesFromImageTest-713888814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.271s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:44 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-399b38d1-8aa9-4070-94de-7f4be87371b3 tempest-CreateVolumesFromImageTest-713888814 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:27:44 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-677e074f-0b3b-46e7-a8d1-5efcf9372931 tempest-VolumesDeleteCascade-1905403258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f905460-f466-4596-9136-5da0aa080886.6818b007-d773-4907-89c1-cd2acf15129e -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3f905460-f466-4596-9136-5da0aa080886.6f5ce50d-2ef0-4923-8e2d-d94e5b13bb01" returned: 0 in 0.359s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:44 devstack cinder-volume[87747]: WARNING cinder.volume.drivers.remotefs [None req-677e074f-0b3b-46e7-a8d1-5efcf9372931 tempest-VolumesDeleteCascade-1905403258 None] /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3f905460-f466-4596-9136-5da0aa080886.6f5ce50d-2ef0-4923-8e2d-d94e5b13bb01 is being set with open permissions: ugo+rw Jul 22 03:27:44 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-677e074f-0b3b-46e7-a8d1-5efcf9372931 tempest-VolumesDeleteCascade-1905403258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3f905460-f466-4596-9136-5da0aa080886.6f5ce50d-2ef0-4923-8e2d-d94e5b13bb01 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:44 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-399b38d1-8aa9-4070-94de-7f4be87371b3 tempest-CreateVolumesFromImageTest-713888814 None] Deleted volume successfully. Jul 22 03:27:44 devstack sudo[101424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3f905460-f466-4596-9136-5da0aa080886.6f5ce50d-2ef0-4923-8e2d-d94e5b13bb01 Jul 22 03:27:44 devstack sudo[101424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:44 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-399b38d1-8aa9-4070-94de-7f4be87371b3 tempest-CreateVolumesFromImageTest-713888814 None] Lock "cinder-9084e0c0-c5a7-4a01-bf7f-1793f0b1f67d-delete_volume" released by "delete_volume" :: held 1.188s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:27:44 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-70857c18-e231-4580-94db-7c792887f8fd tempest-CreateVolumesFromImageTest-713888814 None] Acquiring lock "cinder-quobyte-885f9ea1-ad78-475e-8225-aae0a2eddda2" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:27:44 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-70857c18-e231-4580-94db-7c792887f8fd tempest-CreateVolumesFromImageTest-713888814 None] Lock "cinder-quobyte-885f9ea1-ad78-475e-8225-aae0a2eddda2" acquired by "delete_volume" :: waited 0.013s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:27:44 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[34457aca-4853-4e59-90b2-d8c825e4dfa8]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:27:44 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-70857c18-e231-4580-94db-7c792887f8fd tempest-CreateVolumesFromImageTest-713888814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-885f9ea1-ad78-475e-8225-aae0a2eddda2 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:44 devstack sudo[101426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-885f9ea1-ad78-475e-8225-aae0a2eddda2 Jul 22 03:27:44 devstack sudo[101426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:44 devstack sudo[101424]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:44 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-677e074f-0b3b-46e7-a8d1-5efcf9372931 tempest-VolumesDeleteCascade-1905403258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3f905460-f466-4596-9136-5da0aa080886.6f5ce50d-2ef0-4923-8e2d-d94e5b13bb01" returned: 0 in 0.263s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:44 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-677e074f-0b3b-46e7-a8d1-5efcf9372931 tempest-VolumesDeleteCascade-1905403258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.521s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:27:44 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-677e074f-0b3b-46e7-a8d1-5efcf9372931 tempest-VolumesDeleteCascade-1905403258 None] Create snapshot completed successfully Jul 22 03:27:44 devstack sudo[101426]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:44 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-70857c18-e231-4580-94db-7c792887f8fd tempest-CreateVolumesFromImageTest-713888814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-885f9ea1-ad78-475e-8225-aae0a2eddda2" returned: 0 in 0.355s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:44 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-70857c18-e231-4580-94db-7c792887f8fd tempest-CreateVolumesFromImageTest-713888814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-885f9ea1-ad78-475e-8225-aae0a2eddda2 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:44 devstack sudo[101432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-885f9ea1-ad78-475e-8225-aae0a2eddda2 Jul 22 03:27:44 devstack sudo[101432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:44 devstack sudo[101432]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:44 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-70857c18-e231-4580-94db-7c792887f8fd tempest-CreateVolumesFromImageTest-713888814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-885f9ea1-ad78-475e-8225-aae0a2eddda2" returned: 0 in 0.244s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:44 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-70857c18-e231-4580-94db-7c792887f8fd tempest-CreateVolumesFromImageTest-713888814 None] Lock "cinder-quobyte-885f9ea1-ad78-475e-8225-aae0a2eddda2" released by "delete_volume" :: held 0.639s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:27:45 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-70857c18-e231-4580-94db-7c792887f8fd tempest-CreateVolumesFromImageTest-713888814 None] Created reservations ['8ea6953f-6098-453e-9efc-39c63971c6f1', 'b53dfbf8-7c2f-4a8d-b571-fb89d183f37a', '4d6b8399-0109-454b-a708-3e8b27dc7954', '8cbd7ed6-f72e-40f1-87f9-4ffda296696b'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:27:45 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-70857c18-e231-4580-94db-7c792887f8fd tempest-CreateVolumesFromImageTest-713888814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:27:45 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-70857c18-e231-4580-94db-7c792887f8fd tempest-CreateVolumesFromImageTest-713888814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:27:45 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-70857c18-e231-4580-94db-7c792887f8fd tempest-CreateVolumesFromImageTest-713888814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:27:45 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-70857c18-e231-4580-94db-7c792887f8fd tempest-CreateVolumesFromImageTest-713888814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:27:45 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-70857c18-e231-4580-94db-7c792887f8fd tempest-CreateVolumesFromImageTest-713888814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:27:45 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-70857c18-e231-4580-94db-7c792887f8fd tempest-CreateVolumesFromImageTest-713888814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:45 devstack sudo[101441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:27:45 devstack sudo[101441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:45 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-45741343-8e61-4fa1-b9db-66cec4f9c0d2 tempest-VolumesDeleteCascade-1905403258 None] Acquiring lock "cinder-3f905460-f466-4596-9136-5da0aa080886-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:27:45 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-45741343-8e61-4fa1-b9db-66cec4f9c0d2 tempest-VolumesDeleteCascade-1905403258 None] Lock "cinder-3f905460-f466-4596-9136-5da0aa080886-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:27:45 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-45741343-8e61-4fa1-b9db-66cec4f9c0d2 tempest-VolumesDeleteCascade-1905403258 None] Performing cascade delete. {{(pid=87747) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 22 03:27:45 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-45741343-8e61-4fa1-b9db-66cec4f9c0d2 tempest-VolumesDeleteCascade-1905403258 None] Acquiring lock "cinder-6818b007-d773-4907-89c1-cd2acf15129e-delete_snapshot" by "delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:27:45 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-45741343-8e61-4fa1-b9db-66cec4f9c0d2 tempest-VolumesDeleteCascade-1905403258 None] Lock "cinder-6818b007-d773-4907-89c1-cd2acf15129e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:27:45 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-45741343-8e61-4fa1-b9db-66cec4f9c0d2 tempest-VolumesDeleteCascade-1905403258 None] Acquiring lock "cinder-quobyte-3f905460-f466-4596-9136-5da0aa080886" by "delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:27:45 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-45741343-8e61-4fa1-b9db-66cec4f9c0d2 tempest-VolumesDeleteCascade-1905403258 None] Lock "cinder-quobyte-3f905460-f466-4596-9136-5da0aa080886" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:27:45 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-45741343-8e61-4fa1-b9db-66cec4f9c0d2 tempest-VolumesDeleteCascade-1905403258 None] Acquiring lock "cinder-quobyte-6818b007-d773-4907-89c1-cd2acf15129e" by "_delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:27:45 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-45741343-8e61-4fa1-b9db-66cec4f9c0d2 tempest-VolumesDeleteCascade-1905403258 None] Lock "cinder-quobyte-6818b007-d773-4907-89c1-cd2acf15129e" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:27:45 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-45741343-8e61-4fa1-b9db-66cec4f9c0d2 tempest-VolumesDeleteCascade-1905403258 None] Deleting offline snapshot 6818b007-d773-4907-89c1-cd2acf15129e of volume 3f905460-f466-4596-9136-5da0aa080886 {{(pid=87747) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 03:27:45 devstack sudo[101441]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:45 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-45741343-8e61-4fa1-b9db-66cec4f9c0d2 tempest-VolumesDeleteCascade-1905403258 None] snapshot_file for this snap is: volume-3f905460-f466-4596-9136-5da0aa080886.6818b007-d773-4907-89c1-cd2acf15129e {{(pid=87747) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 03:27:45 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-70857c18-e231-4580-94db-7c792887f8fd tempest-CreateVolumesFromImageTest-713888814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.259s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:45 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-70857c18-e231-4580-94db-7c792887f8fd tempest-CreateVolumesFromImageTest-713888814 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:27:45 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-70857c18-e231-4580-94db-7c792887f8fd tempest-CreateVolumesFromImageTest-713888814 None] Deleted volume successfully. Jul 22 03:27:45 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[94932c0c-2836-4038-9013-28b6c5cb6184]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:27:45 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-45741343-8e61-4fa1-b9db-66cec4f9c0d2 tempest-VolumesDeleteCascade-1905403258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3f905460-f466-4596-9136-5da0aa080886.6818b007-d773-4907-89c1-cd2acf15129e {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:45 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-70857c18-e231-4580-94db-7c792887f8fd tempest-CreateVolumesFromImageTest-713888814 None] Lock "cinder-885f9ea1-ad78-475e-8225-aae0a2eddda2-delete_volume" released by "delete_volume" :: held 1.131s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:27:45 devstack sudo[101444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3f905460-f466-4596-9136-5da0aa080886.6818b007-d773-4907-89c1-cd2acf15129e Jul 22 03:27:45 devstack sudo[101444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:45 devstack sudo[101444]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:45 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-45741343-8e61-4fa1-b9db-66cec4f9c0d2 tempest-VolumesDeleteCascade-1905403258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3f905460-f466-4596-9136-5da0aa080886.6818b007-d773-4907-89c1-cd2acf15129e" returned: 0 in 0.368s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:45 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-45741343-8e61-4fa1-b9db-66cec4f9c0d2 tempest-VolumesDeleteCascade-1905403258 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f905460-f466-4596-9136-5da0aa080886(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87747) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 03:27:45 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[781f52d9-1729-47f8-995f-1a6f3475279b]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:27:45 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-45741343-8e61-4fa1-b9db-66cec4f9c0d2 tempest-VolumesDeleteCascade-1905403258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3f905460-f466-4596-9136-5da0aa080886 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:45 devstack sudo[101449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3f905460-f466-4596-9136-5da0aa080886 Jul 22 03:27:45 devstack sudo[101449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:46 devstack sudo[101449]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:46 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-45741343-8e61-4fa1-b9db-66cec4f9c0d2 tempest-VolumesDeleteCascade-1905403258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3f905460-f466-4596-9136-5da0aa080886" returned: 0 in 0.368s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:46 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[47efedb9-04ea-4e46-a088-b886d21a46c5]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:27:46 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-45741343-8e61-4fa1-b9db-66cec4f9c0d2 tempest-VolumesDeleteCascade-1905403258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3f905460-f466-4596-9136-5da0aa080886.6f5ce50d-2ef0-4923-8e2d-d94e5b13bb01 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:46 devstack sudo[101454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3f905460-f466-4596-9136-5da0aa080886.6f5ce50d-2ef0-4923-8e2d-d94e5b13bb01 Jul 22 03:27:46 devstack sudo[101454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:46 devstack sudo[101454]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:46 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-45741343-8e61-4fa1-b9db-66cec4f9c0d2 tempest-VolumesDeleteCascade-1905403258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3f905460-f466-4596-9136-5da0aa080886.6f5ce50d-2ef0-4923-8e2d-d94e5b13bb01" returned: 0 in 0.385s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:46 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-45741343-8e61-4fa1-b9db-66cec4f9c0d2 tempest-VolumesDeleteCascade-1905403258 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f905460-f466-4596-9136-5da0aa080886(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87747) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 03:27:46 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[12a8cb09-9262-47b1-a059-e6112445ee5d]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:27:46 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-45741343-8e61-4fa1-b9db-66cec4f9c0d2 tempest-VolumesDeleteCascade-1905403258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3f905460-f466-4596-9136-5da0aa080886.6818b007-d773-4907-89c1-cd2acf15129e {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:46 devstack sudo[101459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3f905460-f466-4596-9136-5da0aa080886.6818b007-d773-4907-89c1-cd2acf15129e Jul 22 03:27:46 devstack sudo[101459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:46 devstack sudo[101459]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:46 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-45741343-8e61-4fa1-b9db-66cec4f9c0d2 tempest-VolumesDeleteCascade-1905403258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3f905460-f466-4596-9136-5da0aa080886.6818b007-d773-4907-89c1-cd2acf15129e" returned: 0 in 0.374s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:46 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-45741343-8e61-4fa1-b9db-66cec4f9c0d2 tempest-VolumesDeleteCascade-1905403258 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f905460-f466-4596-9136-5da0aa080886(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87747) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 03:27:46 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d529253-c9b4-4be4-9c50-e8898e2d5659]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:27:46 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-45741343-8e61-4fa1-b9db-66cec4f9c0d2 tempest-VolumesDeleteCascade-1905403258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3f905460-f466-4596-9136-5da0aa080886 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:47 devstack sudo[101464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3f905460-f466-4596-9136-5da0aa080886 Jul 22 03:27:47 devstack sudo[101464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:47 devstack sudo[101464]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:47 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-45741343-8e61-4fa1-b9db-66cec4f9c0d2 tempest-VolumesDeleteCascade-1905403258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3f905460-f466-4596-9136-5da0aa080886" returned: 0 in 0.361s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:47 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-45741343-8e61-4fa1-b9db-66cec4f9c0d2 tempest-VolumesDeleteCascade-1905403258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3f905460-f466-4596-9136-5da0aa080886.6818b007-d773-4907-89c1-cd2acf15129e {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:47 devstack sudo[101469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3f905460-f466-4596-9136-5da0aa080886.6818b007-d773-4907-89c1-cd2acf15129e Jul 22 03:27:47 devstack sudo[101469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:47 devstack sudo[101469]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:47 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-45741343-8e61-4fa1-b9db-66cec4f9c0d2 tempest-VolumesDeleteCascade-1905403258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3f905460-f466-4596-9136-5da0aa080886.6818b007-d773-4907-89c1-cd2acf15129e" returned: 0 in 0.339s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:47 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-45741343-8e61-4fa1-b9db-66cec4f9c0d2 tempest-VolumesDeleteCascade-1905403258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3f905460-f466-4596-9136-5da0aa080886.6818b007-d773-4907-89c1-cd2acf15129e {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:47 devstack sudo[101475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3f905460-f466-4596-9136-5da0aa080886.6818b007-d773-4907-89c1-cd2acf15129e Jul 22 03:27:47 devstack sudo[101475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:47 devstack sudo[101475]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:47 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-45741343-8e61-4fa1-b9db-66cec4f9c0d2 tempest-VolumesDeleteCascade-1905403258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3f905460-f466-4596-9136-5da0aa080886.6818b007-d773-4907-89c1-cd2acf15129e" returned: 0 in 0.264s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:47 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-45741343-8e61-4fa1-b9db-66cec4f9c0d2 tempest-VolumesDeleteCascade-1905403258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f905460-f466-4596-9136-5da0aa080886 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3f905460-f466-4596-9136-5da0aa080886.6f5ce50d-2ef0-4923-8e2d-d94e5b13bb01 -F qcow2 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:47 devstack sudo[101478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f905460-f466-4596-9136-5da0aa080886 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3f905460-f466-4596-9136-5da0aa080886.6f5ce50d-2ef0-4923-8e2d-d94e5b13bb01 -F qcow2 Jul 22 03:27:47 devstack sudo[101478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:48 devstack cinder-volume[87747]: DEBUG dbcounter [-] [87747] Writing DB stats cinder:UPDATE=169,cinder:SELECT=132,cinder:INSERT=44,cinder:DELETE=12 {{(pid=87747) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 03:27:48 devstack cinder-volume[87747]: DEBUG dbcounter [-] [87747] Writing DB stats cinder:SELECT=138,cinder:UPDATE=157,cinder:DELETE=17,cinder:INSERT=41 {{(pid=87747) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 03:27:48 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-7189fa34-cec6-4fd5-bb35-438bfbe029d8 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:27:48 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-7189fa34-cec6-4fd5-bb35-438bfbe029d8 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Flow 'volume_create_manager' (9099851a-0843-4fea-b34f-c0e08a5a1c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:27:48 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-7189fa34-cec6-4fd5-bb35-438bfbe029d8 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59946586-d3e2-4870-b80c-7bdcea30f53d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:48 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-7189fa34-cec6-4fd5-bb35-438bfbe029d8 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59946586-d3e2-4870-b80c-7bdcea30f53d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:27:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-589913040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7989d03-019f-4749-b59d-f2a429582a71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dede3142f88f4d12b564270f879499d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:27:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:27:48Z,use_quota=True,user_id='326444355bf74788a4c868afe4dfabdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:48 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-7189fa34-cec6-4fd5-bb35-438bfbe029d8 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25e99eba-14d4-4869-8c57-55a8e4152dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:48 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-7189fa34-cec6-4fd5-bb35-438bfbe029d8 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25e99eba-14d4-4869-8c57-55a8e4152dab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:48 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-7189fa34-cec6-4fd5-bb35-438bfbe029d8 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45793158-a2ff-490a-914e-fc3270c6eb80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:48 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-7189fa34-cec6-4fd5-bb35-438bfbe029d8 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45793158-a2ff-490a-914e-fc3270c6eb80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7989d03-019f-4749-b59d-f2a429582a71', 'volume_name': 'volume-f7989d03-019f-4749-b59d-f2a429582a71', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:48 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-7189fa34-cec6-4fd5-bb35-438bfbe029d8 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14f95d21-7619-4348-9e04-258d026fb391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:48 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-7189fa34-cec6-4fd5-bb35-438bfbe029d8 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14f95d21-7619-4348-9e04-258d026fb391) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:48 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-7189fa34-cec6-4fd5-bb35-438bfbe029d8 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (941b8c8a-4b69-4aa8-ac17-b9427e7c53d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:48 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-7189fa34-cec6-4fd5-bb35-438bfbe029d8 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Volume f7989d03-019f-4749-b59d-f2a429582a71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7989d03-019f-4749-b59d-f2a429582a71', 'volume_size': 1} Jul 22 03:27:48 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-7189fa34-cec6-4fd5-bb35-438bfbe029d8 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:27:48 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-7189fa34-cec6-4fd5-bb35-438bfbe029d8 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:27:48 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-7189fa34-cec6-4fd5-bb35-438bfbe029d8 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:27:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-589913040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7989d03-019f-4749-b59d-f2a429582a71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dede3142f88f4d12b564270f879499d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:27:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:27:48Z,use_quota=True,user_id='326444355bf74788a4c868afe4dfabdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:27:48 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-7189fa34-cec6-4fd5-bb35-438bfbe029d8 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Creating volume f7989d03-019f-4749-b59d-f2a429582a71 {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:27:48 devstack sudo[101478]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:48 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-7189fa34-cec6-4fd5-bb35-438bfbe029d8 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:27:48 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-7189fa34-cec6-4fd5-bb35-438bfbe029d8 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:27:48 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-7189fa34-cec6-4fd5-bb35-438bfbe029d8 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:27:48 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-7189fa34-cec6-4fd5-bb35-438bfbe029d8 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:27:48 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-7189fa34-cec6-4fd5-bb35-438bfbe029d8 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:27:48 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-7189fa34-cec6-4fd5-bb35-438bfbe029d8 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:27:48 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-7189fa34-cec6-4fd5-bb35-438bfbe029d8 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:27:48 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-7189fa34-cec6-4fd5-bb35-438bfbe029d8 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-f7989d03-019f-4749-b59d-f2a429582a71 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:48 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-45741343-8e61-4fa1-b9db-66cec4f9c0d2 tempest-VolumesDeleteCascade-1905403258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f905460-f466-4596-9136-5da0aa080886 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3f905460-f466-4596-9136-5da0aa080886.6f5ce50d-2ef0-4923-8e2d-d94e5b13bb01 -F qcow2" returned: 0 in 0.312s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:48 devstack sudo[101483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-f7989d03-019f-4749-b59d-f2a429582a71 1073741824 Jul 22 03:27:48 devstack sudo[101483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:48 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-45741343-8e61-4fa1-b9db-66cec4f9c0d2 tempest-VolumesDeleteCascade-1905403258 None] Lock "cinder-quobyte-6818b007-d773-4907-89c1-cd2acf15129e" released by "_delete_snapshot" :: held 2.957s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:27:48 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-45741343-8e61-4fa1-b9db-66cec4f9c0d2 tempest-VolumesDeleteCascade-1905403258 None] Lock "cinder-quobyte-3f905460-f466-4596-9136-5da0aa080886" released by "delete_snapshot" :: held 2.982s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:27:48 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-45741343-8e61-4fa1-b9db-66cec4f9c0d2 tempest-VolumesDeleteCascade-1905403258 None] Created reservations ['f8251144-48c2-4fcc-9d01-063859a784d7', '03c1d35f-092e-4ca5-9839-b5e1d1cd2d6a', '36cf211c-aab5-4353-9f61-f9e026d25bca', '5addf30b-82f8-4701-841c-0fcf09759b28'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:27:48 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-45741343-8e61-4fa1-b9db-66cec4f9c0d2 tempest-VolumesDeleteCascade-1905403258 None] Delete snapshot completed successfully. Jul 22 03:27:48 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-45741343-8e61-4fa1-b9db-66cec4f9c0d2 tempest-VolumesDeleteCascade-1905403258 None] Lock "cinder-6818b007-d773-4907-89c1-cd2acf15129e-delete_snapshot" released by "delete_snapshot" :: held 3.141s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:27:48 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-45741343-8e61-4fa1-b9db-66cec4f9c0d2 tempest-VolumesDeleteCascade-1905403258 None] Acquiring lock "cinder-6f5ce50d-2ef0-4923-8e2d-d94e5b13bb01-delete_snapshot" by "delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:27:48 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-45741343-8e61-4fa1-b9db-66cec4f9c0d2 tempest-VolumesDeleteCascade-1905403258 None] Lock "cinder-6f5ce50d-2ef0-4923-8e2d-d94e5b13bb01-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:27:48 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-45741343-8e61-4fa1-b9db-66cec4f9c0d2 tempest-VolumesDeleteCascade-1905403258 None] Acquiring lock "cinder-quobyte-3f905460-f466-4596-9136-5da0aa080886" by "delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:27:48 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-45741343-8e61-4fa1-b9db-66cec4f9c0d2 tempest-VolumesDeleteCascade-1905403258 None] Lock "cinder-quobyte-3f905460-f466-4596-9136-5da0aa080886" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:27:48 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-45741343-8e61-4fa1-b9db-66cec4f9c0d2 tempest-VolumesDeleteCascade-1905403258 None] Acquiring lock "cinder-quobyte-6f5ce50d-2ef0-4923-8e2d-d94e5b13bb01" by "_delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:27:48 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-45741343-8e61-4fa1-b9db-66cec4f9c0d2 tempest-VolumesDeleteCascade-1905403258 None] Lock "cinder-quobyte-6f5ce50d-2ef0-4923-8e2d-d94e5b13bb01" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:27:48 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-45741343-8e61-4fa1-b9db-66cec4f9c0d2 tempest-VolumesDeleteCascade-1905403258 None] Deleting offline snapshot 6f5ce50d-2ef0-4923-8e2d-d94e5b13bb01 of volume 3f905460-f466-4596-9136-5da0aa080886 {{(pid=87747) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 03:27:48 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-45741343-8e61-4fa1-b9db-66cec4f9c0d2 tempest-VolumesDeleteCascade-1905403258 None] snapshot_file for this snap is: volume-3f905460-f466-4596-9136-5da0aa080886.6f5ce50d-2ef0-4923-8e2d-d94e5b13bb01 {{(pid=87747) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 03:27:48 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0772b63-f7b3-4651-b786-a6216e0b3ca8]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:27:48 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-45741343-8e61-4fa1-b9db-66cec4f9c0d2 tempest-VolumesDeleteCascade-1905403258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3f905460-f466-4596-9136-5da0aa080886.6f5ce50d-2ef0-4923-8e2d-d94e5b13bb01 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:48 devstack sudo[101488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3f905460-f466-4596-9136-5da0aa080886.6f5ce50d-2ef0-4923-8e2d-d94e5b13bb01 Jul 22 03:27:48 devstack sudo[101488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:48 devstack sudo[101483]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:48 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-7189fa34-cec6-4fd5-bb35-438bfbe029d8 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-f7989d03-019f-4749-b59d-f2a429582a71 1073741824" returned: 0 in 0.475s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:48 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-7189fa34-cec6-4fd5-bb35-438bfbe029d8 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-f7989d03-019f-4749-b59d-f2a429582a71 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:48 devstack sudo[101491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-f7989d03-019f-4749-b59d-f2a429582a71 Jul 22 03:27:48 devstack sudo[101491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:48 devstack sudo[101488]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:48 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-45741343-8e61-4fa1-b9db-66cec4f9c0d2 tempest-VolumesDeleteCascade-1905403258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3f905460-f466-4596-9136-5da0aa080886.6f5ce50d-2ef0-4923-8e2d-d94e5b13bb01" returned: 0 in 0.371s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:48 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-45741343-8e61-4fa1-b9db-66cec4f9c0d2 tempest-VolumesDeleteCascade-1905403258 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f905460-f466-4596-9136-5da0aa080886(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87747) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 03:27:48 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fdb97ed-abd4-4eb9-bc8d-1d48a31319ce]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:27:48 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-45741343-8e61-4fa1-b9db-66cec4f9c0d2 tempest-VolumesDeleteCascade-1905403258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3f905460-f466-4596-9136-5da0aa080886 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:48 devstack sudo[101491]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:48 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-7189fa34-cec6-4fd5-bb35-438bfbe029d8 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-f7989d03-019f-4749-b59d-f2a429582a71" returned: 0 in 0.260s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:48 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-7189fa34-cec6-4fd5-bb35-438bfbe029d8 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] <== create_volume: return (781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:27:48 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-7189fa34-cec6-4fd5-bb35-438bfbe029d8 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.784s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:27:48 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-7189fa34-cec6-4fd5-bb35-438bfbe029d8 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (941b8c8a-4b69-4aa8-ac17-b9427e7c53d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7989d03-019f-4749-b59d-f2a429582a71', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:48 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-7189fa34-cec6-4fd5-bb35-438bfbe029d8 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9960d9a9-7423-4d3b-a4b6-238b856f9f9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:49 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-7189fa34-cec6-4fd5-bb35-438bfbe029d8 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Volume volume-f7989d03-019f-4749-b59d-f2a429582a71 (f7989d03-019f-4749-b59d-f2a429582a71): created successfully Jul 22 03:27:49 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-7189fa34-cec6-4fd5-bb35-438bfbe029d8 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9960d9a9-7423-4d3b-a4b6-238b856f9f9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:49 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-7189fa34-cec6-4fd5-bb35-438bfbe029d8 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Flow 'volume_create_manager' (9099851a-0843-4fea-b34f-c0e08a5a1c04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:27:49 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-7189fa34-cec6-4fd5-bb35-438bfbe029d8 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Created volume successfully. Jul 22 03:27:49 devstack sudo[101496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3f905460-f466-4596-9136-5da0aa080886 Jul 22 03:27:49 devstack sudo[101496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:49 devstack sudo[101496]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:49 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-45741343-8e61-4fa1-b9db-66cec4f9c0d2 tempest-VolumesDeleteCascade-1905403258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3f905460-f466-4596-9136-5da0aa080886" returned: 0 in 0.351s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:49 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-45741343-8e61-4fa1-b9db-66cec4f9c0d2 tempest-VolumesDeleteCascade-1905403258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3f905460-f466-4596-9136-5da0aa080886.6f5ce50d-2ef0-4923-8e2d-d94e5b13bb01 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:49 devstack sudo[101502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3f905460-f466-4596-9136-5da0aa080886.6f5ce50d-2ef0-4923-8e2d-d94e5b13bb01 Jul 22 03:27:49 devstack sudo[101502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:49 devstack sudo[101502]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:49 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-45741343-8e61-4fa1-b9db-66cec4f9c0d2 tempest-VolumesDeleteCascade-1905403258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3f905460-f466-4596-9136-5da0aa080886.6f5ce50d-2ef0-4923-8e2d-d94e5b13bb01" returned: 0 in 0.329s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:49 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-45741343-8e61-4fa1-b9db-66cec4f9c0d2 tempest-VolumesDeleteCascade-1905403258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3f905460-f466-4596-9136-5da0aa080886.6f5ce50d-2ef0-4923-8e2d-d94e5b13bb01 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:49 devstack sudo[101507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3f905460-f466-4596-9136-5da0aa080886.6f5ce50d-2ef0-4923-8e2d-d94e5b13bb01 Jul 22 03:27:49 devstack sudo[101507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:49 devstack sudo[101507]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:49 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-45741343-8e61-4fa1-b9db-66cec4f9c0d2 tempest-VolumesDeleteCascade-1905403258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3f905460-f466-4596-9136-5da0aa080886.6f5ce50d-2ef0-4923-8e2d-d94e5b13bb01" returned: 0 in 0.240s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:49 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-45741343-8e61-4fa1-b9db-66cec4f9c0d2 tempest-VolumesDeleteCascade-1905403258 None] Lock "cinder-quobyte-6f5ce50d-2ef0-4923-8e2d-d94e5b13bb01" released by "_delete_snapshot" :: held 1.385s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:27:49 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-45741343-8e61-4fa1-b9db-66cec4f9c0d2 tempest-VolumesDeleteCascade-1905403258 None] Lock "cinder-quobyte-3f905460-f466-4596-9136-5da0aa080886" released by "delete_snapshot" :: held 1.414s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:27:49 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-45741343-8e61-4fa1-b9db-66cec4f9c0d2 tempest-VolumesDeleteCascade-1905403258 None] Created reservations ['ce0e5d0c-d258-43a9-8605-c682c861c1d2', '7234f376-b24d-4e31-aae2-6cb5b71098c9', '13e5f75c-f3cd-4311-b89e-a095f2b7307b', 'd73ed941-23b3-4ea5-9f38-b46b8772ab1d'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:27:50 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-45741343-8e61-4fa1-b9db-66cec4f9c0d2 tempest-VolumesDeleteCascade-1905403258 None] Delete snapshot completed successfully. Jul 22 03:27:50 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-45741343-8e61-4fa1-b9db-66cec4f9c0d2 tempest-VolumesDeleteCascade-1905403258 None] Lock "cinder-6f5ce50d-2ef0-4923-8e2d-d94e5b13bb01-delete_snapshot" released by "delete_snapshot" :: held 1.613s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:27:50 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-45741343-8e61-4fa1-b9db-66cec4f9c0d2 tempest-VolumesDeleteCascade-1905403258 None] Snapshots deleted, issuing volume delete {{(pid=87747) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 22 03:27:50 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-45741343-8e61-4fa1-b9db-66cec4f9c0d2 tempest-VolumesDeleteCascade-1905403258 None] Acquiring lock "cinder-quobyte-3f905460-f466-4596-9136-5da0aa080886" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:27:50 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-45741343-8e61-4fa1-b9db-66cec4f9c0d2 tempest-VolumesDeleteCascade-1905403258 None] Lock "cinder-quobyte-3f905460-f466-4596-9136-5da0aa080886" acquired by "delete_volume" :: waited 0.013s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:27:50 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[0af97cc7-cd95-4180-9e8f-ea7fbecbd6d3]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:27:50 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-45741343-8e61-4fa1-b9db-66cec4f9c0d2 tempest-VolumesDeleteCascade-1905403258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3f905460-f466-4596-9136-5da0aa080886 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:50 devstack sudo[101510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3f905460-f466-4596-9136-5da0aa080886 Jul 22 03:27:50 devstack sudo[101510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:50 devstack sudo[101510]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:50 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-45741343-8e61-4fa1-b9db-66cec4f9c0d2 tempest-VolumesDeleteCascade-1905403258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3f905460-f466-4596-9136-5da0aa080886" returned: 0 in 0.376s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:50 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-45741343-8e61-4fa1-b9db-66cec4f9c0d2 tempest-VolumesDeleteCascade-1905403258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3f905460-f466-4596-9136-5da0aa080886 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:50 devstack sudo[101515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3f905460-f466-4596-9136-5da0aa080886 Jul 22 03:27:50 devstack sudo[101515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:50 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-5117da7d-3d26-421c-ada5-b34ea7397b54 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:27:50 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-5117da7d-3d26-421c-ada5-b34ea7397b54 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Flow 'volume_create_manager' (d92627f5-7f26-4a6a-948c-cead11bcef31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:27:50 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-5117da7d-3d26-421c-ada5-b34ea7397b54 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (436a3b33-076e-4827-a505-dcf12f09effc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:50 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-5117da7d-3d26-421c-ada5-b34ea7397b54 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (436a3b33-076e-4827-a505-dcf12f09effc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:27:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-438329072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fcea350-67fe-4f43-a90c-26e0b701ef93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dede3142f88f4d12b564270f879499d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:27:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:27:51Z,use_quota=True,user_id='326444355bf74788a4c868afe4dfabdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:50 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-5117da7d-3d26-421c-ada5-b34ea7397b54 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe0e7b63-d156-47d6-8a46-198252a97294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:50 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-5117da7d-3d26-421c-ada5-b34ea7397b54 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe0e7b63-d156-47d6-8a46-198252a97294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:50 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-5117da7d-3d26-421c-ada5-b34ea7397b54 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee2bdfe6-9344-449e-88f4-d45ca0a51973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:50 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-5117da7d-3d26-421c-ada5-b34ea7397b54 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee2bdfe6-9344-449e-88f4-d45ca0a51973) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2fcea350-67fe-4f43-a90c-26e0b701ef93', 'volume_name': 'volume-2fcea350-67fe-4f43-a90c-26e0b701ef93', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:50 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-5117da7d-3d26-421c-ada5-b34ea7397b54 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (095ff4fc-0b7f-4271-b67a-f8f9e9afa51e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:50 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-5117da7d-3d26-421c-ada5-b34ea7397b54 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (095ff4fc-0b7f-4271-b67a-f8f9e9afa51e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:50 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-5117da7d-3d26-421c-ada5-b34ea7397b54 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f1707cb-61f8-496e-9805-d3352181abc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:50 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-5117da7d-3d26-421c-ada5-b34ea7397b54 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Volume 2fcea350-67fe-4f43-a90c-26e0b701ef93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2fcea350-67fe-4f43-a90c-26e0b701ef93', 'volume_size': 1} Jul 22 03:27:50 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-5117da7d-3d26-421c-ada5-b34ea7397b54 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:27:50 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-5117da7d-3d26-421c-ada5-b34ea7397b54 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:27:50 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-5117da7d-3d26-421c-ada5-b34ea7397b54 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:27:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-438329072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fcea350-67fe-4f43-a90c-26e0b701ef93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dede3142f88f4d12b564270f879499d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:27:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:27:51Z,use_quota=True,user_id='326444355bf74788a4c868afe4dfabdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:27:50 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-5117da7d-3d26-421c-ada5-b34ea7397b54 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Creating volume 2fcea350-67fe-4f43-a90c-26e0b701ef93 {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:27:50 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-5117da7d-3d26-421c-ada5-b34ea7397b54 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:27:50 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-5117da7d-3d26-421c-ada5-b34ea7397b54 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:27:50 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-5117da7d-3d26-421c-ada5-b34ea7397b54 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:27:50 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-5117da7d-3d26-421c-ada5-b34ea7397b54 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:27:50 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-5117da7d-3d26-421c-ada5-b34ea7397b54 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:27:50 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-5117da7d-3d26-421c-ada5-b34ea7397b54 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:27:50 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-5117da7d-3d26-421c-ada5-b34ea7397b54 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:27:50 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5117da7d-3d26-421c-ada5-b34ea7397b54 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2fcea350-67fe-4f43-a90c-26e0b701ef93 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:50 devstack sudo[101518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2fcea350-67fe-4f43-a90c-26e0b701ef93 1073741824 Jul 22 03:27:50 devstack sudo[101518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:50 devstack sudo[101515]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:50 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-45741343-8e61-4fa1-b9db-66cec4f9c0d2 tempest-VolumesDeleteCascade-1905403258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3f905460-f466-4596-9136-5da0aa080886" returned: 0 in 0.284s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:50 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-45741343-8e61-4fa1-b9db-66cec4f9c0d2 tempest-VolumesDeleteCascade-1905403258 None] Lock "cinder-quobyte-3f905460-f466-4596-9136-5da0aa080886" released by "delete_volume" :: held 0.730s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:27:50 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-45741343-8e61-4fa1-b9db-66cec4f9c0d2 tempest-VolumesDeleteCascade-1905403258 None] Created reservations ['098f83b0-8e80-4c6a-95e8-44b3548f1c88', '13e8bf3b-55ea-466b-a4ef-0bc7d88fa444', '529ae0dd-5d19-42aa-82ef-de2cf986d1a9', 'c131b8a4-3786-44f9-bf9a-da53983bc88e'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:27:50 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-45741343-8e61-4fa1-b9db-66cec4f9c0d2 tempest-VolumesDeleteCascade-1905403258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:27:50 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-45741343-8e61-4fa1-b9db-66cec4f9c0d2 tempest-VolumesDeleteCascade-1905403258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:27:50 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-45741343-8e61-4fa1-b9db-66cec4f9c0d2 tempest-VolumesDeleteCascade-1905403258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:27:50 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-45741343-8e61-4fa1-b9db-66cec4f9c0d2 tempest-VolumesDeleteCascade-1905403258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:27:50 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-45741343-8e61-4fa1-b9db-66cec4f9c0d2 tempest-VolumesDeleteCascade-1905403258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:27:50 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-45741343-8e61-4fa1-b9db-66cec4f9c0d2 tempest-VolumesDeleteCascade-1905403258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:50 devstack sudo[101520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:27:50 devstack sudo[101520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:51 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef65dd03-b621-4d60-a08e-bf20f97ec47d tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:27:51 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-ef65dd03-b621-4d60-a08e-bf20f97ec47d tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Flow 'volume_create_manager' (d4faec00-f170-4a6f-bcf6-aece15fbf80a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:27:51 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-ef65dd03-b621-4d60-a08e-bf20f97ec47d tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0df4d768-d4ee-43c3-844c-c31428f7c227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:51 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-ef65dd03-b621-4d60-a08e-bf20f97ec47d tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0df4d768-d4ee-43c3-844c-c31428f7c227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:27:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-302338897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e70617c-9d43-425c-9370-68e669cf4712,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dede3142f88f4d12b564270f879499d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:27:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:27:51Z,use_quota=True,user_id='326444355bf74788a4c868afe4dfabdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:51 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-ef65dd03-b621-4d60-a08e-bf20f97ec47d tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9f95a5d-f9a6-4441-bc93-080fb8181dba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:51 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-ef65dd03-b621-4d60-a08e-bf20f97ec47d tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9f95a5d-f9a6-4441-bc93-080fb8181dba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:51 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-ef65dd03-b621-4d60-a08e-bf20f97ec47d tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87df6a63-4bbe-4952-ba22-ddf88312c6cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:51 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-ef65dd03-b621-4d60-a08e-bf20f97ec47d tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87df6a63-4bbe-4952-ba22-ddf88312c6cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e70617c-9d43-425c-9370-68e669cf4712', 'volume_name': 'volume-0e70617c-9d43-425c-9370-68e669cf4712', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:51 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-ef65dd03-b621-4d60-a08e-bf20f97ec47d tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97808e85-31b2-4a90-b4f7-fbf2486995df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:51 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-ef65dd03-b621-4d60-a08e-bf20f97ec47d tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97808e85-31b2-4a90-b4f7-fbf2486995df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:51 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-ef65dd03-b621-4d60-a08e-bf20f97ec47d tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31ae800e-0e5d-42b1-a9fa-865d6588f815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:51 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-ef65dd03-b621-4d60-a08e-bf20f97ec47d tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Volume 0e70617c-9d43-425c-9370-68e669cf4712: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e70617c-9d43-425c-9370-68e669cf4712', 'volume_size': 1} Jul 22 03:27:51 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-ef65dd03-b621-4d60-a08e-bf20f97ec47d tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:27:51 devstack sudo[101520]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:51 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-45741343-8e61-4fa1-b9db-66cec4f9c0d2 tempest-VolumesDeleteCascade-1905403258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.301s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:51 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-45741343-8e61-4fa1-b9db-66cec4f9c0d2 tempest-VolumesDeleteCascade-1905403258 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:27:51 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-45741343-8e61-4fa1-b9db-66cec4f9c0d2 tempest-VolumesDeleteCascade-1905403258 None] Deleted volume successfully. Jul 22 03:27:51 devstack sudo[101518]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:51 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5117da7d-3d26-421c-ada5-b34ea7397b54 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2fcea350-67fe-4f43-a90c-26e0b701ef93 1073741824" returned: 0 in 0.536s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:51 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-45741343-8e61-4fa1-b9db-66cec4f9c0d2 tempest-VolumesDeleteCascade-1905403258 None] Lock "cinder-3f905460-f466-4596-9136-5da0aa080886-delete_volume" released by "delete_volume" :: held 6.071s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:27:51 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5117da7d-3d26-421c-ada5-b34ea7397b54 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2fcea350-67fe-4f43-a90c-26e0b701ef93 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:51 devstack sudo[101527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2fcea350-67fe-4f43-a90c-26e0b701ef93 Jul 22 03:27:51 devstack sudo[101527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:51 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-50e66af7-c6a7-43c8-86b4-12266886620c tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:27:51 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-50e66af7-c6a7-43c8-86b4-12266886620c tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Flow 'volume_create_manager' (12f1367e-c2c0-440b-9708-1560399e982d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:27:51 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-50e66af7-c6a7-43c8-86b4-12266886620c tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45e5db95-ce43-4c91-a127-68129d9a6b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:51 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-50e66af7-c6a7-43c8-86b4-12266886620c tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45e5db95-ce43-4c91-a127-68129d9a6b09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:27:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1291771117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29735b2a-a38b-464b-a265-b46a52aee150,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dede3142f88f4d12b564270f879499d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:27:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:27:51Z,use_quota=True,user_id='326444355bf74788a4c868afe4dfabdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:51 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-50e66af7-c6a7-43c8-86b4-12266886620c tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5005e9cf-fb88-4248-8f5f-ca6855fdb925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:51 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-50e66af7-c6a7-43c8-86b4-12266886620c tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5005e9cf-fb88-4248-8f5f-ca6855fdb925) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:51 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-50e66af7-c6a7-43c8-86b4-12266886620c tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (503689a0-8279-496e-ba49-40a406ad5490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:51 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-50e66af7-c6a7-43c8-86b4-12266886620c tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (503689a0-8279-496e-ba49-40a406ad5490) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29735b2a-a38b-464b-a265-b46a52aee150', 'volume_name': 'volume-29735b2a-a38b-464b-a265-b46a52aee150', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:51 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-50e66af7-c6a7-43c8-86b4-12266886620c tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (796f0064-a2e7-4b88-8d1b-ebe90d87c4d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:51 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-50e66af7-c6a7-43c8-86b4-12266886620c tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (796f0064-a2e7-4b88-8d1b-ebe90d87c4d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:51 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-50e66af7-c6a7-43c8-86b4-12266886620c tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd99edfd-8f48-4ce0-a664-870f79a9faff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:51 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-50e66af7-c6a7-43c8-86b4-12266886620c tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Volume 29735b2a-a38b-464b-a265-b46a52aee150: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29735b2a-a38b-464b-a265-b46a52aee150', 'volume_size': 1} Jul 22 03:27:51 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-50e66af7-c6a7-43c8-86b4-12266886620c tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:27:51 devstack sudo[101527]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:51 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5117da7d-3d26-421c-ada5-b34ea7397b54 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2fcea350-67fe-4f43-a90c-26e0b701ef93" returned: 0 in 0.277s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:51 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-5117da7d-3d26-421c-ada5-b34ea7397b54 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:27:51 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-5117da7d-3d26-421c-ada5-b34ea7397b54 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.861s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:27:51 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-ef65dd03-b621-4d60-a08e-bf20f97ec47d tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.453s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:27:51 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-ef65dd03-b621-4d60-a08e-bf20f97ec47d tempest-CreateVolumesFromSourceVolumeTest-793254913 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:27:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-302338897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e70617c-9d43-425c-9370-68e669cf4712,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dede3142f88f4d12b564270f879499d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:27:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:27:51Z,use_quota=True,user_id='326444355bf74788a4c868afe4dfabdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:27:51 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-ef65dd03-b621-4d60-a08e-bf20f97ec47d tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Creating volume 0e70617c-9d43-425c-9370-68e669cf4712 {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:27:51 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-ef65dd03-b621-4d60-a08e-bf20f97ec47d tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:27:51 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-ef65dd03-b621-4d60-a08e-bf20f97ec47d tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:27:51 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-ef65dd03-b621-4d60-a08e-bf20f97ec47d tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:27:51 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-ef65dd03-b621-4d60-a08e-bf20f97ec47d tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:27:51 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-ef65dd03-b621-4d60-a08e-bf20f97ec47d tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:27:51 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-ef65dd03-b621-4d60-a08e-bf20f97ec47d tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:27:51 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-ef65dd03-b621-4d60-a08e-bf20f97ec47d tempest-CreateVolumesFromSourceVolumeTest-793254913 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:27:51 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ef65dd03-b621-4d60-a08e-bf20f97ec47d tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0e70617c-9d43-425c-9370-68e669cf4712 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:51 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-5117da7d-3d26-421c-ada5-b34ea7397b54 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f1707cb-61f8-496e-9805-d3352181abc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fcea350-67fe-4f43-a90c-26e0b701ef93', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:51 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-5117da7d-3d26-421c-ada5-b34ea7397b54 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d30654b-1414-446f-a397-2318bcaa33de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:51 devstack sudo[101530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0e70617c-9d43-425c-9370-68e669cf4712 1073741824 Jul 22 03:27:51 devstack sudo[101530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:51 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-5117da7d-3d26-421c-ada5-b34ea7397b54 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Volume volume-2fcea350-67fe-4f43-a90c-26e0b701ef93 (2fcea350-67fe-4f43-a90c-26e0b701ef93): created successfully Jul 22 03:27:51 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-5117da7d-3d26-421c-ada5-b34ea7397b54 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d30654b-1414-446f-a397-2318bcaa33de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:51 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-5117da7d-3d26-421c-ada5-b34ea7397b54 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Flow 'volume_create_manager' (d92627f5-7f26-4a6a-948c-cead11bcef31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:27:51 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-5117da7d-3d26-421c-ada5-b34ea7397b54 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Created volume successfully. Jul 22 03:27:51 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9f3646d-b805-4f67-bb0b-4ca5585e1d45 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:27:51 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f9f3646d-b805-4f67-bb0b-4ca5585e1d45 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Flow 'volume_create_manager' (87e3b0c3-84e1-42f0-910f-faeb251f7699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:27:51 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f9f3646d-b805-4f67-bb0b-4ca5585e1d45 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (275b268f-1df1-420d-822e-7f8f7774f151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:51 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f9f3646d-b805-4f67-bb0b-4ca5585e1d45 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (275b268f-1df1-420d-822e-7f8f7774f151) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:27:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-96663345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59565563-095f-4baa-94de-8994f3b06342,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dede3142f88f4d12b564270f879499d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:27:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:27:52Z,use_quota=True,user_id='326444355bf74788a4c868afe4dfabdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:51 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f9f3646d-b805-4f67-bb0b-4ca5585e1d45 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6b03a94-09e5-4cc7-84a0-f0c42c607278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:51 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f9f3646d-b805-4f67-bb0b-4ca5585e1d45 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6b03a94-09e5-4cc7-84a0-f0c42c607278) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:51 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f9f3646d-b805-4f67-bb0b-4ca5585e1d45 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b83d1c87-a15a-4674-8fbb-deb960d2042b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:51 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f9f3646d-b805-4f67-bb0b-4ca5585e1d45 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b83d1c87-a15a-4674-8fbb-deb960d2042b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59565563-095f-4baa-94de-8994f3b06342', 'volume_name': 'volume-59565563-095f-4baa-94de-8994f3b06342', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:51 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f9f3646d-b805-4f67-bb0b-4ca5585e1d45 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (083f089b-899f-4f26-a370-7ff36ec73750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:51 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f9f3646d-b805-4f67-bb0b-4ca5585e1d45 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (083f089b-899f-4f26-a370-7ff36ec73750) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:51 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f9f3646d-b805-4f67-bb0b-4ca5585e1d45 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b53aa6f8-cb77-42b0-b236-429266cdb43b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:51 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-f9f3646d-b805-4f67-bb0b-4ca5585e1d45 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Volume 59565563-095f-4baa-94de-8994f3b06342: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59565563-095f-4baa-94de-8994f3b06342', 'volume_size': 1} Jul 22 03:27:51 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-f9f3646d-b805-4f67-bb0b-4ca5585e1d45 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:27:52 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a9a1492-413d-465d-ba4d-c3079e31d674 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:27:52 devstack sudo[101530]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:52 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-3a9a1492-413d-465d-ba4d-c3079e31d674 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Flow 'volume_create_manager' (ff319ec8-c2f2-4b8d-8b96-77dda4214c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:27:52 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-3a9a1492-413d-465d-ba4d-c3079e31d674 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f38b248-ce27-44a3-bcac-edfdefd9afe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:52 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ef65dd03-b621-4d60-a08e-bf20f97ec47d tempest-CreateVolumesFromSourceVolumeTest-793254913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0e70617c-9d43-425c-9370-68e669cf4712 1073741824" returned: 0 in 0.630s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:52 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-3a9a1492-413d-465d-ba4d-c3079e31d674 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f38b248-ce27-44a3-bcac-edfdefd9afe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:27:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1364753044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee09b3d4-7760-4c1d-9a84-8cb87863da2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dede3142f88f4d12b564270f879499d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:27:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:27:52Z,use_quota=True,user_id='326444355bf74788a4c868afe4dfabdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:52 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-3a9a1492-413d-465d-ba4d-c3079e31d674 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03337a8c-89a3-4cf5-b5af-aed5c9888571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:52 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-3a9a1492-413d-465d-ba4d-c3079e31d674 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03337a8c-89a3-4cf5-b5af-aed5c9888571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:52 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-3a9a1492-413d-465d-ba4d-c3079e31d674 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f493313-8703-4ff9-b802-b1464a5870ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:52 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-3a9a1492-413d-465d-ba4d-c3079e31d674 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f493313-8703-4ff9-b802-b1464a5870ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee09b3d4-7760-4c1d-9a84-8cb87863da2e', 'volume_name': 'volume-ee09b3d4-7760-4c1d-9a84-8cb87863da2e', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:52 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-3a9a1492-413d-465d-ba4d-c3079e31d674 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c25af62-3115-41d0-b10f-6b1651b56ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:52 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-3a9a1492-413d-465d-ba4d-c3079e31d674 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c25af62-3115-41d0-b10f-6b1651b56ff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:52 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-3a9a1492-413d-465d-ba4d-c3079e31d674 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (313f9b87-6f5c-4bec-9679-2419345d2e27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:52 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-3a9a1492-413d-465d-ba4d-c3079e31d674 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Volume ee09b3d4-7760-4c1d-9a84-8cb87863da2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee09b3d4-7760-4c1d-9a84-8cb87863da2e', 'volume_size': 1} Jul 22 03:27:52 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-3a9a1492-413d-465d-ba4d-c3079e31d674 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:27:52 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ef65dd03-b621-4d60-a08e-bf20f97ec47d tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0e70617c-9d43-425c-9370-68e669cf4712 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:52 devstack sudo[101536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0e70617c-9d43-425c-9370-68e669cf4712 Jul 22 03:27:52 devstack sudo[101536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:52 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-b568f1d9-5194-45a0-bc63-56b0f47994a1 tempest-VolumesDeleteCascade-1905403258 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:27:52 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b568f1d9-5194-45a0-bc63-56b0f47994a1 tempest-VolumesDeleteCascade-1905403258 None] Flow 'volume_create_manager' (0f7e20e2-1b5d-470b-a1d6-01b8e01dbe67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:27:52 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b568f1d9-5194-45a0-bc63-56b0f47994a1 tempest-VolumesDeleteCascade-1905403258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1914b1eb-fb96-48b0-b99f-d440f720996d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:52 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b568f1d9-5194-45a0-bc63-56b0f47994a1 tempest-VolumesDeleteCascade-1905403258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1914b1eb-fb96-48b0-b99f-d440f720996d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:27:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-129624121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec40dfac-fb55-4aa0-a90b-0d239f6af583,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='957aeedd8a754e4988fe8ab5da853939',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:27:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:27:52Z,use_quota=True,user_id='107a6cab1dac4b9aac8d7b405ace1249',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:52 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b568f1d9-5194-45a0-bc63-56b0f47994a1 tempest-VolumesDeleteCascade-1905403258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (100bbdb3-f9a2-4cd7-a930-0e5304903a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:52 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b568f1d9-5194-45a0-bc63-56b0f47994a1 tempest-VolumesDeleteCascade-1905403258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (100bbdb3-f9a2-4cd7-a930-0e5304903a67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:52 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b568f1d9-5194-45a0-bc63-56b0f47994a1 tempest-VolumesDeleteCascade-1905403258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (417b0ee8-e177-4126-937a-5f450038304f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:52 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b568f1d9-5194-45a0-bc63-56b0f47994a1 tempest-VolumesDeleteCascade-1905403258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (417b0ee8-e177-4126-937a-5f450038304f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec40dfac-fb55-4aa0-a90b-0d239f6af583', 'volume_name': 'volume-ec40dfac-fb55-4aa0-a90b-0d239f6af583', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:52 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b568f1d9-5194-45a0-bc63-56b0f47994a1 tempest-VolumesDeleteCascade-1905403258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24837766-b698-4913-8dd0-aca4c30516a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:52 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b568f1d9-5194-45a0-bc63-56b0f47994a1 tempest-VolumesDeleteCascade-1905403258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24837766-b698-4913-8dd0-aca4c30516a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:52 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b568f1d9-5194-45a0-bc63-56b0f47994a1 tempest-VolumesDeleteCascade-1905403258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b610ead-f83b-416f-857d-066793bb5ef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:52 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-b568f1d9-5194-45a0-bc63-56b0f47994a1 tempest-VolumesDeleteCascade-1905403258 None] Volume ec40dfac-fb55-4aa0-a90b-0d239f6af583: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec40dfac-fb55-4aa0-a90b-0d239f6af583', 'volume_size': 1} Jul 22 03:27:52 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b568f1d9-5194-45a0-bc63-56b0f47994a1 tempest-VolumesDeleteCascade-1905403258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:27:52 devstack sudo[101536]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:52 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ef65dd03-b621-4d60-a08e-bf20f97ec47d tempest-CreateVolumesFromSourceVolumeTest-793254913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0e70617c-9d43-425c-9370-68e669cf4712" returned: 0 in 0.258s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:52 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-ef65dd03-b621-4d60-a08e-bf20f97ec47d tempest-CreateVolumesFromSourceVolumeTest-793254913 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:27:52 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-ef65dd03-b621-4d60-a08e-bf20f97ec47d tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:27:52 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-50e66af7-c6a7-43c8-86b4-12266886620c tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.064s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:27:52 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-50e66af7-c6a7-43c8-86b4-12266886620c tempest-CreateVolumesFromSourceVolumeTest-793254913 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:27:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1291771117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29735b2a-a38b-464b-a265-b46a52aee150,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dede3142f88f4d12b564270f879499d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:27:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:27:51Z,use_quota=True,user_id='326444355bf74788a4c868afe4dfabdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:27:52 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-50e66af7-c6a7-43c8-86b4-12266886620c tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Creating volume 29735b2a-a38b-464b-a265-b46a52aee150 {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:27:52 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-50e66af7-c6a7-43c8-86b4-12266886620c tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:27:52 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-50e66af7-c6a7-43c8-86b4-12266886620c tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:27:52 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-50e66af7-c6a7-43c8-86b4-12266886620c tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:27:52 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-50e66af7-c6a7-43c8-86b4-12266886620c tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:27:52 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-50e66af7-c6a7-43c8-86b4-12266886620c tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:27:52 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-50e66af7-c6a7-43c8-86b4-12266886620c tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:27:52 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-50e66af7-c6a7-43c8-86b4-12266886620c tempest-CreateVolumesFromSourceVolumeTest-793254913 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:27:52 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-50e66af7-c6a7-43c8-86b4-12266886620c tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-29735b2a-a38b-464b-a265-b46a52aee150 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:52 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-ef65dd03-b621-4d60-a08e-bf20f97ec47d tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31ae800e-0e5d-42b1-a9fa-865d6588f815) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e70617c-9d43-425c-9370-68e669cf4712', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:52 devstack sudo[101539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-29735b2a-a38b-464b-a265-b46a52aee150 1073741824 Jul 22 03:27:52 devstack sudo[101539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:52 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-ef65dd03-b621-4d60-a08e-bf20f97ec47d tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e73768d5-1724-491c-9332-e3984d314a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:52 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-ef65dd03-b621-4d60-a08e-bf20f97ec47d tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Volume volume-0e70617c-9d43-425c-9370-68e669cf4712 (0e70617c-9d43-425c-9370-68e669cf4712): created successfully Jul 22 03:27:52 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-ef65dd03-b621-4d60-a08e-bf20f97ec47d tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e73768d5-1724-491c-9332-e3984d314a04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:52 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-ef65dd03-b621-4d60-a08e-bf20f97ec47d tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Flow 'volume_create_manager' (d4faec00-f170-4a6f-bcf6-aece15fbf80a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:27:52 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-ef65dd03-b621-4d60-a08e-bf20f97ec47d tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Created volume successfully. Jul 22 03:27:52 devstack sudo[101539]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:52 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-50e66af7-c6a7-43c8-86b4-12266886620c tempest-CreateVolumesFromSourceVolumeTest-793254913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-29735b2a-a38b-464b-a265-b46a52aee150 1073741824" returned: 0 in 0.407s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:52 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-50e66af7-c6a7-43c8-86b4-12266886620c tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-29735b2a-a38b-464b-a265-b46a52aee150 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:53 devstack sudo[101545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-29735b2a-a38b-464b-a265-b46a52aee150 Jul 22 03:27:53 devstack sudo[101545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:53 devstack sudo[101545]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:53 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-50e66af7-c6a7-43c8-86b4-12266886620c tempest-CreateVolumesFromSourceVolumeTest-793254913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-29735b2a-a38b-464b-a265-b46a52aee150" returned: 0 in 0.256s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:53 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-50e66af7-c6a7-43c8-86b4-12266886620c tempest-CreateVolumesFromSourceVolumeTest-793254913 None] <== create_volume: return (703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:27:53 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-50e66af7-c6a7-43c8-86b4-12266886620c tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.705s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:27:53 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-f9f3646d-b805-4f67-bb0b-4ca5585e1d45 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.334s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:27:53 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-f9f3646d-b805-4f67-bb0b-4ca5585e1d45 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:27:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-96663345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59565563-095f-4baa-94de-8994f3b06342,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dede3142f88f4d12b564270f879499d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:27:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:27:52Z,use_quota=True,user_id='326444355bf74788a4c868afe4dfabdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:27:53 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-f9f3646d-b805-4f67-bb0b-4ca5585e1d45 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Creating volume 59565563-095f-4baa-94de-8994f3b06342 {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:27:53 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-f9f3646d-b805-4f67-bb0b-4ca5585e1d45 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:27:53 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-f9f3646d-b805-4f67-bb0b-4ca5585e1d45 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:27:53 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-f9f3646d-b805-4f67-bb0b-4ca5585e1d45 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:27:53 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-f9f3646d-b805-4f67-bb0b-4ca5585e1d45 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:27:53 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-f9f3646d-b805-4f67-bb0b-4ca5585e1d45 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:27:53 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-f9f3646d-b805-4f67-bb0b-4ca5585e1d45 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:27:53 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-f9f3646d-b805-4f67-bb0b-4ca5585e1d45 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:27:53 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f9f3646d-b805-4f67-bb0b-4ca5585e1d45 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-59565563-095f-4baa-94de-8994f3b06342 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:53 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-50e66af7-c6a7-43c8-86b4-12266886620c tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd99edfd-8f48-4ce0-a664-870f79a9faff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29735b2a-a38b-464b-a265-b46a52aee150', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:53 devstack sudo[101549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-59565563-095f-4baa-94de-8994f3b06342 1073741824 Jul 22 03:27:53 devstack sudo[101549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:53 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-50e66af7-c6a7-43c8-86b4-12266886620c tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8b85c49-aec7-4ce3-9e27-7cf55240b9e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:53 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-50e66af7-c6a7-43c8-86b4-12266886620c tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Volume volume-29735b2a-a38b-464b-a265-b46a52aee150 (29735b2a-a38b-464b-a265-b46a52aee150): created successfully Jul 22 03:27:53 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-50e66af7-c6a7-43c8-86b4-12266886620c tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8b85c49-aec7-4ce3-9e27-7cf55240b9e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:53 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-50e66af7-c6a7-43c8-86b4-12266886620c tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Flow 'volume_create_manager' (12f1367e-c2c0-440b-9708-1560399e982d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:27:53 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-50e66af7-c6a7-43c8-86b4-12266886620c tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Created volume successfully. Jul 22 03:27:53 devstack sudo[101549]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:53 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f9f3646d-b805-4f67-bb0b-4ca5585e1d45 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-59565563-095f-4baa-94de-8994f3b06342 1073741824" returned: 0 in 0.411s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:53 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f9f3646d-b805-4f67-bb0b-4ca5585e1d45 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-59565563-095f-4baa-94de-8994f3b06342 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:53 devstack sudo[101554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-59565563-095f-4baa-94de-8994f3b06342 Jul 22 03:27:53 devstack sudo[101554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:53 devstack sudo[101554]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:53 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f9f3646d-b805-4f67-bb0b-4ca5585e1d45 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-59565563-095f-4baa-94de-8994f3b06342" returned: 0 in 0.239s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:53 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-f9f3646d-b805-4f67-bb0b-4ca5585e1d45 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] <== create_volume: return (686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:27:53 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-f9f3646d-b805-4f67-bb0b-4ca5585e1d45 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.689s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:27:53 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-3a9a1492-413d-465d-ba4d-c3079e31d674 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.691s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:27:53 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-3a9a1492-413d-465d-ba4d-c3079e31d674 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:27:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1364753044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee09b3d4-7760-4c1d-9a84-8cb87863da2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dede3142f88f4d12b564270f879499d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:27:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:27:52Z,use_quota=True,user_id='326444355bf74788a4c868afe4dfabdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:27:53 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-3a9a1492-413d-465d-ba4d-c3079e31d674 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Creating volume ee09b3d4-7760-4c1d-9a84-8cb87863da2e {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:27:53 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-3a9a1492-413d-465d-ba4d-c3079e31d674 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:27:53 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-3a9a1492-413d-465d-ba4d-c3079e31d674 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:27:53 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-3a9a1492-413d-465d-ba4d-c3079e31d674 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:27:53 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-3a9a1492-413d-465d-ba4d-c3079e31d674 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:27:53 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-3a9a1492-413d-465d-ba4d-c3079e31d674 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:27:53 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-3a9a1492-413d-465d-ba4d-c3079e31d674 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:27:53 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-3a9a1492-413d-465d-ba4d-c3079e31d674 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:27:53 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-3a9a1492-413d-465d-ba4d-c3079e31d674 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ee09b3d4-7760-4c1d-9a84-8cb87863da2e 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:53 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f9f3646d-b805-4f67-bb0b-4ca5585e1d45 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b53aa6f8-cb77-42b0-b236-429266cdb43b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59565563-095f-4baa-94de-8994f3b06342', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:53 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f9f3646d-b805-4f67-bb0b-4ca5585e1d45 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05a712bb-41bf-4b47-91ac-157a8a894d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:53 devstack sudo[101557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ee09b3d4-7760-4c1d-9a84-8cb87863da2e 1073741824 Jul 22 03:27:53 devstack sudo[101557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:53 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-f9f3646d-b805-4f67-bb0b-4ca5585e1d45 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Volume volume-59565563-095f-4baa-94de-8994f3b06342 (59565563-095f-4baa-94de-8994f3b06342): created successfully Jul 22 03:27:53 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f9f3646d-b805-4f67-bb0b-4ca5585e1d45 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05a712bb-41bf-4b47-91ac-157a8a894d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:53 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f9f3646d-b805-4f67-bb0b-4ca5585e1d45 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Flow 'volume_create_manager' (87e3b0c3-84e1-42f0-910f-faeb251f7699) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:27:54 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-f9f3646d-b805-4f67-bb0b-4ca5585e1d45 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Created volume successfully. Jul 22 03:27:54 devstack sudo[101557]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:54 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-3a9a1492-413d-465d-ba4d-c3079e31d674 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ee09b3d4-7760-4c1d-9a84-8cb87863da2e 1073741824" returned: 0 in 0.410s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:54 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-3a9a1492-413d-465d-ba4d-c3079e31d674 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ee09b3d4-7760-4c1d-9a84-8cb87863da2e {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:54 devstack sudo[101563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ee09b3d4-7760-4c1d-9a84-8cb87863da2e Jul 22 03:27:54 devstack sudo[101563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:54 devstack sudo[101563]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:54 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-3a9a1492-413d-465d-ba4d-c3079e31d674 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ee09b3d4-7760-4c1d-9a84-8cb87863da2e" returned: 0 in 0.240s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:54 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-3a9a1492-413d-465d-ba4d-c3079e31d674 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] <== create_volume: return (694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:27:54 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-3a9a1492-413d-465d-ba4d-c3079e31d674 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.697s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:27:54 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b568f1d9-5194-45a0-bc63-56b0f47994a1 tempest-VolumesDeleteCascade-1905403258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.174s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:27:54 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-b568f1d9-5194-45a0-bc63-56b0f47994a1 tempest-VolumesDeleteCascade-1905403258 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:27:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-129624121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec40dfac-fb55-4aa0-a90b-0d239f6af583,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='957aeedd8a754e4988fe8ab5da853939',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:27:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:27:52Z,use_quota=True,user_id='107a6cab1dac4b9aac8d7b405ace1249',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:27:54 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-b568f1d9-5194-45a0-bc63-56b0f47994a1 tempest-VolumesDeleteCascade-1905403258 None] Creating volume ec40dfac-fb55-4aa0-a90b-0d239f6af583 {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:27:54 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b568f1d9-5194-45a0-bc63-56b0f47994a1 tempest-VolumesDeleteCascade-1905403258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:27:54 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b568f1d9-5194-45a0-bc63-56b0f47994a1 tempest-VolumesDeleteCascade-1905403258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:27:54 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-b568f1d9-5194-45a0-bc63-56b0f47994a1 tempest-VolumesDeleteCascade-1905403258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:27:54 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-b568f1d9-5194-45a0-bc63-56b0f47994a1 tempest-VolumesDeleteCascade-1905403258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:27:54 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b568f1d9-5194-45a0-bc63-56b0f47994a1 tempest-VolumesDeleteCascade-1905403258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:27:54 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-b568f1d9-5194-45a0-bc63-56b0f47994a1 tempest-VolumesDeleteCascade-1905403258 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:27:54 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-b568f1d9-5194-45a0-bc63-56b0f47994a1 tempest-VolumesDeleteCascade-1905403258 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:27:54 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b568f1d9-5194-45a0-bc63-56b0f47994a1 tempest-VolumesDeleteCascade-1905403258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ec40dfac-fb55-4aa0-a90b-0d239f6af583 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:54 devstack sudo[101566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ec40dfac-fb55-4aa0-a90b-0d239f6af583 1073741824 Jul 22 03:27:54 devstack sudo[101566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:54 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-3a9a1492-413d-465d-ba4d-c3079e31d674 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (313f9b87-6f5c-4bec-9679-2419345d2e27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee09b3d4-7760-4c1d-9a84-8cb87863da2e', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:54 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-3a9a1492-413d-465d-ba4d-c3079e31d674 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (597b99b2-5774-412a-bb72-425ae7f7bdd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:54 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-3a9a1492-413d-465d-ba4d-c3079e31d674 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Volume volume-ee09b3d4-7760-4c1d-9a84-8cb87863da2e (ee09b3d4-7760-4c1d-9a84-8cb87863da2e): created successfully Jul 22 03:27:54 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-3a9a1492-413d-465d-ba4d-c3079e31d674 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (597b99b2-5774-412a-bb72-425ae7f7bdd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:54 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-3a9a1492-413d-465d-ba4d-c3079e31d674 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Flow 'volume_create_manager' (ff319ec8-c2f2-4b8d-8b96-77dda4214c1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:27:54 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-3a9a1492-413d-465d-ba4d-c3079e31d674 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Created volume successfully. Jul 22 03:27:55 devstack sudo[101566]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:55 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b568f1d9-5194-45a0-bc63-56b0f47994a1 tempest-VolumesDeleteCascade-1905403258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ec40dfac-fb55-4aa0-a90b-0d239f6af583 1073741824" returned: 0 in 0.402s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:55 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b568f1d9-5194-45a0-bc63-56b0f47994a1 tempest-VolumesDeleteCascade-1905403258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ec40dfac-fb55-4aa0-a90b-0d239f6af583 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:55 devstack sudo[101572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ec40dfac-fb55-4aa0-a90b-0d239f6af583 Jul 22 03:27:55 devstack sudo[101572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:55 devstack sudo[101572]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:55 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b568f1d9-5194-45a0-bc63-56b0f47994a1 tempest-VolumesDeleteCascade-1905403258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ec40dfac-fb55-4aa0-a90b-0d239f6af583" returned: 0 in 0.239s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:55 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-b568f1d9-5194-45a0-bc63-56b0f47994a1 tempest-VolumesDeleteCascade-1905403258 None] <== create_volume: return (677ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:27:55 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b568f1d9-5194-45a0-bc63-56b0f47994a1 tempest-VolumesDeleteCascade-1905403258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.681s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:27:55 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b568f1d9-5194-45a0-bc63-56b0f47994a1 tempest-VolumesDeleteCascade-1905403258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b610ead-f83b-416f-857d-066793bb5ef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec40dfac-fb55-4aa0-a90b-0d239f6af583', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:55 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b568f1d9-5194-45a0-bc63-56b0f47994a1 tempest-VolumesDeleteCascade-1905403258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88710d51-678e-4020-9b5b-eb2eb0ccff11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:55 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-b568f1d9-5194-45a0-bc63-56b0f47994a1 tempest-VolumesDeleteCascade-1905403258 None] Volume volume-ec40dfac-fb55-4aa0-a90b-0d239f6af583 (ec40dfac-fb55-4aa0-a90b-0d239f6af583): created successfully Jul 22 03:27:55 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b568f1d9-5194-45a0-bc63-56b0f47994a1 tempest-VolumesDeleteCascade-1905403258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88710d51-678e-4020-9b5b-eb2eb0ccff11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:55 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b568f1d9-5194-45a0-bc63-56b0f47994a1 tempest-VolumesDeleteCascade-1905403258 None] Flow 'volume_create_manager' (0f7e20e2-1b5d-470b-a1d6-01b8e01dbe67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:27:55 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-b568f1d9-5194-45a0-bc63-56b0f47994a1 tempest-VolumesDeleteCascade-1905403258 None] Created volume successfully. Jul 22 03:27:55 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-b11c0fae-d997-4bed-be53-af880fbf54d7 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Acquiring lock "cinder-ee09b3d4-7760-4c1d-9a84-8cb87863da2e-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:27:55 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-b11c0fae-d997-4bed-be53-af880fbf54d7 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Lock "cinder-ee09b3d4-7760-4c1d-9a84-8cb87863da2e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:27:55 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-b11c0fae-d997-4bed-be53-af880fbf54d7 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Acquiring lock "cinder-quobyte-ee09b3d4-7760-4c1d-9a84-8cb87863da2e" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:27:55 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-b11c0fae-d997-4bed-be53-af880fbf54d7 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Lock "cinder-quobyte-ee09b3d4-7760-4c1d-9a84-8cb87863da2e" acquired by "delete_volume" :: waited 0.016s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:27:55 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[608cffe4-94b6-4eb4-abd8-2982a98ff7e0]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:27:55 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b11c0fae-d997-4bed-be53-af880fbf54d7 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ee09b3d4-7760-4c1d-9a84-8cb87863da2e {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:55 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-4a81802d-17fb-42b5-a357-a72af5c64455 tempest-VolumesDeleteCascade-1905403258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:27:55 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-4a81802d-17fb-42b5-a357-a72af5c64455 tempest-VolumesDeleteCascade-1905403258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:27:55 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-4a81802d-17fb-42b5-a357-a72af5c64455 tempest-VolumesDeleteCascade-1905403258 None] Creating offline snapshot a2e3216c-c2c4-4380-8fda-63d12622b13e of volume ec40dfac-fb55-4aa0-a90b-0d239f6af583 {{(pid=87747) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 03:27:55 devstack sudo[101575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ee09b3d4-7760-4c1d-9a84-8cb87863da2e Jul 22 03:27:55 devstack sudo[101575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:55 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3914855-d14b-4654-9295-e5088eef09e0]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:27:55 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-4a81802d-17fb-42b5-a357-a72af5c64455 tempest-VolumesDeleteCascade-1905403258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ec40dfac-fb55-4aa0-a90b-0d239f6af583 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:55 devstack sudo[101577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ec40dfac-fb55-4aa0-a90b-0d239f6af583 Jul 22 03:27:55 devstack sudo[101577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:55 devstack sudo[101575]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:55 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b11c0fae-d997-4bed-be53-af880fbf54d7 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ee09b3d4-7760-4c1d-9a84-8cb87863da2e" returned: 0 in 0.384s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:56 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b11c0fae-d997-4bed-be53-af880fbf54d7 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ee09b3d4-7760-4c1d-9a84-8cb87863da2e {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:56 devstack sudo[101582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ee09b3d4-7760-4c1d-9a84-8cb87863da2e Jul 22 03:27:56 devstack sudo[101582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:56 devstack sudo[101577]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:56 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-4a81802d-17fb-42b5-a357-a72af5c64455 tempest-VolumesDeleteCascade-1905403258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ec40dfac-fb55-4aa0-a90b-0d239f6af583" returned: 0 in 0.352s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:56 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-4a81802d-17fb-42b5-a357-a72af5c64455 tempest-VolumesDeleteCascade-1905403258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ec40dfac-fb55-4aa0-a90b-0d239f6af583,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ec40dfac-fb55-4aa0-a90b-0d239f6af583.a2e3216c-c2c4-4380-8fda-63d12622b13e 1G {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:56 devstack sudo[101588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ec40dfac-fb55-4aa0-a90b-0d239f6af583,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ec40dfac-fb55-4aa0-a90b-0d239f6af583.a2e3216c-c2c4-4380-8fda-63d12622b13e 1G Jul 22 03:27:56 devstack sudo[101588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:56 devstack sudo[101582]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:56 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b11c0fae-d997-4bed-be53-af880fbf54d7 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ee09b3d4-7760-4c1d-9a84-8cb87863da2e" returned: 0 in 0.251s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:56 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-b11c0fae-d997-4bed-be53-af880fbf54d7 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Lock "cinder-quobyte-ee09b3d4-7760-4c1d-9a84-8cb87863da2e" released by "delete_volume" :: held 0.680s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:27:56 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-b11c0fae-d997-4bed-be53-af880fbf54d7 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Created reservations ['3fcdd72f-1cc9-48b3-8946-02978274d415', '1ca8e9ab-642a-4637-9708-f41b4defc7be', '1ddc478b-8db6-4b04-8b62-f2e2e05b4ca3', 'f60189a0-cb9f-4c48-b376-1bf5872b1bc1'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:27:56 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b11c0fae-d997-4bed-be53-af880fbf54d7 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:27:56 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b11c0fae-d997-4bed-be53-af880fbf54d7 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:27:56 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-b11c0fae-d997-4bed-be53-af880fbf54d7 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:27:56 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-b11c0fae-d997-4bed-be53-af880fbf54d7 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:27:56 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b11c0fae-d997-4bed-be53-af880fbf54d7 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:27:56 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b11c0fae-d997-4bed-be53-af880fbf54d7 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:56 devstack sudo[101594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:27:56 devstack sudo[101594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:56 devstack sudo[101588]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:56 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-4a81802d-17fb-42b5-a357-a72af5c64455 tempest-VolumesDeleteCascade-1905403258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ec40dfac-fb55-4aa0-a90b-0d239f6af583,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ec40dfac-fb55-4aa0-a90b-0d239f6af583.a2e3216c-c2c4-4380-8fda-63d12622b13e 1G" returned: 0 in 0.408s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:56 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-4a81802d-17fb-42b5-a357-a72af5c64455 tempest-VolumesDeleteCascade-1905403258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec40dfac-fb55-4aa0-a90b-0d239f6af583 -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ec40dfac-fb55-4aa0-a90b-0d239f6af583.a2e3216c-c2c4-4380-8fda-63d12622b13e {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:56 devstack sudo[101596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec40dfac-fb55-4aa0-a90b-0d239f6af583 -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ec40dfac-fb55-4aa0-a90b-0d239f6af583.a2e3216c-c2c4-4380-8fda-63d12622b13e Jul 22 03:27:56 devstack sudo[101596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:56 devstack sudo[101594]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:56 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b11c0fae-d997-4bed-be53-af880fbf54d7 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.249s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:56 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-b11c0fae-d997-4bed-be53-af880fbf54d7 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:27:56 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-b11c0fae-d997-4bed-be53-af880fbf54d7 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Deleted volume successfully. Jul 22 03:27:56 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-d591a834-9d12-491c-8178-1dfc2714bc72 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Acquiring lock "cinder-59565563-095f-4baa-94de-8994f3b06342-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:27:56 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-b11c0fae-d997-4bed-be53-af880fbf54d7 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Lock "cinder-ee09b3d4-7760-4c1d-9a84-8cb87863da2e-delete_volume" released by "delete_volume" :: held 1.157s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:27:56 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-d591a834-9d12-491c-8178-1dfc2714bc72 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Lock "cinder-59565563-095f-4baa-94de-8994f3b06342-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:27:56 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-d591a834-9d12-491c-8178-1dfc2714bc72 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Acquiring lock "cinder-quobyte-59565563-095f-4baa-94de-8994f3b06342" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:27:56 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-d591a834-9d12-491c-8178-1dfc2714bc72 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Lock "cinder-quobyte-59565563-095f-4baa-94de-8994f3b06342" acquired by "delete_volume" :: waited 0.015s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:27:56 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a5dd894-16e8-4539-9db2-5bbb2054eb06]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:27:56 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d591a834-9d12-491c-8178-1dfc2714bc72 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-59565563-095f-4baa-94de-8994f3b06342 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:56 devstack sudo[101596]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:56 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-4a81802d-17fb-42b5-a357-a72af5c64455 tempest-VolumesDeleteCascade-1905403258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec40dfac-fb55-4aa0-a90b-0d239f6af583 -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ec40dfac-fb55-4aa0-a90b-0d239f6af583.a2e3216c-c2c4-4380-8fda-63d12622b13e" returned: 0 in 0.321s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:56 devstack cinder-volume[87747]: WARNING cinder.volume.drivers.remotefs [None req-4a81802d-17fb-42b5-a357-a72af5c64455 tempest-VolumesDeleteCascade-1905403258 None] /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ec40dfac-fb55-4aa0-a90b-0d239f6af583.a2e3216c-c2c4-4380-8fda-63d12622b13e is being set with open permissions: ugo+rw Jul 22 03:27:56 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-4a81802d-17fb-42b5-a357-a72af5c64455 tempest-VolumesDeleteCascade-1905403258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ec40dfac-fb55-4aa0-a90b-0d239f6af583.a2e3216c-c2c4-4380-8fda-63d12622b13e {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:56 devstack sudo[101603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ec40dfac-fb55-4aa0-a90b-0d239f6af583.a2e3216c-c2c4-4380-8fda-63d12622b13e Jul 22 03:27:56 devstack sudo[101603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:56 devstack sudo[101602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-59565563-095f-4baa-94de-8994f3b06342 Jul 22 03:27:56 devstack sudo[101602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:57 devstack sudo[101603]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:57 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-4a81802d-17fb-42b5-a357-a72af5c64455 tempest-VolumesDeleteCascade-1905403258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ec40dfac-fb55-4aa0-a90b-0d239f6af583.a2e3216c-c2c4-4380-8fda-63d12622b13e" returned: 0 in 0.250s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:57 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-4a81802d-17fb-42b5-a357-a72af5c64455 tempest-VolumesDeleteCascade-1905403258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ec40dfac-fb55-4aa0-a90b-0d239f6af583.info {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:57 devstack sudo[101602]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:57 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d591a834-9d12-491c-8178-1dfc2714bc72 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-59565563-095f-4baa-94de-8994f3b06342" returned: 0 in 0.366s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:57 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d591a834-9d12-491c-8178-1dfc2714bc72 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-59565563-095f-4baa-94de-8994f3b06342 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:57 devstack sudo[101610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ec40dfac-fb55-4aa0-a90b-0d239f6af583.info Jul 22 03:27:57 devstack sudo[101610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:57 devstack sudo[101612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-59565563-095f-4baa-94de-8994f3b06342 Jul 22 03:27:57 devstack sudo[101612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:57 devstack sudo[101610]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:57 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-4a81802d-17fb-42b5-a357-a72af5c64455 tempest-VolumesDeleteCascade-1905403258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ec40dfac-fb55-4aa0-a90b-0d239f6af583.info" returned: 0 in 0.248s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:57 devstack cinder-volume[87747]: WARNING cinder.volume.drivers.remotefs [None req-4a81802d-17fb-42b5-a357-a72af5c64455 tempest-VolumesDeleteCascade-1905403258 None] /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ec40dfac-fb55-4aa0-a90b-0d239f6af583.info is being set with open permissions: ugo+rw Jul 22 03:27:57 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-4a81802d-17fb-42b5-a357-a72af5c64455 tempest-VolumesDeleteCascade-1905403258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ec40dfac-fb55-4aa0-a90b-0d239f6af583.info {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:57 devstack sudo[101612]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:57 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d591a834-9d12-491c-8178-1dfc2714bc72 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-59565563-095f-4baa-94de-8994f3b06342" returned: 0 in 0.245s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:57 devstack sudo[101616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ec40dfac-fb55-4aa0-a90b-0d239f6af583.info Jul 22 03:27:57 devstack sudo[101616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:57 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-d591a834-9d12-491c-8178-1dfc2714bc72 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Lock "cinder-quobyte-59565563-095f-4baa-94de-8994f3b06342" released by "delete_volume" :: held 0.649s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:27:57 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-d591a834-9d12-491c-8178-1dfc2714bc72 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Created reservations ['5cb8d2c1-945d-43e3-aa7c-3c9563e2e2db', '659103ab-46c9-4510-a4dd-49d6acfa7120', 'fde64e1f-8059-4cdc-8be4-f796d29862dc', '6cc5c43b-7023-4d0b-895f-23efb94e67d1'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:27:57 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-d591a834-9d12-491c-8178-1dfc2714bc72 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:27:57 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-d591a834-9d12-491c-8178-1dfc2714bc72 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:27:57 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-d591a834-9d12-491c-8178-1dfc2714bc72 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:27:57 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-d591a834-9d12-491c-8178-1dfc2714bc72 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:27:57 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-d591a834-9d12-491c-8178-1dfc2714bc72 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:27:57 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d591a834-9d12-491c-8178-1dfc2714bc72 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:57 devstack sudo[101618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:27:57 devstack sudo[101618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:57 devstack sudo[101616]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:57 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-4a81802d-17fb-42b5-a357-a72af5c64455 tempest-VolumesDeleteCascade-1905403258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ec40dfac-fb55-4aa0-a90b-0d239f6af583.info" returned: 0 in 0.259s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:57 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-4a81802d-17fb-42b5-a357-a72af5c64455 tempest-VolumesDeleteCascade-1905403258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.929s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:27:57 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-4a81802d-17fb-42b5-a357-a72af5c64455 tempest-VolumesDeleteCascade-1905403258 None] Create snapshot completed successfully Jul 22 03:27:57 devstack sudo[101618]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:57 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d591a834-9d12-491c-8178-1dfc2714bc72 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.249s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:57 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-d591a834-9d12-491c-8178-1dfc2714bc72 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:27:57 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-d591a834-9d12-491c-8178-1dfc2714bc72 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Deleted volume successfully. Jul 22 03:27:57 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-d591a834-9d12-491c-8178-1dfc2714bc72 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Lock "cinder-59565563-095f-4baa-94de-8994f3b06342-delete_volume" released by "delete_volume" :: held 1.134s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:27:57 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-4e8eb66d-9b2f-456b-9922-65e69f082473 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Acquiring lock "cinder-29735b2a-a38b-464b-a265-b46a52aee150-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:27:57 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-4e8eb66d-9b2f-456b-9922-65e69f082473 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Lock "cinder-29735b2a-a38b-464b-a265-b46a52aee150-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:27:57 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-4e8eb66d-9b2f-456b-9922-65e69f082473 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Acquiring lock "cinder-quobyte-29735b2a-a38b-464b-a265-b46a52aee150" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:27:57 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-4e8eb66d-9b2f-456b-9922-65e69f082473 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Lock "cinder-quobyte-29735b2a-a38b-464b-a265-b46a52aee150" acquired by "delete_volume" :: waited 0.015s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:27:57 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[e279b3d8-76bd-4fef-b836-40f877a189d1]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:27:57 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-4e8eb66d-9b2f-456b-9922-65e69f082473 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-29735b2a-a38b-464b-a265-b46a52aee150 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:58 devstack sudo[101622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-29735b2a-a38b-464b-a265-b46a52aee150 Jul 22 03:27:58 devstack sudo[101622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:58 devstack sudo[101622]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:58 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-4e8eb66d-9b2f-456b-9922-65e69f082473 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-29735b2a-a38b-464b-a265-b46a52aee150" returned: 0 in 0.415s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:58 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-4e8eb66d-9b2f-456b-9922-65e69f082473 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-29735b2a-a38b-464b-a265-b46a52aee150 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:58 devstack sudo[101627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-29735b2a-a38b-464b-a265-b46a52aee150 Jul 22 03:27:58 devstack sudo[101627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:58 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-550b2746-9e1f-4dd2-bd7c-929585a69460 tempest-VolumesDeleteCascade-1905403258 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:27:58 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-550b2746-9e1f-4dd2-bd7c-929585a69460 tempest-VolumesDeleteCascade-1905403258 None] Flow 'volume_create_manager' (61b6ebed-0252-498b-9eca-742323f38a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:27:58 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-550b2746-9e1f-4dd2-bd7c-929585a69460 tempest-VolumesDeleteCascade-1905403258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (989d7bca-1a85-44f0-a133-e8390b993134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:58 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-550b2746-9e1f-4dd2-bd7c-929585a69460 tempest-VolumesDeleteCascade-1905403258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (989d7bca-1a85-44f0-a133-e8390b993134) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:27:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-401487637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=000e1556-65ef-443f-9fba-61460ef83f2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='957aeedd8a754e4988fe8ab5da853939',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:27:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a2e3216c-c2c4-4380-8fda-63d12622b13e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:27:58Z,use_quota=True,user_id='107a6cab1dac4b9aac8d7b405ace1249',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:58 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-550b2746-9e1f-4dd2-bd7c-929585a69460 tempest-VolumesDeleteCascade-1905403258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bf1e229-0378-410a-b075-dc50e894201a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:58 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-550b2746-9e1f-4dd2-bd7c-929585a69460 tempest-VolumesDeleteCascade-1905403258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bf1e229-0378-410a-b075-dc50e894201a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:58 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-550b2746-9e1f-4dd2-bd7c-929585a69460 tempest-VolumesDeleteCascade-1905403258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fee9e400-a817-40d1-a9fb-2fca5602fb4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:58 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-550b2746-9e1f-4dd2-bd7c-929585a69460 tempest-VolumesDeleteCascade-1905403258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fee9e400-a817-40d1-a9fb-2fca5602fb4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '000e1556-65ef-443f-9fba-61460ef83f2e', 'volume_name': 'volume-000e1556-65ef-443f-9fba-61460ef83f2e', 'volume_size': 1, 'snapshot_id': 'a2e3216c-c2c4-4380-8fda-63d12622b13e'}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:58 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-550b2746-9e1f-4dd2-bd7c-929585a69460 tempest-VolumesDeleteCascade-1905403258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f10c3c28-46c3-4ee7-8567-a86cecdb79eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:58 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-550b2746-9e1f-4dd2-bd7c-929585a69460 tempest-VolumesDeleteCascade-1905403258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f10c3c28-46c3-4ee7-8567-a86cecdb79eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:27:58 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-550b2746-9e1f-4dd2-bd7c-929585a69460 tempest-VolumesDeleteCascade-1905403258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b4707e4-da24-4b7a-9cd1-7247df4a06e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:27:58 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-550b2746-9e1f-4dd2-bd7c-929585a69460 tempest-VolumesDeleteCascade-1905403258 None] Volume 000e1556-65ef-443f-9fba-61460ef83f2e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-000e1556-65ef-443f-9fba-61460ef83f2e', 'volume_size': 1, 'snapshot_id': 'a2e3216c-c2c4-4380-8fda-63d12622b13e'} Jul 22 03:27:58 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-550b2746-9e1f-4dd2-bd7c-929585a69460 tempest-VolumesDeleteCascade-1905403258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:27:58 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-550b2746-9e1f-4dd2-bd7c-929585a69460 tempest-VolumesDeleteCascade-1905403258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:27:58 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-550b2746-9e1f-4dd2-bd7c-929585a69460 tempest-VolumesDeleteCascade-1905403258 None] Acquiring lock "cinder-quobyte-a2e3216c-c2c4-4380-8fda-63d12622b13e-000e1556-65ef-443f-9fba-61460ef83f2e" by "_create_volume_from_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:27:58 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-550b2746-9e1f-4dd2-bd7c-929585a69460 tempest-VolumesDeleteCascade-1905403258 None] Lock "cinder-quobyte-a2e3216c-c2c4-4380-8fda-63d12622b13e-000e1556-65ef-443f-9fba-61460ef83f2e" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:27:58 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-550b2746-9e1f-4dd2-bd7c-929585a69460 tempest-VolumesDeleteCascade-1905403258 None] Creating volume 000e1556-65ef-443f-9fba-61460ef83f2e from snapshot a2e3216c-c2c4-4380-8fda-63d12622b13e {{(pid=87747) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 22 03:27:58 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-550b2746-9e1f-4dd2-bd7c-929585a69460 tempest-VolumesDeleteCascade-1905403258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:27:58 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-550b2746-9e1f-4dd2-bd7c-929585a69460 tempest-VolumesDeleteCascade-1905403258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:27:58 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-550b2746-9e1f-4dd2-bd7c-929585a69460 tempest-VolumesDeleteCascade-1905403258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:27:58 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-550b2746-9e1f-4dd2-bd7c-929585a69460 tempest-VolumesDeleteCascade-1905403258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:27:58 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-550b2746-9e1f-4dd2-bd7c-929585a69460 tempest-VolumesDeleteCascade-1905403258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:27:58 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-550b2746-9e1f-4dd2-bd7c-929585a69460 tempest-VolumesDeleteCascade-1905403258 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:27:58 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-550b2746-9e1f-4dd2-bd7c-929585a69460 tempest-VolumesDeleteCascade-1905403258 None] Acquiring lock "cinder-quobyte-000e1556-65ef-443f-9fba-61460ef83f2e" by "_copy_volume_from_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:27:58 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-550b2746-9e1f-4dd2-bd7c-929585a69460 tempest-VolumesDeleteCascade-1905403258 None] Lock "cinder-quobyte-000e1556-65ef-443f-9fba-61460ef83f2e" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:27:58 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-550b2746-9e1f-4dd2-bd7c-929585a69460 tempest-VolumesDeleteCascade-1905403258 None] snapshot: a2e3216c-c2c4-4380-8fda-63d12622b13e, volume: 000e1556-65ef-443f-9fba-61460ef83f2e, {{(pid=87747) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 22 03:27:58 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-550b2746-9e1f-4dd2-bd7c-929585a69460 tempest-VolumesDeleteCascade-1905403258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:27:58 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-550b2746-9e1f-4dd2-bd7c-929585a69460 tempest-VolumesDeleteCascade-1905403258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:27:58 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-550b2746-9e1f-4dd2-bd7c-929585a69460 tempest-VolumesDeleteCascade-1905403258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:27:58 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-550b2746-9e1f-4dd2-bd7c-929585a69460 tempest-VolumesDeleteCascade-1905403258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:27:58 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-550b2746-9e1f-4dd2-bd7c-929585a69460 tempest-VolumesDeleteCascade-1905403258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:27:58 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dc7100c-64e7-4d98-b782-2a5ddb422418]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:27:58 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-550b2746-9e1f-4dd2-bd7c-929585a69460 tempest-VolumesDeleteCascade-1905403258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ec40dfac-fb55-4aa0-a90b-0d239f6af583.a2e3216c-c2c4-4380-8fda-63d12622b13e {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:58 devstack sudo[101627]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:58 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-4e8eb66d-9b2f-456b-9922-65e69f082473 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-29735b2a-a38b-464b-a265-b46a52aee150" returned: 0 in 0.242s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:58 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-4e8eb66d-9b2f-456b-9922-65e69f082473 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Lock "cinder-quobyte-29735b2a-a38b-464b-a265-b46a52aee150" released by "delete_volume" :: held 0.697s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:27:58 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-4e8eb66d-9b2f-456b-9922-65e69f082473 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Created reservations ['28d757c4-ce2d-4683-b44f-3acbbf924cd8', 'c8e47d55-213e-4676-9fc6-4b637c1ac963', '37fa8fcb-92e8-440b-b988-6cea3afad2cc', 'e9d74a1d-aae7-47c8-a6de-b3c41ad22c72'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:27:58 devstack sudo[101630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ec40dfac-fb55-4aa0-a90b-0d239f6af583.a2e3216c-c2c4-4380-8fda-63d12622b13e Jul 22 03:27:58 devstack sudo[101630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:58 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-4e8eb66d-9b2f-456b-9922-65e69f082473 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:27:58 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-4e8eb66d-9b2f-456b-9922-65e69f082473 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:27:58 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-4e8eb66d-9b2f-456b-9922-65e69f082473 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:27:58 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-4e8eb66d-9b2f-456b-9922-65e69f082473 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:27:58 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-4e8eb66d-9b2f-456b-9922-65e69f082473 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:27:58 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-4e8eb66d-9b2f-456b-9922-65e69f082473 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:58 devstack sudo[101632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:27:58 devstack sudo[101632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:59 devstack sudo[101630]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:59 devstack sudo[101632]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:59 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-4e8eb66d-9b2f-456b-9922-65e69f082473 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.255s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:59 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-550b2746-9e1f-4dd2-bd7c-929585a69460 tempest-VolumesDeleteCascade-1905403258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ec40dfac-fb55-4aa0-a90b-0d239f6af583.a2e3216c-c2c4-4380-8fda-63d12622b13e" returned: 0 in 0.394s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:59 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-4e8eb66d-9b2f-456b-9922-65e69f082473 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:27:59 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-550b2746-9e1f-4dd2-bd7c-929585a69460 tempest-VolumesDeleteCascade-1905403258 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec40dfac-fb55-4aa0-a90b-0d239f6af583(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87747) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 03:27:59 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-550b2746-9e1f-4dd2-bd7c-929585a69460 tempest-VolumesDeleteCascade-1905403258 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ec40dfac-fb55-4aa0-a90b-0d239f6af583 {{(pid=87747) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 22 03:27:59 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-550b2746-9e1f-4dd2-bd7c-929585a69460 tempest-VolumesDeleteCascade-1905403258 None] Creating direct copy from snapshot {{(pid=87747) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 22 03:27:59 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-4e8eb66d-9b2f-456b-9922-65e69f082473 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Deleted volume successfully. Jul 22 03:27:59 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d8a8902-1b84-43f3-ac9e-44523687faad]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:27:59 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-550b2746-9e1f-4dd2-bd7c-929585a69460 tempest-VolumesDeleteCascade-1905403258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ec40dfac-fb55-4aa0-a90b-0d239f6af583 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:59 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-14385e44-f05b-4761-a149-63c573415db7 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Acquiring lock "cinder-0e70617c-9d43-425c-9370-68e669cf4712-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:27:59 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-4e8eb66d-9b2f-456b-9922-65e69f082473 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Lock "cinder-29735b2a-a38b-464b-a265-b46a52aee150-delete_volume" released by "delete_volume" :: held 1.174s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:27:59 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-14385e44-f05b-4761-a149-63c573415db7 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Lock "cinder-0e70617c-9d43-425c-9370-68e669cf4712-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:27:59 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-14385e44-f05b-4761-a149-63c573415db7 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Acquiring lock "cinder-quobyte-0e70617c-9d43-425c-9370-68e669cf4712" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:27:59 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-14385e44-f05b-4761-a149-63c573415db7 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Lock "cinder-quobyte-0e70617c-9d43-425c-9370-68e669cf4712" acquired by "delete_volume" :: waited 0.018s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:27:59 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c19826b-6504-418c-8647-838f5a04ee61]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:27:59 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-14385e44-f05b-4761-a149-63c573415db7 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0e70617c-9d43-425c-9370-68e669cf4712 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:59 devstack sudo[101640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ec40dfac-fb55-4aa0-a90b-0d239f6af583 Jul 22 03:27:59 devstack sudo[101640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:59 devstack sudo[101642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0e70617c-9d43-425c-9370-68e669cf4712 Jul 22 03:27:59 devstack sudo[101642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:59 devstack sudo[101640]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:59 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-550b2746-9e1f-4dd2-bd7c-929585a69460 tempest-VolumesDeleteCascade-1905403258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ec40dfac-fb55-4aa0-a90b-0d239f6af583" returned: 0 in 0.384s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:59 devstack cinder-volume[87747]: DEBUG cinder.utils [None req-550b2746-9e1f-4dd2-bd7c-929585a69460 tempest-VolumesDeleteCascade-1905403258 None] Path /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-000e1556-65ef-443f-9fba-61460ef83f2e not found in is_blk_device check {{(pid=87747) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 22 03:27:59 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-550b2746-9e1f-4dd2-bd7c-929585a69460 tempest-VolumesDeleteCascade-1905403258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ec40dfac-fb55-4aa0-a90b-0d239f6af583 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-000e1556-65ef-443f-9fba-61460ef83f2e {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:59 devstack sudo[101647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ec40dfac-fb55-4aa0-a90b-0d239f6af583 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-000e1556-65ef-443f-9fba-61460ef83f2e Jul 22 03:27:59 devstack sudo[101647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:59 devstack sudo[101642]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:59 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-14385e44-f05b-4761-a149-63c573415db7 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0e70617c-9d43-425c-9370-68e669cf4712" returned: 0 in 0.370s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:59 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-14385e44-f05b-4761-a149-63c573415db7 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0e70617c-9d43-425c-9370-68e669cf4712 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:27:59 devstack sudo[101652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0e70617c-9d43-425c-9370-68e669cf4712 Jul 22 03:27:59 devstack sudo[101652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:27:59 devstack sudo[101652]: pam_unix(sudo:session): session closed for user root Jul 22 03:27:59 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-14385e44-f05b-4761-a149-63c573415db7 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0e70617c-9d43-425c-9370-68e669cf4712" returned: 0 in 0.254s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:27:59 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-14385e44-f05b-4761-a149-63c573415db7 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Lock "cinder-quobyte-0e70617c-9d43-425c-9370-68e669cf4712" released by "delete_volume" :: held 0.663s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:27:59 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-14385e44-f05b-4761-a149-63c573415db7 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Created reservations ['1ab1df53-3f23-4be6-807a-de0a144e3d78', '30791b84-e627-462f-80b0-a2081cccd6f6', '71f3aae2-81cc-4e0e-a6a4-3c76f2f56f9d', '70b72308-6792-4b45-ae13-ceaff2cb1e02'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:27:59 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-14385e44-f05b-4761-a149-63c573415db7 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:27:59 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-14385e44-f05b-4761-a149-63c573415db7 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:28:00 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-14385e44-f05b-4761-a149-63c573415db7 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:28:00 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-14385e44-f05b-4761-a149-63c573415db7 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:28:00 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-14385e44-f05b-4761-a149-63c573415db7 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:28:00 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-14385e44-f05b-4761-a149-63c573415db7 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:28:00 devstack sudo[101665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:28:00 devstack sudo[101665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:28:00 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-1e514444-ea30-4976-ae3a-c907541cb2dd tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Acquiring lock "cinder-2fcea350-67fe-4f43-a90c-26e0b701ef93-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:28:00 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-1e514444-ea30-4976-ae3a-c907541cb2dd tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Lock "cinder-2fcea350-67fe-4f43-a90c-26e0b701ef93-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:28:00 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-1e514444-ea30-4976-ae3a-c907541cb2dd tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Acquiring lock "cinder-quobyte-2fcea350-67fe-4f43-a90c-26e0b701ef93" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:28:00 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-1e514444-ea30-4976-ae3a-c907541cb2dd tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Lock "cinder-quobyte-2fcea350-67fe-4f43-a90c-26e0b701ef93" acquired by "delete_volume" :: waited 0.030s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:28:00 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[35aa258b-9121-4f88-8b57-9d3c9c1e1a05]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:28:00 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-1e514444-ea30-4976-ae3a-c907541cb2dd tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2fcea350-67fe-4f43-a90c-26e0b701ef93 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:28:00 devstack sudo[101667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2fcea350-67fe-4f43-a90c-26e0b701ef93 Jul 22 03:28:00 devstack sudo[101667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:28:00 devstack sudo[101665]: pam_unix(sudo:session): session closed for user root Jul 22 03:28:00 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-14385e44-f05b-4761-a149-63c573415db7 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.900s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:28:00 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-14385e44-f05b-4761-a149-63c573415db7 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:28:00 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-14385e44-f05b-4761-a149-63c573415db7 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Deleted volume successfully. Jul 22 03:28:01 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-14385e44-f05b-4761-a149-63c573415db7 tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Lock "cinder-0e70617c-9d43-425c-9370-68e669cf4712-delete_volume" released by "delete_volume" :: held 1.906s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:28:01 devstack sudo[101667]: pam_unix(sudo:session): session closed for user root Jul 22 03:28:01 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-1e514444-ea30-4976-ae3a-c907541cb2dd tempest-CreateVolumesFromSourceVolumeTest-793254913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2fcea350-67fe-4f43-a90c-26e0b701ef93" returned: 0 in 0.702s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:28:01 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-1e514444-ea30-4976-ae3a-c907541cb2dd tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2fcea350-67fe-4f43-a90c-26e0b701ef93 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:28:01 devstack sudo[101674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2fcea350-67fe-4f43-a90c-26e0b701ef93 Jul 22 03:28:01 devstack sudo[101674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:28:01 devstack sudo[101674]: pam_unix(sudo:session): session closed for user root Jul 22 03:28:01 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-1e514444-ea30-4976-ae3a-c907541cb2dd tempest-CreateVolumesFromSourceVolumeTest-793254913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2fcea350-67fe-4f43-a90c-26e0b701ef93" returned: 0 in 0.582s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:28:01 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-1e514444-ea30-4976-ae3a-c907541cb2dd tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Lock "cinder-quobyte-2fcea350-67fe-4f43-a90c-26e0b701ef93" released by "delete_volume" :: held 1.391s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:28:02 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-1e514444-ea30-4976-ae3a-c907541cb2dd tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Created reservations ['c8b6f7bc-1845-4290-8bac-33437452836e', '9b0cd730-7126-47d9-af20-3fe7721967fb', '86fdea14-bcb7-484f-bd9f-eed7c0553682', '1553fd69-1b2e-4c12-a78d-d22c14bce726'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:28:02 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-1e514444-ea30-4976-ae3a-c907541cb2dd tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:28:02 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-1e514444-ea30-4976-ae3a-c907541cb2dd tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:28:02 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-1e514444-ea30-4976-ae3a-c907541cb2dd tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:28:02 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-1e514444-ea30-4976-ae3a-c907541cb2dd tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:28:02 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-1e514444-ea30-4976-ae3a-c907541cb2dd tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:28:02 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-1e514444-ea30-4976-ae3a-c907541cb2dd tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:28:02 devstack sudo[101677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:28:02 devstack sudo[101677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:28:02 devstack sudo[101677]: pam_unix(sudo:session): session closed for user root Jul 22 03:28:02 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-1e514444-ea30-4976-ae3a-c907541cb2dd tempest-CreateVolumesFromSourceVolumeTest-793254913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.343s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:28:02 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-1e514444-ea30-4976-ae3a-c907541cb2dd tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:28:02 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-1e514444-ea30-4976-ae3a-c907541cb2dd tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Deleted volume successfully. Jul 22 03:28:02 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-1e514444-ea30-4976-ae3a-c907541cb2dd tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Lock "cinder-2fcea350-67fe-4f43-a90c-26e0b701ef93-delete_volume" released by "delete_volume" :: held 2.256s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:28:02 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-3fed08a6-4e04-42a5-83d9-912f14c2d20c tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Acquiring lock "cinder-f7989d03-019f-4749-b59d-f2a429582a71-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:28:02 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-3fed08a6-4e04-42a5-83d9-912f14c2d20c tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Lock "cinder-f7989d03-019f-4749-b59d-f2a429582a71-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:28:02 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-3fed08a6-4e04-42a5-83d9-912f14c2d20c tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Acquiring lock "cinder-quobyte-f7989d03-019f-4749-b59d-f2a429582a71" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:28:03 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-3fed08a6-4e04-42a5-83d9-912f14c2d20c tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Lock "cinder-quobyte-f7989d03-019f-4749-b59d-f2a429582a71" acquired by "delete_volume" :: waited 0.027s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:28:03 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[646a620d-8f73-4e7c-ac48-e8eb3e5eccd6]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:28:03 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-3fed08a6-4e04-42a5-83d9-912f14c2d20c tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-f7989d03-019f-4749-b59d-f2a429582a71 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:28:03 devstack sudo[101680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-f7989d03-019f-4749-b59d-f2a429582a71 Jul 22 03:28:03 devstack sudo[101680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:28:03 devstack sudo[101680]: pam_unix(sudo:session): session closed for user root Jul 22 03:28:03 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-3fed08a6-4e04-42a5-83d9-912f14c2d20c tempest-CreateVolumesFromSourceVolumeTest-793254913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-f7989d03-019f-4749-b59d-f2a429582a71" returned: 0 in 0.594s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:28:03 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-3fed08a6-4e04-42a5-83d9-912f14c2d20c tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-f7989d03-019f-4749-b59d-f2a429582a71 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:28:03 devstack sudo[101686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-f7989d03-019f-4749-b59d-f2a429582a71 Jul 22 03:28:03 devstack sudo[101686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:28:04 devstack sudo[101686]: pam_unix(sudo:session): session closed for user root Jul 22 03:28:04 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-3fed08a6-4e04-42a5-83d9-912f14c2d20c tempest-CreateVolumesFromSourceVolumeTest-793254913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-f7989d03-019f-4749-b59d-f2a429582a71" returned: 0 in 0.487s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:28:04 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-3fed08a6-4e04-42a5-83d9-912f14c2d20c tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Lock "cinder-quobyte-f7989d03-019f-4749-b59d-f2a429582a71" released by "delete_volume" :: held 1.180s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:28:04 devstack sudo[101647]: pam_unix(sudo:session): session closed for user root Jul 22 03:28:04 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-550b2746-9e1f-4dd2-bd7c-929585a69460 tempest-VolumesDeleteCascade-1905403258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ec40dfac-fb55-4aa0-a90b-0d239f6af583 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-000e1556-65ef-443f-9fba-61460ef83f2e" returned: 0 in 4.822s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:28:04 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-3fed08a6-4e04-42a5-83d9-912f14c2d20c tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Created reservations ['6bb93482-2232-41bd-822b-995450ae9b1d', 'a040f4c0-7850-47e0-9aa9-6da92a03f250', '25a72573-007d-46fe-a23e-98fc2d4ed4d1', '68448953-3876-4950-abc8-f26dd7524d6b'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:28:04 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[36db8ff2-3ff7-4749-bc0c-76568b1805dd]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:28:04 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-550b2746-9e1f-4dd2-bd7c-929585a69460 tempest-VolumesDeleteCascade-1905403258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ec40dfac-fb55-4aa0-a90b-0d239f6af583 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:28:04 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-3fed08a6-4e04-42a5-83d9-912f14c2d20c tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:28:04 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-3fed08a6-4e04-42a5-83d9-912f14c2d20c tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:28:04 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-3fed08a6-4e04-42a5-83d9-912f14c2d20c tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:28:04 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-3fed08a6-4e04-42a5-83d9-912f14c2d20c tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:28:04 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-3fed08a6-4e04-42a5-83d9-912f14c2d20c tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:28:04 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-3fed08a6-4e04-42a5-83d9-912f14c2d20c tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:28:04 devstack sudo[101690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:28:04 devstack sudo[101690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:28:04 devstack sudo[101689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ec40dfac-fb55-4aa0-a90b-0d239f6af583 Jul 22 03:28:04 devstack sudo[101689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:28:04 devstack sudo[101690]: pam_unix(sudo:session): session closed for user root Jul 22 03:28:04 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-3fed08a6-4e04-42a5-83d9-912f14c2d20c tempest-CreateVolumesFromSourceVolumeTest-793254913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.243s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:28:04 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-3fed08a6-4e04-42a5-83d9-912f14c2d20c tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:28:04 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-3fed08a6-4e04-42a5-83d9-912f14c2d20c tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Deleted volume successfully. Jul 22 03:28:04 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-3fed08a6-4e04-42a5-83d9-912f14c2d20c tempest-CreateVolumesFromSourceVolumeTest-793254913 None] Lock "cinder-f7989d03-019f-4749-b59d-f2a429582a71-delete_volume" released by "delete_volume" :: held 1.689s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:28:04 devstack sudo[101689]: pam_unix(sudo:session): session closed for user root Jul 22 03:28:04 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-550b2746-9e1f-4dd2-bd7c-929585a69460 tempest-VolumesDeleteCascade-1905403258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ec40dfac-fb55-4aa0-a90b-0d239f6af583" returned: 0 in 0.544s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:28:04 devstack cinder-volume[87747]: DEBUG cinder.image.image_utils [None req-550b2746-9e1f-4dd2-bd7c-929585a69460 tempest-VolumesDeleteCascade-1905403258 None] Image conversion details: src /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ec40dfac-fb55-4aa0-a90b-0d239f6af583, size 1024.00 MB, duration 4.82 sec, destination /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-000e1556-65ef-443f-9fba-61460ef83f2e {{(pid=87747) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 22 03:28:04 devstack cinder-volume[87747]: INFO cinder.image.image_utils [None req-550b2746-9e1f-4dd2-bd7c-929585a69460 tempest-VolumesDeleteCascade-1905403258 None] Converted 1024.00 MB image at 212.29 MB/s Jul 22 03:28:04 devstack cinder-volume[87747]: WARNING cinder.volume.drivers.remotefs [None req-550b2746-9e1f-4dd2-bd7c-929585a69460 tempest-VolumesDeleteCascade-1905403258 None] /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-000e1556-65ef-443f-9fba-61460ef83f2e is being set with open permissions: ugo+rw Jul 22 03:28:04 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-550b2746-9e1f-4dd2-bd7c-929585a69460 tempest-VolumesDeleteCascade-1905403258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-000e1556-65ef-443f-9fba-61460ef83f2e {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:28:04 devstack sudo[101697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-000e1556-65ef-443f-9fba-61460ef83f2e Jul 22 03:28:04 devstack sudo[101697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:28:05 devstack sudo[101697]: pam_unix(sudo:session): session closed for user root Jul 22 03:28:05 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-550b2746-9e1f-4dd2-bd7c-929585a69460 tempest-VolumesDeleteCascade-1905403258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-000e1556-65ef-443f-9fba-61460ef83f2e" returned: 0 in 0.236s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:28:05 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-550b2746-9e1f-4dd2-bd7c-929585a69460 tempest-VolumesDeleteCascade-1905403258 None] Lock "cinder-quobyte-000e1556-65ef-443f-9fba-61460ef83f2e" released by "_copy_volume_from_snapshot" :: held 6.485s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:28:05 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-550b2746-9e1f-4dd2-bd7c-929585a69460 tempest-VolumesDeleteCascade-1905403258 None] Lock "cinder-quobyte-a2e3216c-c2c4-4380-8fda-63d12622b13e-000e1556-65ef-443f-9fba-61460ef83f2e" released by "_create_volume_from_snapshot" :: held 6.512s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:28:05 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-550b2746-9e1f-4dd2-bd7c-929585a69460 tempest-VolumesDeleteCascade-1905403258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.531s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:28:05 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-550b2746-9e1f-4dd2-bd7c-929585a69460 tempest-VolumesDeleteCascade-1905403258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b4707e4-da24-4b7a-9cd1-7247df4a06e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-000e1556-65ef-443f-9fba-61460ef83f2e', 'volume_size': 1, 'snapshot_id': 'a2e3216c-c2c4-4380-8fda-63d12622b13e'}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:28:05 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-550b2746-9e1f-4dd2-bd7c-929585a69460 tempest-VolumesDeleteCascade-1905403258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (769b3b5b-5762-41be-bb54-2a01459f31c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:28:05 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-550b2746-9e1f-4dd2-bd7c-929585a69460 tempest-VolumesDeleteCascade-1905403258 None] Volume volume-000e1556-65ef-443f-9fba-61460ef83f2e (000e1556-65ef-443f-9fba-61460ef83f2e): created successfully Jul 22 03:28:05 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-550b2746-9e1f-4dd2-bd7c-929585a69460 tempest-VolumesDeleteCascade-1905403258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (769b3b5b-5762-41be-bb54-2a01459f31c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:28:05 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-550b2746-9e1f-4dd2-bd7c-929585a69460 tempest-VolumesDeleteCascade-1905403258 None] Flow 'volume_create_manager' (61b6ebed-0252-498b-9eca-742323f38a48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:28:05 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-550b2746-9e1f-4dd2-bd7c-929585a69460 tempest-VolumesDeleteCascade-1905403258 None] Created volume successfully. Jul 22 03:28:06 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-b341ea1d-91f1-4a57-8cf8-83e33cc6ddd7 tempest-VolumesDeleteCascade-1905403258 None] Acquiring lock "cinder-ec40dfac-fb55-4aa0-a90b-0d239f6af583-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:28:06 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-b341ea1d-91f1-4a57-8cf8-83e33cc6ddd7 tempest-VolumesDeleteCascade-1905403258 None] Lock "cinder-ec40dfac-fb55-4aa0-a90b-0d239f6af583-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:28:06 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b341ea1d-91f1-4a57-8cf8-83e33cc6ddd7 tempest-VolumesDeleteCascade-1905403258 None] Performing cascade delete. {{(pid=87747) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 22 03:28:06 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-b341ea1d-91f1-4a57-8cf8-83e33cc6ddd7 tempest-VolumesDeleteCascade-1905403258 None] Acquiring lock "cinder-a2e3216c-c2c4-4380-8fda-63d12622b13e-delete_snapshot" by "delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:28:06 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-b341ea1d-91f1-4a57-8cf8-83e33cc6ddd7 tempest-VolumesDeleteCascade-1905403258 None] Lock "cinder-a2e3216c-c2c4-4380-8fda-63d12622b13e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:28:06 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-b341ea1d-91f1-4a57-8cf8-83e33cc6ddd7 tempest-VolumesDeleteCascade-1905403258 None] Acquiring lock "cinder-quobyte-ec40dfac-fb55-4aa0-a90b-0d239f6af583" by "delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:28:06 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-b341ea1d-91f1-4a57-8cf8-83e33cc6ddd7 tempest-VolumesDeleteCascade-1905403258 None] Lock "cinder-quobyte-ec40dfac-fb55-4aa0-a90b-0d239f6af583" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:28:06 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-b341ea1d-91f1-4a57-8cf8-83e33cc6ddd7 tempest-VolumesDeleteCascade-1905403258 None] Acquiring lock "cinder-quobyte-a2e3216c-c2c4-4380-8fda-63d12622b13e" by "_delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:28:06 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-b341ea1d-91f1-4a57-8cf8-83e33cc6ddd7 tempest-VolumesDeleteCascade-1905403258 None] Lock "cinder-quobyte-a2e3216c-c2c4-4380-8fda-63d12622b13e" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:28:06 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-b341ea1d-91f1-4a57-8cf8-83e33cc6ddd7 tempest-VolumesDeleteCascade-1905403258 None] Deleting offline snapshot a2e3216c-c2c4-4380-8fda-63d12622b13e of volume ec40dfac-fb55-4aa0-a90b-0d239f6af583 {{(pid=87747) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 03:28:06 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-b341ea1d-91f1-4a57-8cf8-83e33cc6ddd7 tempest-VolumesDeleteCascade-1905403258 None] snapshot_file for this snap is: volume-ec40dfac-fb55-4aa0-a90b-0d239f6af583.a2e3216c-c2c4-4380-8fda-63d12622b13e {{(pid=87747) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 03:28:06 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8b6a94d-0099-4eff-b264-d4cd6abfd935]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:28:06 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b341ea1d-91f1-4a57-8cf8-83e33cc6ddd7 tempest-VolumesDeleteCascade-1905403258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ec40dfac-fb55-4aa0-a90b-0d239f6af583.a2e3216c-c2c4-4380-8fda-63d12622b13e {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:28:06 devstack sudo[101700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ec40dfac-fb55-4aa0-a90b-0d239f6af583.a2e3216c-c2c4-4380-8fda-63d12622b13e Jul 22 03:28:06 devstack sudo[101700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:28:06 devstack sudo[101700]: pam_unix(sudo:session): session closed for user root Jul 22 03:28:06 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b341ea1d-91f1-4a57-8cf8-83e33cc6ddd7 tempest-VolumesDeleteCascade-1905403258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ec40dfac-fb55-4aa0-a90b-0d239f6af583.a2e3216c-c2c4-4380-8fda-63d12622b13e" returned: 0 in 0.399s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:28:06 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-b341ea1d-91f1-4a57-8cf8-83e33cc6ddd7 tempest-VolumesDeleteCascade-1905403258 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec40dfac-fb55-4aa0-a90b-0d239f6af583(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87747) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 03:28:06 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[41f4e877-ecaf-42d2-ba47-69c4e3b3c141]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:28:06 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b341ea1d-91f1-4a57-8cf8-83e33cc6ddd7 tempest-VolumesDeleteCascade-1905403258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ec40dfac-fb55-4aa0-a90b-0d239f6af583 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:28:06 devstack sudo[101707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ec40dfac-fb55-4aa0-a90b-0d239f6af583 Jul 22 03:28:06 devstack sudo[101707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:28:07 devstack sudo[101707]: pam_unix(sudo:session): session closed for user root Jul 22 03:28:07 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b341ea1d-91f1-4a57-8cf8-83e33cc6ddd7 tempest-VolumesDeleteCascade-1905403258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ec40dfac-fb55-4aa0-a90b-0d239f6af583" returned: 0 in 0.366s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:28:07 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b341ea1d-91f1-4a57-8cf8-83e33cc6ddd7 tempest-VolumesDeleteCascade-1905403258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ec40dfac-fb55-4aa0-a90b-0d239f6af583.a2e3216c-c2c4-4380-8fda-63d12622b13e {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:28:07 devstack sudo[101713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ec40dfac-fb55-4aa0-a90b-0d239f6af583.a2e3216c-c2c4-4380-8fda-63d12622b13e Jul 22 03:28:07 devstack sudo[101713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:28:07 devstack sudo[101713]: pam_unix(sudo:session): session closed for user root Jul 22 03:28:07 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b341ea1d-91f1-4a57-8cf8-83e33cc6ddd7 tempest-VolumesDeleteCascade-1905403258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ec40dfac-fb55-4aa0-a90b-0d239f6af583.a2e3216c-c2c4-4380-8fda-63d12622b13e" returned: 0 in 0.349s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:28:07 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b341ea1d-91f1-4a57-8cf8-83e33cc6ddd7 tempest-VolumesDeleteCascade-1905403258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ec40dfac-fb55-4aa0-a90b-0d239f6af583.a2e3216c-c2c4-4380-8fda-63d12622b13e {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:28:07 devstack sudo[101718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ec40dfac-fb55-4aa0-a90b-0d239f6af583.a2e3216c-c2c4-4380-8fda-63d12622b13e Jul 22 03:28:07 devstack sudo[101718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:28:07 devstack sudo[101718]: pam_unix(sudo:session): session closed for user root Jul 22 03:28:07 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b341ea1d-91f1-4a57-8cf8-83e33cc6ddd7 tempest-VolumesDeleteCascade-1905403258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ec40dfac-fb55-4aa0-a90b-0d239f6af583.a2e3216c-c2c4-4380-8fda-63d12622b13e" returned: 0 in 0.248s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:28:07 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-b341ea1d-91f1-4a57-8cf8-83e33cc6ddd7 tempest-VolumesDeleteCascade-1905403258 None] Lock "cinder-quobyte-a2e3216c-c2c4-4380-8fda-63d12622b13e" released by "_delete_snapshot" :: held 1.464s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:28:07 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-b341ea1d-91f1-4a57-8cf8-83e33cc6ddd7 tempest-VolumesDeleteCascade-1905403258 None] Lock "cinder-quobyte-ec40dfac-fb55-4aa0-a90b-0d239f6af583" released by "delete_snapshot" :: held 1.497s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:28:07 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-b341ea1d-91f1-4a57-8cf8-83e33cc6ddd7 tempest-VolumesDeleteCascade-1905403258 None] Created reservations ['634a9bb0-989e-4be5-8e1b-5735e1cfffb5', '62cdc5c7-ff06-4958-8764-de60ea4f6416', 'cbca210a-e47c-4857-b3e5-ca7fa823fe24', '34c93788-756b-4134-9ab6-60aef1086c5a'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:28:07 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-b341ea1d-91f1-4a57-8cf8-83e33cc6ddd7 tempest-VolumesDeleteCascade-1905403258 None] Delete snapshot completed successfully. Jul 22 03:28:07 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-b341ea1d-91f1-4a57-8cf8-83e33cc6ddd7 tempest-VolumesDeleteCascade-1905403258 None] Lock "cinder-a2e3216c-c2c4-4380-8fda-63d12622b13e-delete_snapshot" released by "delete_snapshot" :: held 1.654s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:28:07 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b341ea1d-91f1-4a57-8cf8-83e33cc6ddd7 tempest-VolumesDeleteCascade-1905403258 None] Snapshots deleted, issuing volume delete {{(pid=87747) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 22 03:28:07 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-b341ea1d-91f1-4a57-8cf8-83e33cc6ddd7 tempest-VolumesDeleteCascade-1905403258 None] Acquiring lock "cinder-quobyte-ec40dfac-fb55-4aa0-a90b-0d239f6af583" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:28:07 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-b341ea1d-91f1-4a57-8cf8-83e33cc6ddd7 tempest-VolumesDeleteCascade-1905403258 None] Lock "cinder-quobyte-ec40dfac-fb55-4aa0-a90b-0d239f6af583" acquired by "delete_volume" :: waited 0.014s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:28:07 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c1f2208-e5b5-4f24-ab36-5e3891b61130]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:28:07 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b341ea1d-91f1-4a57-8cf8-83e33cc6ddd7 tempest-VolumesDeleteCascade-1905403258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ec40dfac-fb55-4aa0-a90b-0d239f6af583 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:28:08 devstack sudo[101721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ec40dfac-fb55-4aa0-a90b-0d239f6af583 Jul 22 03:28:08 devstack sudo[101721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:28:08 devstack sudo[101721]: pam_unix(sudo:session): session closed for user root Jul 22 03:28:08 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b341ea1d-91f1-4a57-8cf8-83e33cc6ddd7 tempest-VolumesDeleteCascade-1905403258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ec40dfac-fb55-4aa0-a90b-0d239f6af583" returned: 0 in 0.369s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:28:08 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b341ea1d-91f1-4a57-8cf8-83e33cc6ddd7 tempest-VolumesDeleteCascade-1905403258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ec40dfac-fb55-4aa0-a90b-0d239f6af583 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:28:08 devstack sudo[101726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ec40dfac-fb55-4aa0-a90b-0d239f6af583 Jul 22 03:28:08 devstack sudo[101726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:28:08 devstack sudo[101726]: pam_unix(sudo:session): session closed for user root Jul 22 03:28:08 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b341ea1d-91f1-4a57-8cf8-83e33cc6ddd7 tempest-VolumesDeleteCascade-1905403258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ec40dfac-fb55-4aa0-a90b-0d239f6af583" returned: 0 in 0.262s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:28:08 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-b341ea1d-91f1-4a57-8cf8-83e33cc6ddd7 tempest-VolumesDeleteCascade-1905403258 None] Lock "cinder-quobyte-ec40dfac-fb55-4aa0-a90b-0d239f6af583" released by "delete_volume" :: held 0.706s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:28:08 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-92dcaa9a-e684-48f0-8736-4eac9d5e9d4b tempest-ProjectReaderTests-1507094960 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:28:08 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-92dcaa9a-e684-48f0-8736-4eac9d5e9d4b tempest-ProjectReaderTests-1507094960 None] Flow 'volume_create_manager' (da3e6a16-171a-4e18-ae77-1e3639037592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:28:08 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-92dcaa9a-e684-48f0-8736-4eac9d5e9d4b tempest-ProjectReaderTests-1507094960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f61ea381-295f-4546-a498-9649775030e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:28:08 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-92dcaa9a-e684-48f0-8736-4eac9d5e9d4b tempest-ProjectReaderTests-1507094960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f61ea381-295f-4546-a498-9649775030e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:28:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-58652696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6810cfd-8120-4242-a827-7a56966ba1ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='890bea6d7a114e1a8d1e0f7b17efb02d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:28:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:28:09Z,use_quota=True,user_id='244268fcc01d495d83fddb9c4c13b5da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:28:08 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-92dcaa9a-e684-48f0-8736-4eac9d5e9d4b tempest-ProjectReaderTests-1507094960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb05be35-34a8-4409-9a22-dd6b3acff351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:28:08 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-92dcaa9a-e684-48f0-8736-4eac9d5e9d4b tempest-ProjectReaderTests-1507094960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb05be35-34a8-4409-9a22-dd6b3acff351) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:28:08 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-92dcaa9a-e684-48f0-8736-4eac9d5e9d4b tempest-ProjectReaderTests-1507094960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec872850-1c99-412a-bcbd-e2434fc1cfe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:28:08 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-92dcaa9a-e684-48f0-8736-4eac9d5e9d4b tempest-ProjectReaderTests-1507094960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec872850-1c99-412a-bcbd-e2434fc1cfe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6810cfd-8120-4242-a827-7a56966ba1ed', 'volume_name': 'volume-c6810cfd-8120-4242-a827-7a56966ba1ed', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:28:08 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-92dcaa9a-e684-48f0-8736-4eac9d5e9d4b tempest-ProjectReaderTests-1507094960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (064214fd-1805-438e-82c2-62a598eac7a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:28:08 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-92dcaa9a-e684-48f0-8736-4eac9d5e9d4b tempest-ProjectReaderTests-1507094960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (064214fd-1805-438e-82c2-62a598eac7a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:28:08 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-92dcaa9a-e684-48f0-8736-4eac9d5e9d4b tempest-ProjectReaderTests-1507094960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98b6719e-71cf-4c5e-b626-e6cb4c4e8c31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:28:08 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-92dcaa9a-e684-48f0-8736-4eac9d5e9d4b tempest-ProjectReaderTests-1507094960 None] Volume c6810cfd-8120-4242-a827-7a56966ba1ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6810cfd-8120-4242-a827-7a56966ba1ed', 'volume_size': 1} Jul 22 03:28:08 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-92dcaa9a-e684-48f0-8736-4eac9d5e9d4b tempest-ProjectReaderTests-1507094960 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:28:08 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-92dcaa9a-e684-48f0-8736-4eac9d5e9d4b tempest-ProjectReaderTests-1507094960 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:28:08 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-92dcaa9a-e684-48f0-8736-4eac9d5e9d4b tempest-ProjectReaderTests-1507094960 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:28:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-58652696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6810cfd-8120-4242-a827-7a56966ba1ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='890bea6d7a114e1a8d1e0f7b17efb02d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:28:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:28:09Z,use_quota=True,user_id='244268fcc01d495d83fddb9c4c13b5da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:28:08 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-92dcaa9a-e684-48f0-8736-4eac9d5e9d4b tempest-ProjectReaderTests-1507094960 None] Creating volume c6810cfd-8120-4242-a827-7a56966ba1ed {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:28:08 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-92dcaa9a-e684-48f0-8736-4eac9d5e9d4b tempest-ProjectReaderTests-1507094960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:28:08 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-92dcaa9a-e684-48f0-8736-4eac9d5e9d4b tempest-ProjectReaderTests-1507094960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:28:08 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-92dcaa9a-e684-48f0-8736-4eac9d5e9d4b tempest-ProjectReaderTests-1507094960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:28:08 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-92dcaa9a-e684-48f0-8736-4eac9d5e9d4b tempest-ProjectReaderTests-1507094960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:28:08 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-92dcaa9a-e684-48f0-8736-4eac9d5e9d4b tempest-ProjectReaderTests-1507094960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:28:08 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-92dcaa9a-e684-48f0-8736-4eac9d5e9d4b tempest-ProjectReaderTests-1507094960 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:28:08 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-92dcaa9a-e684-48f0-8736-4eac9d5e9d4b tempest-ProjectReaderTests-1507094960 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:28:08 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-92dcaa9a-e684-48f0-8736-4eac9d5e9d4b tempest-ProjectReaderTests-1507094960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c6810cfd-8120-4242-a827-7a56966ba1ed 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:28:08 devstack sudo[101729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c6810cfd-8120-4242-a827-7a56966ba1ed 1073741824 Jul 22 03:28:08 devstack sudo[101729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:28:08 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-b341ea1d-91f1-4a57-8cf8-83e33cc6ddd7 tempest-VolumesDeleteCascade-1905403258 None] Created reservations ['2258b807-232e-4ce1-be3a-e76ff26dc194', 'db0c0417-1e84-4851-9880-9d6b08b105d9', 'b9861d8a-3da1-4194-9014-fd9933dea5cf', 'a2f3dd2e-fc6d-46f2-b1bd-a3b99f7b29cd'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:28:08 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b341ea1d-91f1-4a57-8cf8-83e33cc6ddd7 tempest-VolumesDeleteCascade-1905403258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:28:08 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b341ea1d-91f1-4a57-8cf8-83e33cc6ddd7 tempest-VolumesDeleteCascade-1905403258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:28:08 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-b341ea1d-91f1-4a57-8cf8-83e33cc6ddd7 tempest-VolumesDeleteCascade-1905403258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:28:08 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-b341ea1d-91f1-4a57-8cf8-83e33cc6ddd7 tempest-VolumesDeleteCascade-1905403258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:28:08 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b341ea1d-91f1-4a57-8cf8-83e33cc6ddd7 tempest-VolumesDeleteCascade-1905403258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:28:08 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b341ea1d-91f1-4a57-8cf8-83e33cc6ddd7 tempest-VolumesDeleteCascade-1905403258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:28:08 devstack sudo[101731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:28:08 devstack sudo[101731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:28:09 devstack sudo[101731]: pam_unix(sudo:session): session closed for user root Jul 22 03:28:09 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b341ea1d-91f1-4a57-8cf8-83e33cc6ddd7 tempest-VolumesDeleteCascade-1905403258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.270s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:28:09 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-b341ea1d-91f1-4a57-8cf8-83e33cc6ddd7 tempest-VolumesDeleteCascade-1905403258 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:28:09 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-b341ea1d-91f1-4a57-8cf8-83e33cc6ddd7 tempest-VolumesDeleteCascade-1905403258 None] Deleted volume successfully. Jul 22 03:28:09 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-b341ea1d-91f1-4a57-8cf8-83e33cc6ddd7 tempest-VolumesDeleteCascade-1905403258 None] Lock "cinder-ec40dfac-fb55-4aa0-a90b-0d239f6af583-delete_volume" released by "delete_volume" :: held 2.948s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:28:09 devstack sudo[101729]: pam_unix(sudo:session): session closed for user root Jul 22 03:28:09 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-92dcaa9a-e684-48f0-8736-4eac9d5e9d4b tempest-ProjectReaderTests-1507094960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c6810cfd-8120-4242-a827-7a56966ba1ed 1073741824" returned: 0 in 0.423s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:28:09 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-92dcaa9a-e684-48f0-8736-4eac9d5e9d4b tempest-ProjectReaderTests-1507094960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c6810cfd-8120-4242-a827-7a56966ba1ed {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:28:09 devstack sudo[101738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c6810cfd-8120-4242-a827-7a56966ba1ed Jul 22 03:28:09 devstack sudo[101738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:28:09 devstack sudo[101738]: pam_unix(sudo:session): session closed for user root Jul 22 03:28:09 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-92dcaa9a-e684-48f0-8736-4eac9d5e9d4b tempest-ProjectReaderTests-1507094960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c6810cfd-8120-4242-a827-7a56966ba1ed" returned: 0 in 0.238s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:28:09 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-92dcaa9a-e684-48f0-8736-4eac9d5e9d4b tempest-ProjectReaderTests-1507094960 None] <== create_volume: return (699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:28:09 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-92dcaa9a-e684-48f0-8736-4eac9d5e9d4b tempest-ProjectReaderTests-1507094960 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.701s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:28:09 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-92dcaa9a-e684-48f0-8736-4eac9d5e9d4b tempest-ProjectReaderTests-1507094960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98b6719e-71cf-4c5e-b626-e6cb4c4e8c31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6810cfd-8120-4242-a827-7a56966ba1ed', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:28:09 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-92dcaa9a-e684-48f0-8736-4eac9d5e9d4b tempest-ProjectReaderTests-1507094960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c1e3456-db5e-4f6d-a2ad-28a18fc8d8b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:28:09 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-92dcaa9a-e684-48f0-8736-4eac9d5e9d4b tempest-ProjectReaderTests-1507094960 None] Volume volume-c6810cfd-8120-4242-a827-7a56966ba1ed (c6810cfd-8120-4242-a827-7a56966ba1ed): created successfully Jul 22 03:28:09 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-92dcaa9a-e684-48f0-8736-4eac9d5e9d4b tempest-ProjectReaderTests-1507094960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c1e3456-db5e-4f6d-a2ad-28a18fc8d8b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:28:09 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-92dcaa9a-e684-48f0-8736-4eac9d5e9d4b tempest-ProjectReaderTests-1507094960 None] Flow 'volume_create_manager' (da3e6a16-171a-4e18-ae77-1e3639037592) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:28:09 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-92dcaa9a-e684-48f0-8736-4eac9d5e9d4b tempest-ProjectReaderTests-1507094960 None] Created volume successfully. Jul 22 03:28:09 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-efee8f8d-0ead-4fae-b5fb-10391de2b2aa tempest-VolumesDeleteCascade-1905403258 None] Acquiring lock "cinder-000e1556-65ef-443f-9fba-61460ef83f2e-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:28:09 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-efee8f8d-0ead-4fae-b5fb-10391de2b2aa tempest-VolumesDeleteCascade-1905403258 None] Lock "cinder-000e1556-65ef-443f-9fba-61460ef83f2e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:28:09 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-efee8f8d-0ead-4fae-b5fb-10391de2b2aa tempest-VolumesDeleteCascade-1905403258 None] Acquiring lock "cinder-quobyte-000e1556-65ef-443f-9fba-61460ef83f2e" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:28:09 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-efee8f8d-0ead-4fae-b5fb-10391de2b2aa tempest-VolumesDeleteCascade-1905403258 None] Lock "cinder-quobyte-000e1556-65ef-443f-9fba-61460ef83f2e" acquired by "delete_volume" :: waited 0.024s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:28:09 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ccd2c23-a80f-4994-a24b-1f88b8b19ee6]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:28:09 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-efee8f8d-0ead-4fae-b5fb-10391de2b2aa tempest-VolumesDeleteCascade-1905403258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-000e1556-65ef-443f-9fba-61460ef83f2e {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:28:09 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-601fd42a-4335-4a68-826c-0ab1eb3bd9a6 tempest-ProjectReaderTests-1507094960 None] Acquiring lock "cinder-c6810cfd-8120-4242-a827-7a56966ba1ed-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:28:09 devstack sudo[101741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-000e1556-65ef-443f-9fba-61460ef83f2e Jul 22 03:28:09 devstack sudo[101741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:28:09 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-601fd42a-4335-4a68-826c-0ab1eb3bd9a6 tempest-ProjectReaderTests-1507094960 None] Lock "cinder-c6810cfd-8120-4242-a827-7a56966ba1ed-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:28:09 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-601fd42a-4335-4a68-826c-0ab1eb3bd9a6 tempest-ProjectReaderTests-1507094960 None] Acquiring lock "cinder-quobyte-c6810cfd-8120-4242-a827-7a56966ba1ed" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:28:09 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-601fd42a-4335-4a68-826c-0ab1eb3bd9a6 tempest-ProjectReaderTests-1507094960 None] Lock "cinder-quobyte-c6810cfd-8120-4242-a827-7a56966ba1ed" acquired by "delete_volume" :: waited 0.021s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:28:09 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bed4c81-2d75-46a9-b433-5918ce28e1c3]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:28:09 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-601fd42a-4335-4a68-826c-0ab1eb3bd9a6 tempest-ProjectReaderTests-1507094960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c6810cfd-8120-4242-a827-7a56966ba1ed {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:28:09 devstack sudo[101743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c6810cfd-8120-4242-a827-7a56966ba1ed Jul 22 03:28:09 devstack sudo[101743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:28:10 devstack sudo[101741]: pam_unix(sudo:session): session closed for user root Jul 22 03:28:10 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-efee8f8d-0ead-4fae-b5fb-10391de2b2aa tempest-VolumesDeleteCascade-1905403258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-000e1556-65ef-443f-9fba-61460ef83f2e" returned: 0 in 0.385s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:28:10 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-efee8f8d-0ead-4fae-b5fb-10391de2b2aa tempest-VolumesDeleteCascade-1905403258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-000e1556-65ef-443f-9fba-61460ef83f2e {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:28:10 devstack sudo[101748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-000e1556-65ef-443f-9fba-61460ef83f2e Jul 22 03:28:10 devstack sudo[101748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:28:10 devstack sudo[101743]: pam_unix(sudo:session): session closed for user root Jul 22 03:28:10 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-601fd42a-4335-4a68-826c-0ab1eb3bd9a6 tempest-ProjectReaderTests-1507094960 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c6810cfd-8120-4242-a827-7a56966ba1ed" returned: 0 in 0.358s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:28:10 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-601fd42a-4335-4a68-826c-0ab1eb3bd9a6 tempest-ProjectReaderTests-1507094960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c6810cfd-8120-4242-a827-7a56966ba1ed {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:28:10 devstack sudo[101753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c6810cfd-8120-4242-a827-7a56966ba1ed Jul 22 03:28:10 devstack sudo[101753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:28:10 devstack sudo[101748]: pam_unix(sudo:session): session closed for user root Jul 22 03:28:10 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-efee8f8d-0ead-4fae-b5fb-10391de2b2aa tempest-VolumesDeleteCascade-1905403258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-000e1556-65ef-443f-9fba-61460ef83f2e" returned: 0 in 0.249s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:28:10 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-efee8f8d-0ead-4fae-b5fb-10391de2b2aa tempest-VolumesDeleteCascade-1905403258 None] Lock "cinder-quobyte-000e1556-65ef-443f-9fba-61460ef83f2e" released by "delete_volume" :: held 0.680s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:28:10 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-efee8f8d-0ead-4fae-b5fb-10391de2b2aa tempest-VolumesDeleteCascade-1905403258 None] Created reservations ['677b0955-0008-4a03-874e-0c1ecd3ec429', '0dc46c36-b5f0-45d7-84df-f4d4725a44a4', '8ff14832-407c-42e0-aeac-51e6bcc98550', '9dfb93a9-09d1-4aff-a467-7560a735b393'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:28:10 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-efee8f8d-0ead-4fae-b5fb-10391de2b2aa tempest-VolumesDeleteCascade-1905403258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:28:10 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-efee8f8d-0ead-4fae-b5fb-10391de2b2aa tempest-VolumesDeleteCascade-1905403258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:28:10 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-efee8f8d-0ead-4fae-b5fb-10391de2b2aa tempest-VolumesDeleteCascade-1905403258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:28:10 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-efee8f8d-0ead-4fae-b5fb-10391de2b2aa tempest-VolumesDeleteCascade-1905403258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:28:10 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-efee8f8d-0ead-4fae-b5fb-10391de2b2aa tempest-VolumesDeleteCascade-1905403258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:28:10 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-efee8f8d-0ead-4fae-b5fb-10391de2b2aa tempest-VolumesDeleteCascade-1905403258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:28:10 devstack sudo[101756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:28:10 devstack sudo[101756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:28:10 devstack sudo[101753]: pam_unix(sudo:session): session closed for user root Jul 22 03:28:10 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-601fd42a-4335-4a68-826c-0ab1eb3bd9a6 tempest-ProjectReaderTests-1507094960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c6810cfd-8120-4242-a827-7a56966ba1ed" returned: 0 in 0.252s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:28:10 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-601fd42a-4335-4a68-826c-0ab1eb3bd9a6 tempest-ProjectReaderTests-1507094960 None] Lock "cinder-quobyte-c6810cfd-8120-4242-a827-7a56966ba1ed" released by "delete_volume" :: held 0.646s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:28:10 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-601fd42a-4335-4a68-826c-0ab1eb3bd9a6 tempest-ProjectReaderTests-1507094960 None] Created reservations ['f665b1f1-8d8e-4118-82fd-2fbb196696f0', '97fd5db2-63fc-4d7a-ab5b-4c8b8ff93885', '9c9e1641-6b7a-45d9-b516-423553fa493f', '881e003c-ac03-41f4-818d-371c4c0deca6'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:28:10 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-601fd42a-4335-4a68-826c-0ab1eb3bd9a6 tempest-ProjectReaderTests-1507094960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:28:10 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-601fd42a-4335-4a68-826c-0ab1eb3bd9a6 tempest-ProjectReaderTests-1507094960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:28:10 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-601fd42a-4335-4a68-826c-0ab1eb3bd9a6 tempest-ProjectReaderTests-1507094960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:28:10 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-601fd42a-4335-4a68-826c-0ab1eb3bd9a6 tempest-ProjectReaderTests-1507094960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:28:10 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-601fd42a-4335-4a68-826c-0ab1eb3bd9a6 tempest-ProjectReaderTests-1507094960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:28:10 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-601fd42a-4335-4a68-826c-0ab1eb3bd9a6 tempest-ProjectReaderTests-1507094960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:28:10 devstack sudo[101759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:28:10 devstack sudo[101759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:28:10 devstack sudo[101756]: pam_unix(sudo:session): session closed for user root Jul 22 03:28:10 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-efee8f8d-0ead-4fae-b5fb-10391de2b2aa tempest-VolumesDeleteCascade-1905403258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.262s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:28:10 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-efee8f8d-0ead-4fae-b5fb-10391de2b2aa tempest-VolumesDeleteCascade-1905403258 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:28:10 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-efee8f8d-0ead-4fae-b5fb-10391de2b2aa tempest-VolumesDeleteCascade-1905403258 None] Deleted volume successfully. Jul 22 03:28:10 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-efee8f8d-0ead-4fae-b5fb-10391de2b2aa tempest-VolumesDeleteCascade-1905403258 None] Lock "cinder-000e1556-65ef-443f-9fba-61460ef83f2e-delete_volume" released by "delete_volume" :: held 1.158s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:28:10 devstack sudo[101759]: pam_unix(sudo:session): session closed for user root Jul 22 03:28:10 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-601fd42a-4335-4a68-826c-0ab1eb3bd9a6 tempest-ProjectReaderTests-1507094960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.282s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:28:10 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-601fd42a-4335-4a68-826c-0ab1eb3bd9a6 tempest-ProjectReaderTests-1507094960 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:28:10 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-601fd42a-4335-4a68-826c-0ab1eb3bd9a6 tempest-ProjectReaderTests-1507094960 None] Deleted volume successfully. Jul 22 03:28:10 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-601fd42a-4335-4a68-826c-0ab1eb3bd9a6 tempest-ProjectReaderTests-1507094960 None] Lock "cinder-c6810cfd-8120-4242-a827-7a56966ba1ed-delete_volume" released by "delete_volume" :: held 1.122s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:28:11 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a6470e5-8a3d-483f-bce5-2cc79072e197 tempest-ProjectReaderTests-1507094960 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:28:11 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2a6470e5-8a3d-483f-bce5-2cc79072e197 tempest-ProjectReaderTests-1507094960 None] Flow 'volume_create_manager' (97033429-c909-4a2b-bc6f-e1f04eab8953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:28:11 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2a6470e5-8a3d-483f-bce5-2cc79072e197 tempest-ProjectReaderTests-1507094960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddc10f96-3665-4bf8-bc22-82af928a7522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:28:11 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2a6470e5-8a3d-483f-bce5-2cc79072e197 tempest-ProjectReaderTests-1507094960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddc10f96-3665-4bf8-bc22-82af928a7522) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:28:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1715266104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a0400cd-c638-41aa-b360-f007f412dd26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='890bea6d7a114e1a8d1e0f7b17efb02d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:28:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:28:11Z,use_quota=True,user_id='244268fcc01d495d83fddb9c4c13b5da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:28:11 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2a6470e5-8a3d-483f-bce5-2cc79072e197 tempest-ProjectReaderTests-1507094960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e781b83b-fabe-47d0-9372-8297319193e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:28:11 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2a6470e5-8a3d-483f-bce5-2cc79072e197 tempest-ProjectReaderTests-1507094960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e781b83b-fabe-47d0-9372-8297319193e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:28:11 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2a6470e5-8a3d-483f-bce5-2cc79072e197 tempest-ProjectReaderTests-1507094960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7c03036-49e6-4f9e-b61d-93a66a0ae410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:28:11 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2a6470e5-8a3d-483f-bce5-2cc79072e197 tempest-ProjectReaderTests-1507094960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7c03036-49e6-4f9e-b61d-93a66a0ae410) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a0400cd-c638-41aa-b360-f007f412dd26', 'volume_name': 'volume-1a0400cd-c638-41aa-b360-f007f412dd26', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:28:11 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2a6470e5-8a3d-483f-bce5-2cc79072e197 tempest-ProjectReaderTests-1507094960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72a95a45-85b5-45ed-ae87-45904814dad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:28:11 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2a6470e5-8a3d-483f-bce5-2cc79072e197 tempest-ProjectReaderTests-1507094960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72a95a45-85b5-45ed-ae87-45904814dad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:28:11 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2a6470e5-8a3d-483f-bce5-2cc79072e197 tempest-ProjectReaderTests-1507094960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f04ac5f-0729-46db-836f-85ab3ff9ac3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:28:11 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-2a6470e5-8a3d-483f-bce5-2cc79072e197 tempest-ProjectReaderTests-1507094960 None] Volume 1a0400cd-c638-41aa-b360-f007f412dd26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a0400cd-c638-41aa-b360-f007f412dd26', 'volume_size': 1} Jul 22 03:28:11 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-2a6470e5-8a3d-483f-bce5-2cc79072e197 tempest-ProjectReaderTests-1507094960 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:28:11 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-2a6470e5-8a3d-483f-bce5-2cc79072e197 tempest-ProjectReaderTests-1507094960 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:28:11 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-2a6470e5-8a3d-483f-bce5-2cc79072e197 tempest-ProjectReaderTests-1507094960 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:28:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1715266104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a0400cd-c638-41aa-b360-f007f412dd26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='890bea6d7a114e1a8d1e0f7b17efb02d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:28:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:28:11Z,use_quota=True,user_id='244268fcc01d495d83fddb9c4c13b5da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:28:11 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-2a6470e5-8a3d-483f-bce5-2cc79072e197 tempest-ProjectReaderTests-1507094960 None] Creating volume 1a0400cd-c638-41aa-b360-f007f412dd26 {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:28:11 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-2a6470e5-8a3d-483f-bce5-2cc79072e197 tempest-ProjectReaderTests-1507094960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:28:11 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-2a6470e5-8a3d-483f-bce5-2cc79072e197 tempest-ProjectReaderTests-1507094960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:28:11 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-2a6470e5-8a3d-483f-bce5-2cc79072e197 tempest-ProjectReaderTests-1507094960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:28:11 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-2a6470e5-8a3d-483f-bce5-2cc79072e197 tempest-ProjectReaderTests-1507094960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:28:11 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-2a6470e5-8a3d-483f-bce5-2cc79072e197 tempest-ProjectReaderTests-1507094960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:28:11 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-2a6470e5-8a3d-483f-bce5-2cc79072e197 tempest-ProjectReaderTests-1507094960 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:28:11 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-2a6470e5-8a3d-483f-bce5-2cc79072e197 tempest-ProjectReaderTests-1507094960 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:28:11 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2a6470e5-8a3d-483f-bce5-2cc79072e197 tempest-ProjectReaderTests-1507094960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1a0400cd-c638-41aa-b360-f007f412dd26 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:28:11 devstack sudo[101763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1a0400cd-c638-41aa-b360-f007f412dd26 1073741824 Jul 22 03:28:11 devstack sudo[101763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:28:11 devstack sudo[101763]: pam_unix(sudo:session): session closed for user root Jul 22 03:28:11 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2a6470e5-8a3d-483f-bce5-2cc79072e197 tempest-ProjectReaderTests-1507094960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1a0400cd-c638-41aa-b360-f007f412dd26 1073741824" returned: 0 in 0.447s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:28:11 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2a6470e5-8a3d-483f-bce5-2cc79072e197 tempest-ProjectReaderTests-1507094960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1a0400cd-c638-41aa-b360-f007f412dd26 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:28:11 devstack sudo[101769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1a0400cd-c638-41aa-b360-f007f412dd26 Jul 22 03:28:11 devstack sudo[101769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:28:12 devstack sudo[101769]: pam_unix(sudo:session): session closed for user root Jul 22 03:28:12 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2a6470e5-8a3d-483f-bce5-2cc79072e197 tempest-ProjectReaderTests-1507094960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1a0400cd-c638-41aa-b360-f007f412dd26" returned: 0 in 0.291s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:28:12 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-2a6470e5-8a3d-483f-bce5-2cc79072e197 tempest-ProjectReaderTests-1507094960 None] <== create_volume: return (785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:28:12 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-2a6470e5-8a3d-483f-bce5-2cc79072e197 tempest-ProjectReaderTests-1507094960 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.788s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:28:12 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2a6470e5-8a3d-483f-bce5-2cc79072e197 tempest-ProjectReaderTests-1507094960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f04ac5f-0729-46db-836f-85ab3ff9ac3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a0400cd-c638-41aa-b360-f007f412dd26', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:28:12 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2a6470e5-8a3d-483f-bce5-2cc79072e197 tempest-ProjectReaderTests-1507094960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b5010b8-a7f1-433d-b01e-3b7f0e1e7a26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:28:12 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-2a6470e5-8a3d-483f-bce5-2cc79072e197 tempest-ProjectReaderTests-1507094960 None] Volume volume-1a0400cd-c638-41aa-b360-f007f412dd26 (1a0400cd-c638-41aa-b360-f007f412dd26): created successfully Jul 22 03:28:12 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2a6470e5-8a3d-483f-bce5-2cc79072e197 tempest-ProjectReaderTests-1507094960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b5010b8-a7f1-433d-b01e-3b7f0e1e7a26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:28:12 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2a6470e5-8a3d-483f-bce5-2cc79072e197 tempest-ProjectReaderTests-1507094960 None] Flow 'volume_create_manager' (97033429-c909-4a2b-bc6f-e1f04eab8953) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:28:12 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-2a6470e5-8a3d-483f-bce5-2cc79072e197 tempest-ProjectReaderTests-1507094960 None] Created volume successfully. Jul 22 03:28:13 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-138fbf8d-af4d-4ef8-832b-d5e0a7356b54 tempest-ProjectReaderTests-1507094960 None] Acquiring lock "cinder-1a0400cd-c638-41aa-b360-f007f412dd26-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:28:13 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-138fbf8d-af4d-4ef8-832b-d5e0a7356b54 tempest-ProjectReaderTests-1507094960 None] Lock "cinder-1a0400cd-c638-41aa-b360-f007f412dd26-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:28:13 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-138fbf8d-af4d-4ef8-832b-d5e0a7356b54 tempest-ProjectReaderTests-1507094960 None] Acquiring lock "cinder-quobyte-1a0400cd-c638-41aa-b360-f007f412dd26" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:28:13 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-138fbf8d-af4d-4ef8-832b-d5e0a7356b54 tempest-ProjectReaderTests-1507094960 None] Lock "cinder-quobyte-1a0400cd-c638-41aa-b360-f007f412dd26" acquired by "delete_volume" :: waited 0.017s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:28:13 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-935d36ec-36d5-4c9c-886b-d3352ce23611 tempest-VolumesCloneTest-1728908944 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:28:13 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-935d36ec-36d5-4c9c-886b-d3352ce23611 tempest-VolumesCloneTest-1728908944 None] Flow 'volume_create_manager' (f2eda931-a4fc-43df-8588-6ea3dce3dfb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:28:13 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-935d36ec-36d5-4c9c-886b-d3352ce23611 tempest-VolumesCloneTest-1728908944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56e31f5c-fba6-40d7-a3af-95483c8b914f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:28:13 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a4d0eb0-87b4-4a0d-99de-328b0183b9b6]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:28:13 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-138fbf8d-af4d-4ef8-832b-d5e0a7356b54 tempest-ProjectReaderTests-1507094960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1a0400cd-c638-41aa-b360-f007f412dd26 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:28:13 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-935d36ec-36d5-4c9c-886b-d3352ce23611 tempest-VolumesCloneTest-1728908944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56e31f5c-fba6-40d7-a3af-95483c8b914f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:28:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1810020659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cf00089-392c-450d-a08f-0930e906eb2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2a3638b80094308a3802597b1c84d9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:28:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:28:13Z,use_quota=True,user_id='d4abc902cdd3473abda8b4cadc076578',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:28:13 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-935d36ec-36d5-4c9c-886b-d3352ce23611 tempest-VolumesCloneTest-1728908944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0129bd9f-a618-459d-8fe4-1ff96afbf273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:28:13 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-935d36ec-36d5-4c9c-886b-d3352ce23611 tempest-VolumesCloneTest-1728908944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0129bd9f-a618-459d-8fe4-1ff96afbf273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:28:13 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-935d36ec-36d5-4c9c-886b-d3352ce23611 tempest-VolumesCloneTest-1728908944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f71cfc7-cdb3-4f8b-90fa-6963ff3884b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:28:13 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-935d36ec-36d5-4c9c-886b-d3352ce23611 tempest-VolumesCloneTest-1728908944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f71cfc7-cdb3-4f8b-90fa-6963ff3884b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3cf00089-392c-450d-a08f-0930e906eb2a', 'volume_name': 'volume-3cf00089-392c-450d-a08f-0930e906eb2a', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:28:13 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-935d36ec-36d5-4c9c-886b-d3352ce23611 tempest-VolumesCloneTest-1728908944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e09708d-75a8-4aa1-b399-fc93da73437a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:28:13 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-935d36ec-36d5-4c9c-886b-d3352ce23611 tempest-VolumesCloneTest-1728908944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e09708d-75a8-4aa1-b399-fc93da73437a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:28:13 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-935d36ec-36d5-4c9c-886b-d3352ce23611 tempest-VolumesCloneTest-1728908944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff5b6c9a-1d0c-4ce8-912f-a78dd123fa8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:28:13 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-935d36ec-36d5-4c9c-886b-d3352ce23611 tempest-VolumesCloneTest-1728908944 None] Volume 3cf00089-392c-450d-a08f-0930e906eb2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3cf00089-392c-450d-a08f-0930e906eb2a', 'volume_size': 1} Jul 22 03:28:13 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-935d36ec-36d5-4c9c-886b-d3352ce23611 tempest-VolumesCloneTest-1728908944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:28:13 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-935d36ec-36d5-4c9c-886b-d3352ce23611 tempest-VolumesCloneTest-1728908944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:28:13 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-935d36ec-36d5-4c9c-886b-d3352ce23611 tempest-VolumesCloneTest-1728908944 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:28:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1810020659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cf00089-392c-450d-a08f-0930e906eb2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2a3638b80094308a3802597b1c84d9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:28:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:28:13Z,use_quota=True,user_id='d4abc902cdd3473abda8b4cadc076578',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:28:13 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-935d36ec-36d5-4c9c-886b-d3352ce23611 tempest-VolumesCloneTest-1728908944 None] Creating volume 3cf00089-392c-450d-a08f-0930e906eb2a {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:28:13 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-935d36ec-36d5-4c9c-886b-d3352ce23611 tempest-VolumesCloneTest-1728908944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:28:13 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-935d36ec-36d5-4c9c-886b-d3352ce23611 tempest-VolumesCloneTest-1728908944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:28:13 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-935d36ec-36d5-4c9c-886b-d3352ce23611 tempest-VolumesCloneTest-1728908944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:28:13 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-935d36ec-36d5-4c9c-886b-d3352ce23611 tempest-VolumesCloneTest-1728908944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:28:13 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-935d36ec-36d5-4c9c-886b-d3352ce23611 tempest-VolumesCloneTest-1728908944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:28:13 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-935d36ec-36d5-4c9c-886b-d3352ce23611 tempest-VolumesCloneTest-1728908944 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:28:13 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-935d36ec-36d5-4c9c-886b-d3352ce23611 tempest-VolumesCloneTest-1728908944 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:28:13 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-935d36ec-36d5-4c9c-886b-d3352ce23611 tempest-VolumesCloneTest-1728908944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3cf00089-392c-450d-a08f-0930e906eb2a 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:28:13 devstack sudo[101774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3cf00089-392c-450d-a08f-0930e906eb2a 1073741824 Jul 22 03:28:13 devstack sudo[101774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:28:13 devstack sudo[101773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1a0400cd-c638-41aa-b360-f007f412dd26 Jul 22 03:28:13 devstack sudo[101773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:28:13 devstack sudo[101773]: pam_unix(sudo:session): session closed for user root Jul 22 03:28:13 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-138fbf8d-af4d-4ef8-832b-d5e0a7356b54 tempest-ProjectReaderTests-1507094960 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1a0400cd-c638-41aa-b360-f007f412dd26" returned: 0 in 0.356s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:28:13 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-138fbf8d-af4d-4ef8-832b-d5e0a7356b54 tempest-ProjectReaderTests-1507094960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1a0400cd-c638-41aa-b360-f007f412dd26 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:28:13 devstack sudo[101783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1a0400cd-c638-41aa-b360-f007f412dd26 Jul 22 03:28:13 devstack sudo[101783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:28:14 devstack sudo[101774]: pam_unix(sudo:session): session closed for user root Jul 22 03:28:14 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-935d36ec-36d5-4c9c-886b-d3352ce23611 tempest-VolumesCloneTest-1728908944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3cf00089-392c-450d-a08f-0930e906eb2a 1073741824" returned: 0 in 0.411s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:28:14 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-935d36ec-36d5-4c9c-886b-d3352ce23611 tempest-VolumesCloneTest-1728908944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3cf00089-392c-450d-a08f-0930e906eb2a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:28:14 devstack sudo[101785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3cf00089-392c-450d-a08f-0930e906eb2a Jul 22 03:28:14 devstack sudo[101785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:28:14 devstack sudo[101783]: pam_unix(sudo:session): session closed for user root Jul 22 03:28:14 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-138fbf8d-af4d-4ef8-832b-d5e0a7356b54 tempest-ProjectReaderTests-1507094960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1a0400cd-c638-41aa-b360-f007f412dd26" returned: 0 in 0.246s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:28:14 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-138fbf8d-af4d-4ef8-832b-d5e0a7356b54 tempest-ProjectReaderTests-1507094960 None] Lock "cinder-quobyte-1a0400cd-c638-41aa-b360-f007f412dd26" released by "delete_volume" :: held 0.661s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:28:14 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-138fbf8d-af4d-4ef8-832b-d5e0a7356b54 tempest-ProjectReaderTests-1507094960 None] Created reservations ['a19b375c-acd5-4b95-8ff5-9203f9f4ffd9', '5a43ba9f-7136-4da2-811b-91ab75ed9369', 'a89ed4c8-1d16-46a5-85f5-56124ff7cb2f', '1aac8fc3-e762-49f7-a3d4-a6396839c80d'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:28:14 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-138fbf8d-af4d-4ef8-832b-d5e0a7356b54 tempest-ProjectReaderTests-1507094960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:28:14 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-138fbf8d-af4d-4ef8-832b-d5e0a7356b54 tempest-ProjectReaderTests-1507094960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:28:14 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-138fbf8d-af4d-4ef8-832b-d5e0a7356b54 tempest-ProjectReaderTests-1507094960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:28:14 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-138fbf8d-af4d-4ef8-832b-d5e0a7356b54 tempest-ProjectReaderTests-1507094960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:28:14 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-138fbf8d-af4d-4ef8-832b-d5e0a7356b54 tempest-ProjectReaderTests-1507094960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:28:14 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-138fbf8d-af4d-4ef8-832b-d5e0a7356b54 tempest-ProjectReaderTests-1507094960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:28:14 devstack sudo[101789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:28:14 devstack sudo[101789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:28:14 devstack sudo[101785]: pam_unix(sudo:session): session closed for user root Jul 22 03:28:14 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-935d36ec-36d5-4c9c-886b-d3352ce23611 tempest-VolumesCloneTest-1728908944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3cf00089-392c-450d-a08f-0930e906eb2a" returned: 0 in 0.245s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:28:14 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-935d36ec-36d5-4c9c-886b-d3352ce23611 tempest-VolumesCloneTest-1728908944 None] <== create_volume: return (701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:28:14 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-935d36ec-36d5-4c9c-886b-d3352ce23611 tempest-VolumesCloneTest-1728908944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.703s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:28:14 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-935d36ec-36d5-4c9c-886b-d3352ce23611 tempest-VolumesCloneTest-1728908944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff5b6c9a-1d0c-4ce8-912f-a78dd123fa8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3cf00089-392c-450d-a08f-0930e906eb2a', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:28:14 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-935d36ec-36d5-4c9c-886b-d3352ce23611 tempest-VolumesCloneTest-1728908944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44d746e6-c3c6-4f4c-8c9b-7088b73c1192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:28:14 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-935d36ec-36d5-4c9c-886b-d3352ce23611 tempest-VolumesCloneTest-1728908944 None] Volume volume-3cf00089-392c-450d-a08f-0930e906eb2a (3cf00089-392c-450d-a08f-0930e906eb2a): created successfully Jul 22 03:28:14 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-935d36ec-36d5-4c9c-886b-d3352ce23611 tempest-VolumesCloneTest-1728908944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44d746e6-c3c6-4f4c-8c9b-7088b73c1192) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:28:14 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-935d36ec-36d5-4c9c-886b-d3352ce23611 tempest-VolumesCloneTest-1728908944 None] Flow 'volume_create_manager' (f2eda931-a4fc-43df-8588-6ea3dce3dfb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:28:14 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-935d36ec-36d5-4c9c-886b-d3352ce23611 tempest-VolumesCloneTest-1728908944 None] Created volume successfully. Jul 22 03:28:14 devstack sudo[101789]: pam_unix(sudo:session): session closed for user root Jul 22 03:28:14 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-138fbf8d-af4d-4ef8-832b-d5e0a7356b54 tempest-ProjectReaderTests-1507094960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.248s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:28:14 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-138fbf8d-af4d-4ef8-832b-d5e0a7356b54 tempest-ProjectReaderTests-1507094960 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:28:14 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-138fbf8d-af4d-4ef8-832b-d5e0a7356b54 tempest-ProjectReaderTests-1507094960 None] Deleted volume successfully. Jul 22 03:28:14 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-138fbf8d-af4d-4ef8-832b-d5e0a7356b54 tempest-ProjectReaderTests-1507094960 None] Lock "cinder-1a0400cd-c638-41aa-b360-f007f412dd26-delete_volume" released by "delete_volume" :: held 1.119s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:28:15 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc237a18-0253-46f3-9305-fbda72b5f407 tempest-VolumesCloneTest-1728908944 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:28:15 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-bc237a18-0253-46f3-9305-fbda72b5f407 tempest-VolumesCloneTest-1728908944 None] Flow 'volume_create_manager' (7b9f480c-46c0-4aff-b99a-27c0ec5228e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:28:15 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-bc237a18-0253-46f3-9305-fbda72b5f407 tempest-VolumesCloneTest-1728908944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa0c67c4-9af4-4c89-9abe-368dc29d50c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:28:15 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-bc237a18-0253-46f3-9305-fbda72b5f407 tempest-VolumesCloneTest-1728908944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa0c67c4-9af4-4c89-9abe-368dc29d50c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:28:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-482327124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96245a43-c0da-4db2-9b2c-8d2af61ea6ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2a3638b80094308a3802597b1c84d9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:28:15Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=3cf00089-392c-450d-a08f-0930e906eb2a,status='creating',terminated_at=None,updated_at=2026-07-22T01:28:15Z,use_quota=True,user_id='d4abc902cdd3473abda8b4cadc076578',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:28:15 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-bc237a18-0253-46f3-9305-fbda72b5f407 tempest-VolumesCloneTest-1728908944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ac221b9-68f6-424f-a166-dc5658207b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:28:15 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-bc237a18-0253-46f3-9305-fbda72b5f407 tempest-VolumesCloneTest-1728908944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ac221b9-68f6-424f-a166-dc5658207b2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:28:15 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-bc237a18-0253-46f3-9305-fbda72b5f407 tempest-VolumesCloneTest-1728908944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c68fae16-66b0-4a67-b67f-4b0135c81d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:28:15 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-bc237a18-0253-46f3-9305-fbda72b5f407 tempest-VolumesCloneTest-1728908944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c68fae16-66b0-4a67-b67f-4b0135c81d57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '96245a43-c0da-4db2-9b2c-8d2af61ea6ae', 'volume_name': 'volume-96245a43-c0da-4db2-9b2c-8d2af61ea6ae', 'volume_size': 2, 'source_volid': '3cf00089-392c-450d-a08f-0930e906eb2a', 'source_volstatus': 'available'}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:28:15 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-bc237a18-0253-46f3-9305-fbda72b5f407 tempest-VolumesCloneTest-1728908944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dec3be19-d479-43cd-a214-56ead3ced442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:28:15 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-bc237a18-0253-46f3-9305-fbda72b5f407 tempest-VolumesCloneTest-1728908944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dec3be19-d479-43cd-a214-56ead3ced442) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:28:15 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-bc237a18-0253-46f3-9305-fbda72b5f407 tempest-VolumesCloneTest-1728908944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6758a079-54a3-4208-87fa-652469b68ff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:28:15 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-bc237a18-0253-46f3-9305-fbda72b5f407 tempest-VolumesCloneTest-1728908944 None] Volume 96245a43-c0da-4db2-9b2c-8d2af61ea6ae: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-96245a43-c0da-4db2-9b2c-8d2af61ea6ae', 'volume_size': 2, 'source_volid': '3cf00089-392c-450d-a08f-0930e906eb2a', 'source_volstatus': 'available'} Jul 22 03:28:15 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-bc237a18-0253-46f3-9305-fbda72b5f407 tempest-VolumesCloneTest-1728908944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:28:15 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-bc237a18-0253-46f3-9305-fbda72b5f407 tempest-VolumesCloneTest-1728908944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:28:15 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-bc237a18-0253-46f3-9305-fbda72b5f407 tempest-VolumesCloneTest-1728908944 None] Cloning volume 3cf00089-392c-450d-a08f-0930e906eb2a to volume 96245a43-c0da-4db2-9b2c-8d2af61ea6ae Jul 22 03:28:15 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-bc237a18-0253-46f3-9305-fbda72b5f407 tempest-VolumesCloneTest-1728908944 None] Creating offline snapshot ee74a470-4a8f-4037-9d3a-dca433ef52af of volume 3cf00089-392c-450d-a08f-0930e906eb2a {{(pid=87747) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 03:28:15 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c73dc1b-c7b9-4507-ba1b-2fb8a3d71c44]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:28:15 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-bc237a18-0253-46f3-9305-fbda72b5f407 tempest-VolumesCloneTest-1728908944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3cf00089-392c-450d-a08f-0930e906eb2a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:28:15 devstack sudo[101792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3cf00089-392c-450d-a08f-0930e906eb2a Jul 22 03:28:15 devstack sudo[101792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:28:15 devstack sudo[101792]: pam_unix(sudo:session): session closed for user root Jul 22 03:28:15 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-bc237a18-0253-46f3-9305-fbda72b5f407 tempest-VolumesCloneTest-1728908944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3cf00089-392c-450d-a08f-0930e906eb2a" returned: 0 in 0.373s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:28:15 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-bc237a18-0253-46f3-9305-fbda72b5f407 tempest-VolumesCloneTest-1728908944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3cf00089-392c-450d-a08f-0930e906eb2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3cf00089-392c-450d-a08f-0930e906eb2a.ee74a470-4a8f-4037-9d3a-dca433ef52af 1G {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:28:15 devstack sudo[101797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3cf00089-392c-450d-a08f-0930e906eb2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3cf00089-392c-450d-a08f-0930e906eb2a.ee74a470-4a8f-4037-9d3a-dca433ef52af 1G Jul 22 03:28:15 devstack sudo[101797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:28:16 devstack sudo[101797]: pam_unix(sudo:session): session closed for user root Jul 22 03:28:16 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-bc237a18-0253-46f3-9305-fbda72b5f407 tempest-VolumesCloneTest-1728908944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3cf00089-392c-450d-a08f-0930e906eb2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3cf00089-392c-450d-a08f-0930e906eb2a.ee74a470-4a8f-4037-9d3a-dca433ef52af 1G" returned: 0 in 0.443s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:28:16 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-bc237a18-0253-46f3-9305-fbda72b5f407 tempest-VolumesCloneTest-1728908944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3cf00089-392c-450d-a08f-0930e906eb2a -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3cf00089-392c-450d-a08f-0930e906eb2a.ee74a470-4a8f-4037-9d3a-dca433ef52af {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:28:16 devstack sudo[101803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3cf00089-392c-450d-a08f-0930e906eb2a -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3cf00089-392c-450d-a08f-0930e906eb2a.ee74a470-4a8f-4037-9d3a-dca433ef52af Jul 22 03:28:16 devstack sudo[101803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:28:16 devstack sudo[101803]: pam_unix(sudo:session): session closed for user root Jul 22 03:28:16 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-bc237a18-0253-46f3-9305-fbda72b5f407 tempest-VolumesCloneTest-1728908944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3cf00089-392c-450d-a08f-0930e906eb2a -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3cf00089-392c-450d-a08f-0930e906eb2a.ee74a470-4a8f-4037-9d3a-dca433ef52af" returned: 0 in 0.306s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:28:16 devstack cinder-volume[87747]: WARNING cinder.volume.drivers.remotefs [None req-bc237a18-0253-46f3-9305-fbda72b5f407 tempest-VolumesCloneTest-1728908944 None] /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3cf00089-392c-450d-a08f-0930e906eb2a.ee74a470-4a8f-4037-9d3a-dca433ef52af is being set with open permissions: ugo+rw Jul 22 03:28:16 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-bc237a18-0253-46f3-9305-fbda72b5f407 tempest-VolumesCloneTest-1728908944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3cf00089-392c-450d-a08f-0930e906eb2a.ee74a470-4a8f-4037-9d3a-dca433ef52af {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:28:16 devstack sudo[101808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3cf00089-392c-450d-a08f-0930e906eb2a.ee74a470-4a8f-4037-9d3a-dca433ef52af Jul 22 03:28:16 devstack sudo[101808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:28:16 devstack sudo[101808]: pam_unix(sudo:session): session closed for user root Jul 22 03:28:16 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-bc237a18-0253-46f3-9305-fbda72b5f407 tempest-VolumesCloneTest-1728908944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3cf00089-392c-450d-a08f-0930e906eb2a.ee74a470-4a8f-4037-9d3a-dca433ef52af" returned: 0 in 0.266s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:28:16 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-bc237a18-0253-46f3-9305-fbda72b5f407 tempest-VolumesCloneTest-1728908944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3cf00089-392c-450d-a08f-0930e906eb2a.info {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:28:16 devstack sudo[101811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3cf00089-392c-450d-a08f-0930e906eb2a.info Jul 22 03:28:16 devstack sudo[101811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:28:16 devstack sudo[101811]: pam_unix(sudo:session): session closed for user root Jul 22 03:28:16 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-bc237a18-0253-46f3-9305-fbda72b5f407 tempest-VolumesCloneTest-1728908944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3cf00089-392c-450d-a08f-0930e906eb2a.info" returned: 0 in 0.244s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:28:16 devstack cinder-volume[87747]: WARNING cinder.volume.drivers.remotefs [None req-bc237a18-0253-46f3-9305-fbda72b5f407 tempest-VolumesCloneTest-1728908944 None] /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3cf00089-392c-450d-a08f-0930e906eb2a.info is being set with open permissions: ugo+rw Jul 22 03:28:16 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-bc237a18-0253-46f3-9305-fbda72b5f407 tempest-VolumesCloneTest-1728908944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3cf00089-392c-450d-a08f-0930e906eb2a.info {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:28:16 devstack sudo[101814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3cf00089-392c-450d-a08f-0930e906eb2a.info Jul 22 03:28:16 devstack sudo[101814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:28:17 devstack sudo[101814]: pam_unix(sudo:session): session closed for user root Jul 22 03:28:17 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-bc237a18-0253-46f3-9305-fbda72b5f407 tempest-VolumesCloneTest-1728908944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3cf00089-392c-450d-a08f-0930e906eb2a.info" returned: 0 in 0.239s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:28:17 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-bc237a18-0253-46f3-9305-fbda72b5f407 tempest-VolumesCloneTest-1728908944 None] Acquiring lock "cinder-quobyte-96245a43-c0da-4db2-9b2c-8d2af61ea6ae" by "_copy_volume_from_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:28:17 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-bc237a18-0253-46f3-9305-fbda72b5f407 tempest-VolumesCloneTest-1728908944 None] Lock "cinder-quobyte-96245a43-c0da-4db2-9b2c-8d2af61ea6ae" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:28:17 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-bc237a18-0253-46f3-9305-fbda72b5f407 tempest-VolumesCloneTest-1728908944 None] snapshot: ee74a470-4a8f-4037-9d3a-dca433ef52af, volume: 96245a43-c0da-4db2-9b2c-8d2af61ea6ae, {{(pid=87747) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 22 03:28:17 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-bc237a18-0253-46f3-9305-fbda72b5f407 tempest-VolumesCloneTest-1728908944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:28:17 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-bc237a18-0253-46f3-9305-fbda72b5f407 tempest-VolumesCloneTest-1728908944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:28:17 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-bc237a18-0253-46f3-9305-fbda72b5f407 tempest-VolumesCloneTest-1728908944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:28:17 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-bc237a18-0253-46f3-9305-fbda72b5f407 tempest-VolumesCloneTest-1728908944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:28:17 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-bc237a18-0253-46f3-9305-fbda72b5f407 tempest-VolumesCloneTest-1728908944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:28:17 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[879b1507-cd3d-4f8b-9851-bf57bc7066bb]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:28:17 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-bc237a18-0253-46f3-9305-fbda72b5f407 tempest-VolumesCloneTest-1728908944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3cf00089-392c-450d-a08f-0930e906eb2a.ee74a470-4a8f-4037-9d3a-dca433ef52af {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:28:17 devstack sudo[101817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3cf00089-392c-450d-a08f-0930e906eb2a.ee74a470-4a8f-4037-9d3a-dca433ef52af Jul 22 03:28:17 devstack sudo[101817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:28:17 devstack sudo[101817]: pam_unix(sudo:session): session closed for user root Jul 22 03:28:17 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-bc237a18-0253-46f3-9305-fbda72b5f407 tempest-VolumesCloneTest-1728908944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3cf00089-392c-450d-a08f-0930e906eb2a.ee74a470-4a8f-4037-9d3a-dca433ef52af" returned: 0 in 0.345s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:28:17 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-bc237a18-0253-46f3-9305-fbda72b5f407 tempest-VolumesCloneTest-1728908944 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3cf00089-392c-450d-a08f-0930e906eb2a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87747) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 03:28:17 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-bc237a18-0253-46f3-9305-fbda72b5f407 tempest-VolumesCloneTest-1728908944 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3cf00089-392c-450d-a08f-0930e906eb2a {{(pid=87747) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 22 03:28:17 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-bc237a18-0253-46f3-9305-fbda72b5f407 tempest-VolumesCloneTest-1728908944 None] Creating direct copy from snapshot {{(pid=87747) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 22 03:28:17 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f8e735f-f494-449a-9f16-cf1252769bfe]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:28:17 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-bc237a18-0253-46f3-9305-fbda72b5f407 tempest-VolumesCloneTest-1728908944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3cf00089-392c-450d-a08f-0930e906eb2a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:28:17 devstack sudo[101822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3cf00089-392c-450d-a08f-0930e906eb2a Jul 22 03:28:17 devstack sudo[101822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:28:17 devstack sudo[101822]: pam_unix(sudo:session): session closed for user root Jul 22 03:28:17 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-bc237a18-0253-46f3-9305-fbda72b5f407 tempest-VolumesCloneTest-1728908944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3cf00089-392c-450d-a08f-0930e906eb2a" returned: 0 in 0.347s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:28:17 devstack cinder-volume[87747]: DEBUG cinder.utils [None req-bc237a18-0253-46f3-9305-fbda72b5f407 tempest-VolumesCloneTest-1728908944 None] Path /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-96245a43-c0da-4db2-9b2c-8d2af61ea6ae not found in is_blk_device check {{(pid=87747) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 22 03:28:17 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-bc237a18-0253-46f3-9305-fbda72b5f407 tempest-VolumesCloneTest-1728908944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3cf00089-392c-450d-a08f-0930e906eb2a /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-96245a43-c0da-4db2-9b2c-8d2af61ea6ae {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:28:17 devstack sudo[101827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3cf00089-392c-450d-a08f-0930e906eb2a /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-96245a43-c0da-4db2-9b2c-8d2af61ea6ae Jul 22 03:28:17 devstack sudo[101827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:28:21 devstack sudo[101827]: pam_unix(sudo:session): session closed for user root Jul 22 03:28:21 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-bc237a18-0253-46f3-9305-fbda72b5f407 tempest-VolumesCloneTest-1728908944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3cf00089-392c-450d-a08f-0930e906eb2a /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-96245a43-c0da-4db2-9b2c-8d2af61ea6ae" returned: 0 in 3.958s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:28:21 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ef37252-45a6-484c-ac05-b67e204010c8]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:28:21 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-bc237a18-0253-46f3-9305-fbda72b5f407 tempest-VolumesCloneTest-1728908944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3cf00089-392c-450d-a08f-0930e906eb2a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:28:21 devstack sudo[101841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3cf00089-392c-450d-a08f-0930e906eb2a Jul 22 03:28:21 devstack sudo[101841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:28:22 devstack sudo[101841]: pam_unix(sudo:session): session closed for user root Jul 22 03:28:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-bc237a18-0253-46f3-9305-fbda72b5f407 tempest-VolumesCloneTest-1728908944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3cf00089-392c-450d-a08f-0930e906eb2a" returned: 0 in 0.521s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:28:22 devstack cinder-volume[87747]: DEBUG cinder.image.image_utils [None req-bc237a18-0253-46f3-9305-fbda72b5f407 tempest-VolumesCloneTest-1728908944 None] Image conversion details: src /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3cf00089-392c-450d-a08f-0930e906eb2a, size 1024.00 MB, duration 3.96 sec, destination /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-96245a43-c0da-4db2-9b2c-8d2af61ea6ae {{(pid=87747) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 22 03:28:22 devstack cinder-volume[87747]: INFO cinder.image.image_utils [None req-bc237a18-0253-46f3-9305-fbda72b5f407 tempest-VolumesCloneTest-1728908944 None] Converted 1024.00 MB image at 258.65 MB/s Jul 22 03:28:22 devstack cinder-volume[87747]: WARNING cinder.volume.drivers.remotefs [None req-bc237a18-0253-46f3-9305-fbda72b5f407 tempest-VolumesCloneTest-1728908944 None] /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-96245a43-c0da-4db2-9b2c-8d2af61ea6ae is being set with open permissions: ugo+rw Jul 22 03:28:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-bc237a18-0253-46f3-9305-fbda72b5f407 tempest-VolumesCloneTest-1728908944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-96245a43-c0da-4db2-9b2c-8d2af61ea6ae {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:28:22 devstack sudo[101846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-96245a43-c0da-4db2-9b2c-8d2af61ea6ae Jul 22 03:28:22 devstack sudo[101846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:28:22 devstack cinder-volume[87747]: DEBUG oslo_service.periodic_task [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87747) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 03:28:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:28:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:28:22 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:28:22 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:28:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:28:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:28:22 devstack sudo[101848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:28:22 devstack sudo[101848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:28:22 devstack sudo[101846]: pam_unix(sudo:session): session closed for user root Jul 22 03:28:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-bc237a18-0253-46f3-9305-fbda72b5f407 tempest-VolumesCloneTest-1728908944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-96245a43-c0da-4db2-9b2c-8d2af61ea6ae" returned: 0 in 0.245s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:28:22 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-bc237a18-0253-46f3-9305-fbda72b5f407 tempest-VolumesCloneTest-1728908944 None] Lock "cinder-quobyte-96245a43-c0da-4db2-9b2c-8d2af61ea6ae" released by "_copy_volume_from_snapshot" :: held 5.487s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:28:22 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-bc237a18-0253-46f3-9305-fbda72b5f407 tempest-VolumesCloneTest-1728908944 None] Acquiring lock "cinder-quobyte-ee74a470-4a8f-4037-9d3a-dca433ef52af" by "_delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:28:22 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-bc237a18-0253-46f3-9305-fbda72b5f407 tempest-VolumesCloneTest-1728908944 None] Lock "cinder-quobyte-ee74a470-4a8f-4037-9d3a-dca433ef52af" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:28:22 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-bc237a18-0253-46f3-9305-fbda72b5f407 tempest-VolumesCloneTest-1728908944 None] Deleting offline snapshot ee74a470-4a8f-4037-9d3a-dca433ef52af of volume 3cf00089-392c-450d-a08f-0930e906eb2a {{(pid=87747) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 03:28:22 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-bc237a18-0253-46f3-9305-fbda72b5f407 tempest-VolumesCloneTest-1728908944 None] snapshot_file for this snap is: volume-3cf00089-392c-450d-a08f-0930e906eb2a.ee74a470-4a8f-4037-9d3a-dca433ef52af {{(pid=87747) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 03:28:22 devstack sudo[101848]: pam_unix(sudo:session): session closed for user root Jul 22 03:28:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.239s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:28:22 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:28:22 devstack cinder-volume[87747]: DEBUG oslo_service.periodic_task [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Running periodic task VolumeManager._thread_info {{(pid=87747) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 03:28:22 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] thread count: 28 {{(pid=87747) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 22 03:28:22 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] thread info: [<_MainThread(MainThread, started 132775275860096)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87747) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 22 03:28:22 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[af5f1352-2a82-4983-aacb-ebbf56257f2a]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:28:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-bc237a18-0253-46f3-9305-fbda72b5f407 tempest-VolumesCloneTest-1728908944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3cf00089-392c-450d-a08f-0930e906eb2a.ee74a470-4a8f-4037-9d3a-dca433ef52af {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:28:22 devstack sudo[101852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3cf00089-392c-450d-a08f-0930e906eb2a.ee74a470-4a8f-4037-9d3a-dca433ef52af Jul 22 03:28:22 devstack sudo[101852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:28:23 devstack sudo[101852]: pam_unix(sudo:session): session closed for user root Jul 22 03:28:23 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-bc237a18-0253-46f3-9305-fbda72b5f407 tempest-VolumesCloneTest-1728908944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3cf00089-392c-450d-a08f-0930e906eb2a.ee74a470-4a8f-4037-9d3a-dca433ef52af" returned: 0 in 0.345s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:28:23 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-bc237a18-0253-46f3-9305-fbda72b5f407 tempest-VolumesCloneTest-1728908944 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3cf00089-392c-450d-a08f-0930e906eb2a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87747) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 03:28:23 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b7a5593-742a-41e9-b6b0-0f994507371d]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:28:23 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-bc237a18-0253-46f3-9305-fbda72b5f407 tempest-VolumesCloneTest-1728908944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3cf00089-392c-450d-a08f-0930e906eb2a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:28:23 devstack sudo[101857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3cf00089-392c-450d-a08f-0930e906eb2a Jul 22 03:28:23 devstack sudo[101857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:28:23 devstack sudo[101857]: pam_unix(sudo:session): session closed for user root Jul 22 03:28:23 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-bc237a18-0253-46f3-9305-fbda72b5f407 tempest-VolumesCloneTest-1728908944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3cf00089-392c-450d-a08f-0930e906eb2a" returned: 0 in 0.343s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:28:23 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-bc237a18-0253-46f3-9305-fbda72b5f407 tempest-VolumesCloneTest-1728908944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3cf00089-392c-450d-a08f-0930e906eb2a.ee74a470-4a8f-4037-9d3a-dca433ef52af {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:28:23 devstack sudo[101864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3cf00089-392c-450d-a08f-0930e906eb2a.ee74a470-4a8f-4037-9d3a-dca433ef52af Jul 22 03:28:23 devstack sudo[101864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:28:23 devstack sudo[101864]: pam_unix(sudo:session): session closed for user root Jul 22 03:28:23 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-bc237a18-0253-46f3-9305-fbda72b5f407 tempest-VolumesCloneTest-1728908944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3cf00089-392c-450d-a08f-0930e906eb2a.ee74a470-4a8f-4037-9d3a-dca433ef52af" returned: 0 in 0.339s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:28:23 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-bc237a18-0253-46f3-9305-fbda72b5f407 tempest-VolumesCloneTest-1728908944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3cf00089-392c-450d-a08f-0930e906eb2a.ee74a470-4a8f-4037-9d3a-dca433ef52af {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:28:23 devstack sudo[101869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3cf00089-392c-450d-a08f-0930e906eb2a.ee74a470-4a8f-4037-9d3a-dca433ef52af Jul 22 03:28:23 devstack sudo[101869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:28:23 devstack sudo[101869]: pam_unix(sudo:session): session closed for user root Jul 22 03:28:23 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-bc237a18-0253-46f3-9305-fbda72b5f407 tempest-VolumesCloneTest-1728908944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3cf00089-392c-450d-a08f-0930e906eb2a.ee74a470-4a8f-4037-9d3a-dca433ef52af" returned: 0 in 0.245s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:28:24 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-bc237a18-0253-46f3-9305-fbda72b5f407 tempest-VolumesCloneTest-1728908944 None] Lock "cinder-quobyte-ee74a470-4a8f-4037-9d3a-dca433ef52af" released by "_delete_snapshot" :: held 1.354s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:28:24 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-bc237a18-0253-46f3-9305-fbda72b5f407 tempest-VolumesCloneTest-1728908944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.904s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:28:24 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-bc237a18-0253-46f3-9305-fbda72b5f407 tempest-VolumesCloneTest-1728908944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6758a079-54a3-4208-87fa-652469b68ff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96245a43-c0da-4db2-9b2c-8d2af61ea6ae', 'volume_size': 2, 'source_volid': '3cf00089-392c-450d-a08f-0930e906eb2a', 'source_volstatus': 'available'}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:28:24 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-bc237a18-0253-46f3-9305-fbda72b5f407 tempest-VolumesCloneTest-1728908944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb6b9341-c1be-44e2-8f0d-87d6c024c4b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:28:24 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-bc237a18-0253-46f3-9305-fbda72b5f407 tempest-VolumesCloneTest-1728908944 None] Volume volume-96245a43-c0da-4db2-9b2c-8d2af61ea6ae (96245a43-c0da-4db2-9b2c-8d2af61ea6ae): created successfully Jul 22 03:28:24 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-bc237a18-0253-46f3-9305-fbda72b5f407 tempest-VolumesCloneTest-1728908944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb6b9341-c1be-44e2-8f0d-87d6c024c4b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:28:24 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-bc237a18-0253-46f3-9305-fbda72b5f407 tempest-VolumesCloneTest-1728908944 None] Flow 'volume_create_manager' (7b9f480c-46c0-4aff-b99a-27c0ec5228e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:28:24 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-bc237a18-0253-46f3-9305-fbda72b5f407 tempest-VolumesCloneTest-1728908944 None] Created volume successfully. Jul 22 03:28:24 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-3bfa3139-9813-4b9c-950e-c15ad95d7ca3 tempest-VolumesCloneTest-1728908944 None] Acquiring lock "cinder-96245a43-c0da-4db2-9b2c-8d2af61ea6ae-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:28:24 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-3bfa3139-9813-4b9c-950e-c15ad95d7ca3 tempest-VolumesCloneTest-1728908944 None] Lock "cinder-96245a43-c0da-4db2-9b2c-8d2af61ea6ae-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:28:24 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-3bfa3139-9813-4b9c-950e-c15ad95d7ca3 tempest-VolumesCloneTest-1728908944 None] Acquiring lock "cinder-quobyte-96245a43-c0da-4db2-9b2c-8d2af61ea6ae" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:28:24 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-3bfa3139-9813-4b9c-950e-c15ad95d7ca3 tempest-VolumesCloneTest-1728908944 None] Lock "cinder-quobyte-96245a43-c0da-4db2-9b2c-8d2af61ea6ae" acquired by "delete_volume" :: waited 0.013s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:28:24 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[33df2b83-2374-4e52-965c-cfb20a69cece]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:28:24 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-3bfa3139-9813-4b9c-950e-c15ad95d7ca3 tempest-VolumesCloneTest-1728908944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-96245a43-c0da-4db2-9b2c-8d2af61ea6ae {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:28:25 devstack sudo[101872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-96245a43-c0da-4db2-9b2c-8d2af61ea6ae Jul 22 03:28:25 devstack sudo[101872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:28:25 devstack sudo[101872]: pam_unix(sudo:session): session closed for user root Jul 22 03:28:25 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-3bfa3139-9813-4b9c-950e-c15ad95d7ca3 tempest-VolumesCloneTest-1728908944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-96245a43-c0da-4db2-9b2c-8d2af61ea6ae" returned: 0 in 0.340s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:28:25 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-3bfa3139-9813-4b9c-950e-c15ad95d7ca3 tempest-VolumesCloneTest-1728908944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-96245a43-c0da-4db2-9b2c-8d2af61ea6ae {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:28:25 devstack sudo[101877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-96245a43-c0da-4db2-9b2c-8d2af61ea6ae Jul 22 03:28:25 devstack sudo[101877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:28:25 devstack sudo[101877]: pam_unix(sudo:session): session closed for user root Jul 22 03:28:25 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-3bfa3139-9813-4b9c-950e-c15ad95d7ca3 tempest-VolumesCloneTest-1728908944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-96245a43-c0da-4db2-9b2c-8d2af61ea6ae" returned: 0 in 0.242s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:28:25 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-3bfa3139-9813-4b9c-950e-c15ad95d7ca3 tempest-VolumesCloneTest-1728908944 None] Lock "cinder-quobyte-96245a43-c0da-4db2-9b2c-8d2af61ea6ae" released by "delete_volume" :: held 0.618s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:28:25 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-3bfa3139-9813-4b9c-950e-c15ad95d7ca3 tempest-VolumesCloneTest-1728908944 None] Created reservations ['4d7d2ff8-f0f1-491f-95e9-d9b5942719a5', '3eda027f-1b84-4215-bd6e-d147fbe7f3ae', 'e423f353-775a-4b8b-8bd9-99b07b5bd381', 'fbeb6062-64b2-4bfa-a6e7-35d662deb961'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:28:25 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-3bfa3139-9813-4b9c-950e-c15ad95d7ca3 tempest-VolumesCloneTest-1728908944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:28:25 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-3bfa3139-9813-4b9c-950e-c15ad95d7ca3 tempest-VolumesCloneTest-1728908944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:28:25 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-3bfa3139-9813-4b9c-950e-c15ad95d7ca3 tempest-VolumesCloneTest-1728908944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:28:25 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-3bfa3139-9813-4b9c-950e-c15ad95d7ca3 tempest-VolumesCloneTest-1728908944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:28:25 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-3bfa3139-9813-4b9c-950e-c15ad95d7ca3 tempest-VolumesCloneTest-1728908944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:28:25 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-3bfa3139-9813-4b9c-950e-c15ad95d7ca3 tempest-VolumesCloneTest-1728908944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:28:25 devstack sudo[101880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:28:25 devstack sudo[101880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:28:25 devstack sudo[101880]: pam_unix(sudo:session): session closed for user root Jul 22 03:28:25 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-3bfa3139-9813-4b9c-950e-c15ad95d7ca3 tempest-VolumesCloneTest-1728908944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.236s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:28:25 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-3bfa3139-9813-4b9c-950e-c15ad95d7ca3 tempest-VolumesCloneTest-1728908944 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:28:25 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-3bfa3139-9813-4b9c-950e-c15ad95d7ca3 tempest-VolumesCloneTest-1728908944 None] Deleted volume successfully. Jul 22 03:28:25 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-3bfa3139-9813-4b9c-950e-c15ad95d7ca3 tempest-VolumesCloneTest-1728908944 None] Lock "cinder-96245a43-c0da-4db2-9b2c-8d2af61ea6ae-delete_volume" released by "delete_volume" :: held 1.031s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:28:26 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-4ec4b878-521d-4e0b-9673-f916899e8224 tempest-VolumesCloneTest-1728908944 None] Acquiring lock "cinder-3cf00089-392c-450d-a08f-0930e906eb2a-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:28:26 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-4ec4b878-521d-4e0b-9673-f916899e8224 tempest-VolumesCloneTest-1728908944 None] Lock "cinder-3cf00089-392c-450d-a08f-0930e906eb2a-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:28:26 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-4ec4b878-521d-4e0b-9673-f916899e8224 tempest-VolumesCloneTest-1728908944 None] Acquiring lock "cinder-quobyte-3cf00089-392c-450d-a08f-0930e906eb2a" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:28:26 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-4ec4b878-521d-4e0b-9673-f916899e8224 tempest-VolumesCloneTest-1728908944 None] Lock "cinder-quobyte-3cf00089-392c-450d-a08f-0930e906eb2a" acquired by "delete_volume" :: waited 0.016s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:28:26 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a516aa9-97d9-4b89-8526-26aebd7d4fe8]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:28:26 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-4ec4b878-521d-4e0b-9673-f916899e8224 tempest-VolumesCloneTest-1728908944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3cf00089-392c-450d-a08f-0930e906eb2a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:28:26 devstack sudo[101883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3cf00089-392c-450d-a08f-0930e906eb2a Jul 22 03:28:26 devstack sudo[101883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:28:26 devstack sudo[101883]: pam_unix(sudo:session): session closed for user root Jul 22 03:28:26 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-4ec4b878-521d-4e0b-9673-f916899e8224 tempest-VolumesCloneTest-1728908944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3cf00089-392c-450d-a08f-0930e906eb2a" returned: 0 in 0.349s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:28:26 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-4ec4b878-521d-4e0b-9673-f916899e8224 tempest-VolumesCloneTest-1728908944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3cf00089-392c-450d-a08f-0930e906eb2a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:28:26 devstack sudo[101888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3cf00089-392c-450d-a08f-0930e906eb2a Jul 22 03:28:26 devstack sudo[101888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:28:26 devstack sudo[101888]: pam_unix(sudo:session): session closed for user root Jul 22 03:28:26 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-4ec4b878-521d-4e0b-9673-f916899e8224 tempest-VolumesCloneTest-1728908944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3cf00089-392c-450d-a08f-0930e906eb2a" returned: 0 in 0.246s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:28:26 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-4ec4b878-521d-4e0b-9673-f916899e8224 tempest-VolumesCloneTest-1728908944 None] Lock "cinder-quobyte-3cf00089-392c-450d-a08f-0930e906eb2a" released by "delete_volume" :: held 0.648s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:28:26 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-4ec4b878-521d-4e0b-9673-f916899e8224 tempest-VolumesCloneTest-1728908944 None] Created reservations ['dc5fb918-1276-4ea3-a8dc-19b83f26be69', '064107ce-d12a-452e-9c60-0cccbdc1e742', 'b1b6aa05-6987-4287-a8e7-4149265f58d1', '294e0ed1-5574-4ee4-82c3-828f0a315688'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:28:26 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-4ec4b878-521d-4e0b-9673-f916899e8224 tempest-VolumesCloneTest-1728908944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:28:26 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-4ec4b878-521d-4e0b-9673-f916899e8224 tempest-VolumesCloneTest-1728908944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:28:26 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-4ec4b878-521d-4e0b-9673-f916899e8224 tempest-VolumesCloneTest-1728908944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:28:26 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-4ec4b878-521d-4e0b-9673-f916899e8224 tempest-VolumesCloneTest-1728908944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:28:26 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-4ec4b878-521d-4e0b-9673-f916899e8224 tempest-VolumesCloneTest-1728908944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:28:26 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-4ec4b878-521d-4e0b-9673-f916899e8224 tempest-VolumesCloneTest-1728908944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:28:26 devstack sudo[101891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:28:26 devstack sudo[101891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:28:27 devstack sudo[101891]: pam_unix(sudo:session): session closed for user root Jul 22 03:28:27 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-4ec4b878-521d-4e0b-9673-f916899e8224 tempest-VolumesCloneTest-1728908944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.243s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:28:27 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-4ec4b878-521d-4e0b-9673-f916899e8224 tempest-VolumesCloneTest-1728908944 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:28:27 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-4ec4b878-521d-4e0b-9673-f916899e8224 tempest-VolumesCloneTest-1728908944 None] Deleted volume successfully. Jul 22 03:28:27 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-4ec4b878-521d-4e0b-9673-f916899e8224 tempest-VolumesCloneTest-1728908944 None] Lock "cinder-3cf00089-392c-450d-a08f-0930e906eb2a-delete_volume" released by "delete_volume" :: held 1.089s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:28:30 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-41b31818-1c09-4e4b-8f2b-915372a6e6be tempest-VolumesExtendTest-20761872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:28:30 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-41b31818-1c09-4e4b-8f2b-915372a6e6be tempest-VolumesExtendTest-20761872 None] Flow 'volume_create_manager' (20968787-dbeb-4e93-9c37-01e538b28a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:28:30 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-41b31818-1c09-4e4b-8f2b-915372a6e6be tempest-VolumesExtendTest-20761872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d216a2a7-0513-48ba-ac1f-52e86ea3f667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:28:30 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-41b31818-1c09-4e4b-8f2b-915372a6e6be tempest-VolumesExtendTest-20761872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d216a2a7-0513-48ba-ac1f-52e86ea3f667) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:28:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1025788546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ea2858c-4a5a-432c-b820-d08b0b8b85d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c9ea3d0860444b6972e161d7951944d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:28:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:28:30Z,use_quota=True,user_id='6f9000e496b249cea4fc64d7d94b3fe6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:28:30 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-41b31818-1c09-4e4b-8f2b-915372a6e6be tempest-VolumesExtendTest-20761872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b45d41be-4b43-4368-8639-e44ea50e3080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:28:30 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-41b31818-1c09-4e4b-8f2b-915372a6e6be tempest-VolumesExtendTest-20761872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b45d41be-4b43-4368-8639-e44ea50e3080) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:28:30 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-41b31818-1c09-4e4b-8f2b-915372a6e6be tempest-VolumesExtendTest-20761872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cbdb537-5ba6-4f50-9200-4f0ef044e95d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:28:30 devstack cinder-volume[87747]: DEBUG cinder.image.glance [None req-41b31818-1c09-4e4b-8f2b-915372a6e6be tempest-VolumesExtendTest-20761872 None] Creating Keystone auth plugin from conf {{(pid=87747) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 22 03:28:30 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-41b31818-1c09-4e4b-8f2b-915372a6e6be tempest-VolumesExtendTest-20761872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cbdb537-5ba6-4f50-9200-4f0ef044e95d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2ea2858c-4a5a-432c-b820-d08b0b8b85d8', 'volume_name': 'volume-2ea2858c-4a5a-432c-b820-d08b0b8b85d8', 'volume_size': 1, 'image_id': 'a3efde48-babd-4b04-b205-71cd843dec16', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a3efde48-babd-4b04-b205-71cd843dec16', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '37328413017b49c4b4fe75bae83dd2ac', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a3efde48-babd-4b04-b205-71cd843dec16', 'created_at': datetime.datetime(2026, 7, 22, 1, 8, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 22, 1, 8, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a3efde48-babd-4b04-b205-71cd843dec16/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:28:30 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-41b31818-1c09-4e4b-8f2b-915372a6e6be tempest-VolumesExtendTest-20761872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcbdd904-2ac3-4d96-af46-8af2f00cdde2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:28:30 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-41b31818-1c09-4e4b-8f2b-915372a6e6be tempest-VolumesExtendTest-20761872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcbdd904-2ac3-4d96-af46-8af2f00cdde2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:28:30 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-41b31818-1c09-4e4b-8f2b-915372a6e6be tempest-VolumesExtendTest-20761872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e85b6f2a-2b5b-41b5-955b-dcdde3e8b08a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:28:30 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-41b31818-1c09-4e4b-8f2b-915372a6e6be tempest-VolumesExtendTest-20761872 None] Volume 2ea2858c-4a5a-432c-b820-d08b0b8b85d8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2ea2858c-4a5a-432c-b820-d08b0b8b85d8', 'volume_size': 1, 'image_id': 'a3efde48-babd-4b04-b205-71cd843dec16', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a3efde48-babd-4b04-b205-71cd843dec16', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '37328413017b49c4b4fe75bae83dd2ac', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a3efde48-babd-4b04-b205-71cd843dec16', 'created_at': datetime.datetime(2026, 7, 22, 1, 8, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 22, 1, 8, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a3efde48-babd-4b04-b205-71cd843dec16/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 22 03:28:30 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-41b31818-1c09-4e4b-8f2b-915372a6e6be tempest-VolumesExtendTest-20761872 None] Trying to clone 2ea2858c-4a5a-432c-b820-d08b0b8b85d8 from image a3efde48-babd-4b04-b205-71cd843dec16 at location (None, [{'url': 'file:///opt/stack/data/glance/images/a3efde48-babd-4b04-b205-71cd843dec16', 'metadata': {}}]). {{(pid=87747) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 22 03:28:30 devstack cinder-volume[87747]: DEBUG cinder.image.image_utils [None req-41b31818-1c09-4e4b-8f2b-915372a6e6be tempest-VolumesExtendTest-20761872 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a3efde48-babd-4b04-b205-71cd843dec16_vizt6anqdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87747) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 22 03:28:30 devstack cinder-volume[87747]: INFO cinder.image.image_utils [None req-41b31818-1c09-4e4b-8f2b-915372a6e6be tempest-VolumesExtendTest-20761872 None] Image download 20.69 MB at 20.69 MB/s Jul 22 03:28:30 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[02ca354d-8024-4034-8930-149764883f93]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:28:30 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-41b31818-1c09-4e4b-8f2b-915372a6e6be tempest-VolumesExtendTest-20761872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a3efde48-babd-4b04-b205-71cd843dec16_vizt6anqdevstack@QuobyteHD {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:28:30 devstack sudo[101895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a3efde48-babd-4b04-b205-71cd843dec16_vizt6anqdevstack@QuobyteHD Jul 22 03:28:30 devstack sudo[101895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:28:31 devstack sudo[101895]: pam_unix(sudo:session): session closed for user root Jul 22 03:28:31 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-41b31818-1c09-4e4b-8f2b-915372a6e6be tempest-VolumesExtendTest-20761872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a3efde48-babd-4b04-b205-71cd843dec16_vizt6anqdevstack@QuobyteHD" returned: 0 in 0.326s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:28:31 devstack cinder-volume[87747]: DEBUG cinder.image.image_utils [None req-41b31818-1c09-4e4b-8f2b-915372a6e6be tempest-VolumesExtendTest-20761872 None] Temporary image a3efde48-babd-4b04-b205-71cd843dec16 is fetched for user 6f9000e496b249cea4fc64d7d94b3fe6. {{(pid=87747) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 22 03:28:31 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1fa9a03-5cc2-4b8f-bad0-4b75ad08b0c7]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:28:31 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-41b31818-1c09-4e4b-8f2b-915372a6e6be tempest-VolumesExtendTest-20761872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a3efde48-babd-4b04-b205-71cd843dec16_vizt6anqdevstack@QuobyteHD {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:28:31 devstack sudo[101900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a3efde48-babd-4b04-b205-71cd843dec16_vizt6anqdevstack@QuobyteHD Jul 22 03:28:31 devstack sudo[101900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:28:31 devstack sudo[101900]: pam_unix(sudo:session): session closed for user root Jul 22 03:28:31 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-41b31818-1c09-4e4b-8f2b-915372a6e6be tempest-VolumesExtendTest-20761872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a3efde48-babd-4b04-b205-71cd843dec16_vizt6anqdevstack@QuobyteHD" returned: 0 in 0.315s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:28:31 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-41b31818-1c09-4e4b-8f2b-915372a6e6be tempest-VolumesExtendTest-20761872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:28:31 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-41b31818-1c09-4e4b-8f2b-915372a6e6be tempest-VolumesExtendTest-20761872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:28:31 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-41b31818-1c09-4e4b-8f2b-915372a6e6be tempest-VolumesExtendTest-20761872 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:28:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1025788546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ea2858c-4a5a-432c-b820-d08b0b8b85d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c9ea3d0860444b6972e161d7951944d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:28:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:28:30Z,use_quota=True,user_id='6f9000e496b249cea4fc64d7d94b3fe6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:28:31 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-41b31818-1c09-4e4b-8f2b-915372a6e6be tempest-VolumesExtendTest-20761872 None] Creating volume 2ea2858c-4a5a-432c-b820-d08b0b8b85d8 {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:28:31 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-41b31818-1c09-4e4b-8f2b-915372a6e6be tempest-VolumesExtendTest-20761872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:28:31 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-41b31818-1c09-4e4b-8f2b-915372a6e6be tempest-VolumesExtendTest-20761872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:28:31 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-41b31818-1c09-4e4b-8f2b-915372a6e6be tempest-VolumesExtendTest-20761872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:28:31 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-41b31818-1c09-4e4b-8f2b-915372a6e6be tempest-VolumesExtendTest-20761872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:28:31 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-41b31818-1c09-4e4b-8f2b-915372a6e6be tempest-VolumesExtendTest-20761872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:28:31 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-41b31818-1c09-4e4b-8f2b-915372a6e6be tempest-VolumesExtendTest-20761872 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:28:31 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-41b31818-1c09-4e4b-8f2b-915372a6e6be tempest-VolumesExtendTest-20761872 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:28:31 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-41b31818-1c09-4e4b-8f2b-915372a6e6be tempest-VolumesExtendTest-20761872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2ea2858c-4a5a-432c-b820-d08b0b8b85d8 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:28:31 devstack sudo[101905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2ea2858c-4a5a-432c-b820-d08b0b8b85d8 1073741824 Jul 22 03:28:31 devstack sudo[101905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:28:31 devstack sudo[101905]: pam_unix(sudo:session): session closed for user root Jul 22 03:28:31 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-41b31818-1c09-4e4b-8f2b-915372a6e6be tempest-VolumesExtendTest-20761872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2ea2858c-4a5a-432c-b820-d08b0b8b85d8 1073741824" returned: 0 in 0.396s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:28:31 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-41b31818-1c09-4e4b-8f2b-915372a6e6be tempest-VolumesExtendTest-20761872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2ea2858c-4a5a-432c-b820-d08b0b8b85d8 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:28:31 devstack sudo[101911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2ea2858c-4a5a-432c-b820-d08b0b8b85d8 Jul 22 03:28:31 devstack sudo[101911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:28:32 devstack sudo[101911]: pam_unix(sudo:session): session closed for user root Jul 22 03:28:32 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-41b31818-1c09-4e4b-8f2b-915372a6e6be tempest-VolumesExtendTest-20761872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2ea2858c-4a5a-432c-b820-d08b0b8b85d8" returned: 0 in 0.241s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:28:32 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-41b31818-1c09-4e4b-8f2b-915372a6e6be tempest-VolumesExtendTest-20761872 None] <== create_volume: return (677ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:28:32 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-41b31818-1c09-4e4b-8f2b-915372a6e6be tempest-VolumesExtendTest-20761872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.679s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:28:32 devstack cinder-volume[87747]: DEBUG cinder.volume.volume_utils [None req-41b31818-1c09-4e4b-8f2b-915372a6e6be tempest-VolumesExtendTest-20761872 None] Attempting download of a3efde48-babd-4b04-b205-71cd843dec16 ((None, [{'url': 'file:///opt/stack/data/glance/images/a3efde48-babd-4b04-b205-71cd843dec16', 'metadata': {}}])) to volume 2ea2858c-4a5a-432c-b820-d08b0b8b85d8. {{(pid=87747) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 22 03:28:32 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[00ad4979-bf18-4361-abda-179c89a2f723]: (4, 'raw') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:28:32 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-41b31818-1c09-4e4b-8f2b-915372a6e6be tempest-VolumesExtendTest-20761872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a3efde48-babd-4b04-b205-71cd843dec16_pqy8xi9z {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:28:32 devstack sudo[101914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a3efde48-babd-4b04-b205-71cd843dec16_pqy8xi9z Jul 22 03:28:32 devstack sudo[101914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:28:32 devstack sudo[101914]: pam_unix(sudo:session): session closed for user root Jul 22 03:28:32 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-41b31818-1c09-4e4b-8f2b-915372a6e6be tempest-VolumesExtendTest-20761872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a3efde48-babd-4b04-b205-71cd843dec16_pqy8xi9z" returned: 0 in 0.317s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:28:32 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-41b31818-1c09-4e4b-8f2b-915372a6e6be tempest-VolumesExtendTest-20761872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a3efde48-babd-4b04-b205-71cd843dec16_pqy8xi9z {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:28:32 devstack sudo[101918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a3efde48-babd-4b04-b205-71cd843dec16_pqy8xi9z Jul 22 03:28:32 devstack sudo[101918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:28:32 devstack sudo[101918]: pam_unix(sudo:session): session closed for user root Jul 22 03:28:32 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-41b31818-1c09-4e4b-8f2b-915372a6e6be tempest-VolumesExtendTest-20761872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a3efde48-babd-4b04-b205-71cd843dec16_pqy8xi9z" returned: 1 in 0.317s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:28:32 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-41b31818-1c09-4e4b-8f2b-915372a6e6be tempest-VolumesExtendTest-20761872 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a3efde48-babd-4b04-b205-71cd843dec16_pqy8xi9z' failed. Not Retrying. {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 22 03:28:32 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dd1e1fe-1421-461e-8cd3-aba3e8350d4b]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:28:32 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-41b31818-1c09-4e4b-8f2b-915372a6e6be tempest-VolumesExtendTest-20761872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a3efde48-babd-4b04-b205-71cd843dec16_vizt6anqdevstack@QuobyteHD {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:28:33 devstack sudo[101922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a3efde48-babd-4b04-b205-71cd843dec16_vizt6anqdevstack@QuobyteHD Jul 22 03:28:33 devstack sudo[101922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:28:33 devstack sudo[101922]: pam_unix(sudo:session): session closed for user root Jul 22 03:28:33 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-41b31818-1c09-4e4b-8f2b-915372a6e6be tempest-VolumesExtendTest-20761872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a3efde48-babd-4b04-b205-71cd843dec16_vizt6anqdevstack@QuobyteHD" returned: 0 in 0.320s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:28:33 devstack cinder-volume[87747]: DEBUG cinder.image.image_utils [None req-41b31818-1c09-4e4b-8f2b-915372a6e6be tempest-VolumesExtendTest-20761872 None] a3efde48-babd-4b04-b205-71cd843dec16 was qcow2, converting to qcow2 {{(pid=87747) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 22 03:28:33 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-41b31818-1c09-4e4b-8f2b-915372a6e6be tempest-VolumesExtendTest-20761872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a3efde48-babd-4b04-b205-71cd843dec16_vizt6anqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2ea2858c-4a5a-432c-b820-d08b0b8b85d8 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:28:33 devstack sudo[101928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a3efde48-babd-4b04-b205-71cd843dec16_vizt6anqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2ea2858c-4a5a-432c-b820-d08b0b8b85d8 Jul 22 03:28:33 devstack sudo[101928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:28:34 devstack sudo[101928]: pam_unix(sudo:session): session closed for user root Jul 22 03:28:34 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-41b31818-1c09-4e4b-8f2b-915372a6e6be tempest-VolumesExtendTest-20761872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a3efde48-babd-4b04-b205-71cd843dec16_vizt6anqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2ea2858c-4a5a-432c-b820-d08b0b8b85d8" returned: 0 in 1.487s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:28:34 devstack cinder-volume[87747]: DEBUG cinder.image.image_utils [None req-41b31818-1c09-4e4b-8f2b-915372a6e6be tempest-VolumesExtendTest-20761872 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a3efde48-babd-4b04-b205-71cd843dec16_vizt6anqdevstack@QuobyteHD, size 112.00 MB, duration 1.49 sec, destination /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2ea2858c-4a5a-432c-b820-d08b0b8b85d8 {{(pid=87747) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 22 03:28:34 devstack cinder-volume[87747]: INFO cinder.image.image_utils [None req-41b31818-1c09-4e4b-8f2b-915372a6e6be tempest-VolumesExtendTest-20761872 None] Converted 112.00 MB image at 75.25 MB/s Jul 22 03:28:34 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-41b31818-1c09-4e4b-8f2b-915372a6e6be tempest-VolumesExtendTest-20761872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2ea2858c-4a5a-432c-b820-d08b0b8b85d8 1G {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:28:34 devstack sudo[101937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2ea2858c-4a5a-432c-b820-d08b0b8b85d8 1G Jul 22 03:28:34 devstack sudo[101937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:28:35 devstack sudo[101937]: pam_unix(sudo:session): session closed for user root Jul 22 03:28:35 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-41b31818-1c09-4e4b-8f2b-915372a6e6be tempest-VolumesExtendTest-20761872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2ea2858c-4a5a-432c-b820-d08b0b8b85d8 1G" returned: 0 in 0.304s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:28:35 devstack cinder-volume[87747]: DEBUG cinder.volume.volume_utils [None req-41b31818-1c09-4e4b-8f2b-915372a6e6be tempest-VolumesExtendTest-20761872 None] Downloaded image a3efde48-babd-4b04-b205-71cd843dec16 ((None, [{'url': 'file:///opt/stack/data/glance/images/a3efde48-babd-4b04-b205-71cd843dec16', 'metadata': {}}])) to volume 2ea2858c-4a5a-432c-b820-d08b0b8b85d8 successfully. {{(pid=87747) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 22 03:28:35 devstack cinder-volume[87747]: DEBUG cinder.image.image_utils [None req-41b31818-1c09-4e4b-8f2b-915372a6e6be tempest-VolumesExtendTest-20761872 None] Temporary image a3efde48-babd-4b04-b205-71cd843dec16 for user 6f9000e496b249cea4fc64d7d94b3fe6 is deleted. {{(pid=87747) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 22 03:28:35 devstack cinder-volume[87747]: DEBUG cinder.volume.volume_utils [None req-41b31818-1c09-4e4b-8f2b-915372a6e6be tempest-VolumesExtendTest-20761872 None] Marking volume 2ea2858c-4a5a-432c-b820-d08b0b8b85d8 as bootable. {{(pid=87747) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 22 03:28:35 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-41b31818-1c09-4e4b-8f2b-915372a6e6be tempest-VolumesExtendTest-20761872 None] Copying metadata from image a3efde48-babd-4b04-b205-71cd843dec16 to 2ea2858c-4a5a-432c-b820-d08b0b8b85d8. {{(pid=87747) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 22 03:28:35 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-41b31818-1c09-4e4b-8f2b-915372a6e6be tempest-VolumesExtendTest-20761872 None] Creating volume glance metadata for volume 2ea2858c-4a5a-432c-b820-d08b0b8b85d8 backed by image a3efde48-babd-4b04-b205-71cd843dec16 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'a3efde48-babd-4b04-b205-71cd843dec16', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87747) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 22 03:28:35 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-41b31818-1c09-4e4b-8f2b-915372a6e6be tempest-VolumesExtendTest-20761872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e85b6f2a-2b5b-41b5-955b-dcdde3e8b08a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ea2858c-4a5a-432c-b820-d08b0b8b85d8', 'volume_size': 1, 'image_id': 'a3efde48-babd-4b04-b205-71cd843dec16', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a3efde48-babd-4b04-b205-71cd843dec16', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '37328413017b49c4b4fe75bae83dd2ac', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a3efde48-babd-4b04-b205-71cd843dec16', 'created_at': datetime.datetime(2026, 7, 22, 1, 8, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 22, 1, 8, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a3efde48-babd-4b04-b205-71cd843dec16/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:28:35 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-41b31818-1c09-4e4b-8f2b-915372a6e6be tempest-VolumesExtendTest-20761872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11f8e3df-1c3f-49e8-ab4c-477d7004994a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:28:35 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-41b31818-1c09-4e4b-8f2b-915372a6e6be tempest-VolumesExtendTest-20761872 None] Volume volume-2ea2858c-4a5a-432c-b820-d08b0b8b85d8 (2ea2858c-4a5a-432c-b820-d08b0b8b85d8): created successfully Jul 22 03:28:35 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-41b31818-1c09-4e4b-8f2b-915372a6e6be tempest-VolumesExtendTest-20761872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11f8e3df-1c3f-49e8-ab4c-477d7004994a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:28:35 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-41b31818-1c09-4e4b-8f2b-915372a6e6be tempest-VolumesExtendTest-20761872 None] Flow 'volume_create_manager' (20968787-dbeb-4e93-9c37-01e538b28a50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:28:35 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-41b31818-1c09-4e4b-8f2b-915372a6e6be tempest-VolumesExtendTest-20761872 None] Created volume successfully. Jul 22 03:28:35 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-2b64254a-9a84-4b04-9ed1-13badc5c0c59 tempest-VolumesExtendTest-20761872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:28:35 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-2b64254a-9a84-4b04-9ed1-13badc5c0c59 tempest-VolumesExtendTest-20761872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:28:35 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[df504d61-0702-4e6b-b82e-f49150c21ae8]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:28:35 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2b64254a-9a84-4b04-9ed1-13badc5c0c59 tempest-VolumesExtendTest-20761872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2ea2858c-4a5a-432c-b820-d08b0b8b85d8 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:28:35 devstack sudo[101942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2ea2858c-4a5a-432c-b820-d08b0b8b85d8 Jul 22 03:28:35 devstack sudo[101942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:28:35 devstack sudo[101942]: pam_unix(sudo:session): session closed for user root Jul 22 03:28:35 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2b64254a-9a84-4b04-9ed1-13badc5c0c59 tempest-VolumesExtendTest-20761872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2ea2858c-4a5a-432c-b820-d08b0b8b85d8" returned: 0 in 0.353s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:28:35 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2b64254a-9a84-4b04-9ed1-13badc5c0c59 tempest-VolumesExtendTest-20761872 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2ea2858c-4a5a-432c-b820-d08b0b8b85d8 2G {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:28:35 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2b64254a-9a84-4b04-9ed1-13badc5c0c59 tempest-VolumesExtendTest-20761872 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2ea2858c-4a5a-432c-b820-d08b0b8b85d8 2G" returned: 0 in 0.085s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:28:35 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-2b64254a-9a84-4b04-9ed1-13badc5c0c59 tempest-VolumesExtendTest-20761872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.459s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:28:35 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-2b64254a-9a84-4b04-9ed1-13badc5c0c59 tempest-VolumesExtendTest-20761872 None] Extend volume completed successfully. Jul 22 03:28:36 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-22a531cc-cb70-454f-a53e-06ffa5e7c21f tempest-VolumesExtendTest-20761872 None] Acquiring lock "cinder-2ea2858c-4a5a-432c-b820-d08b0b8b85d8-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:28:36 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-22a531cc-cb70-454f-a53e-06ffa5e7c21f tempest-VolumesExtendTest-20761872 None] Lock "cinder-2ea2858c-4a5a-432c-b820-d08b0b8b85d8-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:28:36 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-22a531cc-cb70-454f-a53e-06ffa5e7c21f tempest-VolumesExtendTest-20761872 None] Acquiring lock "cinder-quobyte-2ea2858c-4a5a-432c-b820-d08b0b8b85d8" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:28:36 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-22a531cc-cb70-454f-a53e-06ffa5e7c21f tempest-VolumesExtendTest-20761872 None] Lock "cinder-quobyte-2ea2858c-4a5a-432c-b820-d08b0b8b85d8" acquired by "delete_volume" :: waited 0.019s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:28:36 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff823f35-d8e3-419f-a480-fe326a01873a]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:28:36 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-22a531cc-cb70-454f-a53e-06ffa5e7c21f tempest-VolumesExtendTest-20761872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2ea2858c-4a5a-432c-b820-d08b0b8b85d8 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:28:36 devstack sudo[101986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2ea2858c-4a5a-432c-b820-d08b0b8b85d8 Jul 22 03:28:36 devstack sudo[101986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:28:37 devstack sudo[101986]: pam_unix(sudo:session): session closed for user root Jul 22 03:28:37 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-22a531cc-cb70-454f-a53e-06ffa5e7c21f tempest-VolumesExtendTest-20761872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2ea2858c-4a5a-432c-b820-d08b0b8b85d8" returned: 0 in 0.349s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:28:37 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-22a531cc-cb70-454f-a53e-06ffa5e7c21f tempest-VolumesExtendTest-20761872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2ea2858c-4a5a-432c-b820-d08b0b8b85d8 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:28:37 devstack sudo[101991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2ea2858c-4a5a-432c-b820-d08b0b8b85d8 Jul 22 03:28:37 devstack sudo[101991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:28:37 devstack sudo[101991]: pam_unix(sudo:session): session closed for user root Jul 22 03:28:37 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-22a531cc-cb70-454f-a53e-06ffa5e7c21f tempest-VolumesExtendTest-20761872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2ea2858c-4a5a-432c-b820-d08b0b8b85d8" returned: 0 in 0.248s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:28:37 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-22a531cc-cb70-454f-a53e-06ffa5e7c21f tempest-VolumesExtendTest-20761872 None] Lock "cinder-quobyte-2ea2858c-4a5a-432c-b820-d08b0b8b85d8" released by "delete_volume" :: held 0.632s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:28:37 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-22a531cc-cb70-454f-a53e-06ffa5e7c21f tempest-VolumesExtendTest-20761872 None] Created reservations ['27c0c069-a604-4afe-9bb0-f7bf0c44f923', '529dc035-40d4-4467-8c38-d2cbd07865c7', '31beeed7-0d51-4a95-aabc-9b9473eeab74', '6d128909-5d12-4130-a0f7-b52850fe242c'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:28:37 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-22a531cc-cb70-454f-a53e-06ffa5e7c21f tempest-VolumesExtendTest-20761872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:28:37 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-22a531cc-cb70-454f-a53e-06ffa5e7c21f tempest-VolumesExtendTest-20761872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:28:37 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-22a531cc-cb70-454f-a53e-06ffa5e7c21f tempest-VolumesExtendTest-20761872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:28:37 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-22a531cc-cb70-454f-a53e-06ffa5e7c21f tempest-VolumesExtendTest-20761872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:28:37 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-22a531cc-cb70-454f-a53e-06ffa5e7c21f tempest-VolumesExtendTest-20761872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:28:37 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-22a531cc-cb70-454f-a53e-06ffa5e7c21f tempest-VolumesExtendTest-20761872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:28:37 devstack sudo[101994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:28:37 devstack sudo[101994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:28:37 devstack sudo[101994]: pam_unix(sudo:session): session closed for user root Jul 22 03:28:37 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-22a531cc-cb70-454f-a53e-06ffa5e7c21f tempest-VolumesExtendTest-20761872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.235s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:28:37 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-22a531cc-cb70-454f-a53e-06ffa5e7c21f tempest-VolumesExtendTest-20761872 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:28:37 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-22a531cc-cb70-454f-a53e-06ffa5e7c21f tempest-VolumesExtendTest-20761872 None] Deleted volume successfully. Jul 22 03:28:37 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-22a531cc-cb70-454f-a53e-06ffa5e7c21f tempest-VolumesExtendTest-20761872 None] Lock "cinder-2ea2858c-4a5a-432c-b820-d08b0b8b85d8-delete_volume" released by "delete_volume" :: held 1.064s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:28:38 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-4727c6e8-809a-4f94-8e2c-92456c2c104a tempest-VolumesExtendTest-20761872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:28:38 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-4727c6e8-809a-4f94-8e2c-92456c2c104a tempest-VolumesExtendTest-20761872 None] Flow 'volume_create_manager' (711dd670-7126-4b45-aad4-506a251e2f8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:28:38 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-4727c6e8-809a-4f94-8e2c-92456c2c104a tempest-VolumesExtendTest-20761872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55e26fee-e879-40fc-8a14-5cf2ecb0d8c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:28:38 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-4727c6e8-809a-4f94-8e2c-92456c2c104a tempest-VolumesExtendTest-20761872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55e26fee-e879-40fc-8a14-5cf2ecb0d8c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:28:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-968744219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11861a7f-e521-4210-85ae-d999ab579b19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c9ea3d0860444b6972e161d7951944d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:28:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:28:38Z,use_quota=True,user_id='6f9000e496b249cea4fc64d7d94b3fe6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:28:38 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-4727c6e8-809a-4f94-8e2c-92456c2c104a tempest-VolumesExtendTest-20761872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ba27535-ea71-40d2-9fc8-84969c80a4d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:28:38 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-4727c6e8-809a-4f94-8e2c-92456c2c104a tempest-VolumesExtendTest-20761872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ba27535-ea71-40d2-9fc8-84969c80a4d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:28:38 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-4727c6e8-809a-4f94-8e2c-92456c2c104a tempest-VolumesExtendTest-20761872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c017897-22ac-426c-be6e-0043ad758122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:28:38 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-4727c6e8-809a-4f94-8e2c-92456c2c104a tempest-VolumesExtendTest-20761872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c017897-22ac-426c-be6e-0043ad758122) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11861a7f-e521-4210-85ae-d999ab579b19', 'volume_name': 'volume-11861a7f-e521-4210-85ae-d999ab579b19', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:28:38 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-4727c6e8-809a-4f94-8e2c-92456c2c104a tempest-VolumesExtendTest-20761872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbe45534-c3f7-47fb-8de5-dec45ef755af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:28:38 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-4727c6e8-809a-4f94-8e2c-92456c2c104a tempest-VolumesExtendTest-20761872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbe45534-c3f7-47fb-8de5-dec45ef755af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:28:38 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-4727c6e8-809a-4f94-8e2c-92456c2c104a tempest-VolumesExtendTest-20761872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c2bf216-2b1b-454b-9775-0c9e4f2531ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:28:38 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-4727c6e8-809a-4f94-8e2c-92456c2c104a tempest-VolumesExtendTest-20761872 None] Volume 11861a7f-e521-4210-85ae-d999ab579b19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11861a7f-e521-4210-85ae-d999ab579b19', 'volume_size': 1} Jul 22 03:28:38 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-4727c6e8-809a-4f94-8e2c-92456c2c104a tempest-VolumesExtendTest-20761872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:28:38 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-4727c6e8-809a-4f94-8e2c-92456c2c104a tempest-VolumesExtendTest-20761872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:28:38 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-4727c6e8-809a-4f94-8e2c-92456c2c104a tempest-VolumesExtendTest-20761872 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:28:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-968744219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11861a7f-e521-4210-85ae-d999ab579b19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c9ea3d0860444b6972e161d7951944d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:28:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:28:38Z,use_quota=True,user_id='6f9000e496b249cea4fc64d7d94b3fe6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:28:38 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-4727c6e8-809a-4f94-8e2c-92456c2c104a tempest-VolumesExtendTest-20761872 None] Creating volume 11861a7f-e521-4210-85ae-d999ab579b19 {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:28:38 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-4727c6e8-809a-4f94-8e2c-92456c2c104a tempest-VolumesExtendTest-20761872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:28:38 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-4727c6e8-809a-4f94-8e2c-92456c2c104a tempest-VolumesExtendTest-20761872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:28:38 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-4727c6e8-809a-4f94-8e2c-92456c2c104a tempest-VolumesExtendTest-20761872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:28:38 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-4727c6e8-809a-4f94-8e2c-92456c2c104a tempest-VolumesExtendTest-20761872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:28:38 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-4727c6e8-809a-4f94-8e2c-92456c2c104a tempest-VolumesExtendTest-20761872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:28:38 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-4727c6e8-809a-4f94-8e2c-92456c2c104a tempest-VolumesExtendTest-20761872 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:28:38 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-4727c6e8-809a-4f94-8e2c-92456c2c104a tempest-VolumesExtendTest-20761872 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:28:38 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-4727c6e8-809a-4f94-8e2c-92456c2c104a tempest-VolumesExtendTest-20761872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-11861a7f-e521-4210-85ae-d999ab579b19 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:28:38 devstack sudo[101997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-11861a7f-e521-4210-85ae-d999ab579b19 1073741824 Jul 22 03:28:38 devstack sudo[101997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:28:38 devstack sudo[101997]: pam_unix(sudo:session): session closed for user root Jul 22 03:28:38 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-4727c6e8-809a-4f94-8e2c-92456c2c104a tempest-VolumesExtendTest-20761872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-11861a7f-e521-4210-85ae-d999ab579b19 1073741824" returned: 0 in 0.403s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:28:38 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-4727c6e8-809a-4f94-8e2c-92456c2c104a tempest-VolumesExtendTest-20761872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-11861a7f-e521-4210-85ae-d999ab579b19 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:28:38 devstack sudo[102002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-11861a7f-e521-4210-85ae-d999ab579b19 Jul 22 03:28:38 devstack sudo[102002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:28:39 devstack sudo[102002]: pam_unix(sudo:session): session closed for user root Jul 22 03:28:39 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-4727c6e8-809a-4f94-8e2c-92456c2c104a tempest-VolumesExtendTest-20761872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-11861a7f-e521-4210-85ae-d999ab579b19" returned: 0 in 0.236s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:28:39 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-4727c6e8-809a-4f94-8e2c-92456c2c104a tempest-VolumesExtendTest-20761872 None] <== create_volume: return (682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:28:39 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-4727c6e8-809a-4f94-8e2c-92456c2c104a tempest-VolumesExtendTest-20761872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.686s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:28:39 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-4727c6e8-809a-4f94-8e2c-92456c2c104a tempest-VolumesExtendTest-20761872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c2bf216-2b1b-454b-9775-0c9e4f2531ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11861a7f-e521-4210-85ae-d999ab579b19', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:28:39 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-4727c6e8-809a-4f94-8e2c-92456c2c104a tempest-VolumesExtendTest-20761872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (257bf68f-bbf3-4403-a7b7-96983fdbdbb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:28:39 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-4727c6e8-809a-4f94-8e2c-92456c2c104a tempest-VolumesExtendTest-20761872 None] Volume volume-11861a7f-e521-4210-85ae-d999ab579b19 (11861a7f-e521-4210-85ae-d999ab579b19): created successfully Jul 22 03:28:39 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-4727c6e8-809a-4f94-8e2c-92456c2c104a tempest-VolumesExtendTest-20761872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (257bf68f-bbf3-4403-a7b7-96983fdbdbb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:28:39 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-4727c6e8-809a-4f94-8e2c-92456c2c104a tempest-VolumesExtendTest-20761872 None] Flow 'volume_create_manager' (711dd670-7126-4b45-aad4-506a251e2f8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:28:39 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-4727c6e8-809a-4f94-8e2c-92456c2c104a tempest-VolumesExtendTest-20761872 None] Created volume successfully. Jul 22 03:28:39 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-41db6306-7b9c-4fc6-99d4-44ba6e7651a1 tempest-VolumesExtendTest-20761872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:28:39 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-41db6306-7b9c-4fc6-99d4-44ba6e7651a1 tempest-VolumesExtendTest-20761872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:28:39 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-41db6306-7b9c-4fc6-99d4-44ba6e7651a1 tempest-VolumesExtendTest-20761872 None] Creating offline snapshot 882b3c27-7470-463c-a81b-43cc19364bb3 of volume 11861a7f-e521-4210-85ae-d999ab579b19 {{(pid=87747) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 03:28:39 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[b975fc4e-70c7-4b29-b3c9-5f9edd94ef12]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:28:39 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-41db6306-7b9c-4fc6-99d4-44ba6e7651a1 tempest-VolumesExtendTest-20761872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-11861a7f-e521-4210-85ae-d999ab579b19 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:28:39 devstack sudo[102005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-11861a7f-e521-4210-85ae-d999ab579b19 Jul 22 03:28:39 devstack sudo[102005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:28:39 devstack sudo[102005]: pam_unix(sudo:session): session closed for user root Jul 22 03:28:39 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-41db6306-7b9c-4fc6-99d4-44ba6e7651a1 tempest-VolumesExtendTest-20761872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-11861a7f-e521-4210-85ae-d999ab579b19" returned: 0 in 0.353s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:28:39 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-41db6306-7b9c-4fc6-99d4-44ba6e7651a1 tempest-VolumesExtendTest-20761872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-11861a7f-e521-4210-85ae-d999ab579b19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-11861a7f-e521-4210-85ae-d999ab579b19.882b3c27-7470-463c-a81b-43cc19364bb3 1G {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:28:39 devstack sudo[102010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-11861a7f-e521-4210-85ae-d999ab579b19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-11861a7f-e521-4210-85ae-d999ab579b19.882b3c27-7470-463c-a81b-43cc19364bb3 1G Jul 22 03:28:39 devstack sudo[102010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:28:40 devstack sudo[102010]: pam_unix(sudo:session): session closed for user root Jul 22 03:28:40 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-41db6306-7b9c-4fc6-99d4-44ba6e7651a1 tempest-VolumesExtendTest-20761872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-11861a7f-e521-4210-85ae-d999ab579b19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-11861a7f-e521-4210-85ae-d999ab579b19.882b3c27-7470-463c-a81b-43cc19364bb3 1G" returned: 0 in 0.374s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:28:40 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-41db6306-7b9c-4fc6-99d4-44ba6e7651a1 tempest-VolumesExtendTest-20761872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11861a7f-e521-4210-85ae-d999ab579b19 -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-11861a7f-e521-4210-85ae-d999ab579b19.882b3c27-7470-463c-a81b-43cc19364bb3 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:28:40 devstack sudo[102016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11861a7f-e521-4210-85ae-d999ab579b19 -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-11861a7f-e521-4210-85ae-d999ab579b19.882b3c27-7470-463c-a81b-43cc19364bb3 Jul 22 03:28:40 devstack sudo[102016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:28:40 devstack sudo[102016]: pam_unix(sudo:session): session closed for user root Jul 22 03:28:40 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-41db6306-7b9c-4fc6-99d4-44ba6e7651a1 tempest-VolumesExtendTest-20761872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11861a7f-e521-4210-85ae-d999ab579b19 -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-11861a7f-e521-4210-85ae-d999ab579b19.882b3c27-7470-463c-a81b-43cc19364bb3" returned: 0 in 0.285s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:28:40 devstack cinder-volume[87747]: WARNING cinder.volume.drivers.remotefs [None req-41db6306-7b9c-4fc6-99d4-44ba6e7651a1 tempest-VolumesExtendTest-20761872 None] /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-11861a7f-e521-4210-85ae-d999ab579b19.882b3c27-7470-463c-a81b-43cc19364bb3 is being set with open permissions: ugo+rw Jul 22 03:28:40 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-41db6306-7b9c-4fc6-99d4-44ba6e7651a1 tempest-VolumesExtendTest-20761872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-11861a7f-e521-4210-85ae-d999ab579b19.882b3c27-7470-463c-a81b-43cc19364bb3 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:28:40 devstack sudo[102021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-11861a7f-e521-4210-85ae-d999ab579b19.882b3c27-7470-463c-a81b-43cc19364bb3 Jul 22 03:28:40 devstack sudo[102021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:28:40 devstack sudo[102021]: pam_unix(sudo:session): session closed for user root Jul 22 03:28:40 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-41db6306-7b9c-4fc6-99d4-44ba6e7651a1 tempest-VolumesExtendTest-20761872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-11861a7f-e521-4210-85ae-d999ab579b19.882b3c27-7470-463c-a81b-43cc19364bb3" returned: 0 in 0.241s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:28:40 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-41db6306-7b9c-4fc6-99d4-44ba6e7651a1 tempest-VolumesExtendTest-20761872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-11861a7f-e521-4210-85ae-d999ab579b19.info {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:28:40 devstack sudo[102024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-11861a7f-e521-4210-85ae-d999ab579b19.info Jul 22 03:28:40 devstack sudo[102024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:28:41 devstack sudo[102024]: pam_unix(sudo:session): session closed for user root Jul 22 03:28:41 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-41db6306-7b9c-4fc6-99d4-44ba6e7651a1 tempest-VolumesExtendTest-20761872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-11861a7f-e521-4210-85ae-d999ab579b19.info" returned: 0 in 0.242s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:28:41 devstack cinder-volume[87747]: WARNING cinder.volume.drivers.remotefs [None req-41db6306-7b9c-4fc6-99d4-44ba6e7651a1 tempest-VolumesExtendTest-20761872 None] /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-11861a7f-e521-4210-85ae-d999ab579b19.info is being set with open permissions: ugo+rw Jul 22 03:28:41 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-41db6306-7b9c-4fc6-99d4-44ba6e7651a1 tempest-VolumesExtendTest-20761872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-11861a7f-e521-4210-85ae-d999ab579b19.info {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:28:41 devstack sudo[102027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-11861a7f-e521-4210-85ae-d999ab579b19.info Jul 22 03:28:41 devstack sudo[102027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:28:41 devstack sudo[102027]: pam_unix(sudo:session): session closed for user root Jul 22 03:28:41 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-41db6306-7b9c-4fc6-99d4-44ba6e7651a1 tempest-VolumesExtendTest-20761872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-11861a7f-e521-4210-85ae-d999ab579b19.info" returned: 0 in 0.231s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:28:41 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-41db6306-7b9c-4fc6-99d4-44ba6e7651a1 tempest-VolumesExtendTest-20761872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.808s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:28:41 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-41db6306-7b9c-4fc6-99d4-44ba6e7651a1 tempest-VolumesExtendTest-20761872 None] Create snapshot completed successfully Jul 22 03:28:41 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-0efb2cd1-51dd-43bf-88bf-a99231b2b154 tempest-VolumesExtendTest-20761872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:28:41 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-0efb2cd1-51dd-43bf-88bf-a99231b2b154 tempest-VolumesExtendTest-20761872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:28:41 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[228209a8-f0ff-4a2a-9182-5f1f736be989]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:28:41 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-0efb2cd1-51dd-43bf-88bf-a99231b2b154 tempest-VolumesExtendTest-20761872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-11861a7f-e521-4210-85ae-d999ab579b19 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:28:41 devstack sudo[102030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-11861a7f-e521-4210-85ae-d999ab579b19 Jul 22 03:28:41 devstack sudo[102030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:28:42 devstack sudo[102030]: pam_unix(sudo:session): session closed for user root Jul 22 03:28:42 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-0efb2cd1-51dd-43bf-88bf-a99231b2b154 tempest-VolumesExtendTest-20761872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-11861a7f-e521-4210-85ae-d999ab579b19" returned: 0 in 0.342s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:28:42 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-0efb2cd1-51dd-43bf-88bf-a99231b2b154 tempest-VolumesExtendTest-20761872 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-11861a7f-e521-4210-85ae-d999ab579b19.882b3c27-7470-463c-a81b-43cc19364bb3 2G {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:28:42 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-0efb2cd1-51dd-43bf-88bf-a99231b2b154 tempest-VolumesExtendTest-20761872 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-11861a7f-e521-4210-85ae-d999ab579b19.882b3c27-7470-463c-a81b-43cc19364bb3 2G" returned: 0 in 0.114s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:28:42 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-0efb2cd1-51dd-43bf-88bf-a99231b2b154 tempest-VolumesExtendTest-20761872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.484s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:28:42 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-0efb2cd1-51dd-43bf-88bf-a99231b2b154 tempest-VolumesExtendTest-20761872 None] Extend volume completed successfully. Jul 22 03:28:42 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-73d20b57-8eb0-4fcc-9bdb-b1dd90925c28 tempest-VolumesExtendTest-20761872 None] Acquiring lock "cinder-882b3c27-7470-463c-a81b-43cc19364bb3-delete_snapshot" by "delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:28:42 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-73d20b57-8eb0-4fcc-9bdb-b1dd90925c28 tempest-VolumesExtendTest-20761872 None] Lock "cinder-882b3c27-7470-463c-a81b-43cc19364bb3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:28:42 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-73d20b57-8eb0-4fcc-9bdb-b1dd90925c28 tempest-VolumesExtendTest-20761872 None] Acquiring lock "cinder-quobyte-11861a7f-e521-4210-85ae-d999ab579b19" by "delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:28:42 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-73d20b57-8eb0-4fcc-9bdb-b1dd90925c28 tempest-VolumesExtendTest-20761872 None] Lock "cinder-quobyte-11861a7f-e521-4210-85ae-d999ab579b19" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:28:42 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-73d20b57-8eb0-4fcc-9bdb-b1dd90925c28 tempest-VolumesExtendTest-20761872 None] Acquiring lock "cinder-quobyte-882b3c27-7470-463c-a81b-43cc19364bb3" by "_delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:28:42 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-73d20b57-8eb0-4fcc-9bdb-b1dd90925c28 tempest-VolumesExtendTest-20761872 None] Lock "cinder-quobyte-882b3c27-7470-463c-a81b-43cc19364bb3" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:28:42 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-73d20b57-8eb0-4fcc-9bdb-b1dd90925c28 tempest-VolumesExtendTest-20761872 None] Deleting offline snapshot 882b3c27-7470-463c-a81b-43cc19364bb3 of volume 11861a7f-e521-4210-85ae-d999ab579b19 {{(pid=87747) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 03:28:42 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-73d20b57-8eb0-4fcc-9bdb-b1dd90925c28 tempest-VolumesExtendTest-20761872 None] snapshot_file for this snap is: volume-11861a7f-e521-4210-85ae-d999ab579b19.882b3c27-7470-463c-a81b-43cc19364bb3 {{(pid=87747) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 03:28:42 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cd0e83e-50a7-4071-ab77-f1352d69dcb3]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:28:42 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-73d20b57-8eb0-4fcc-9bdb-b1dd90925c28 tempest-VolumesExtendTest-20761872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-11861a7f-e521-4210-85ae-d999ab579b19.882b3c27-7470-463c-a81b-43cc19364bb3 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:28:43 devstack sudo[102040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-11861a7f-e521-4210-85ae-d999ab579b19.882b3c27-7470-463c-a81b-43cc19364bb3 Jul 22 03:28:43 devstack sudo[102040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:28:43 devstack sudo[102040]: pam_unix(sudo:session): session closed for user root Jul 22 03:28:43 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-73d20b57-8eb0-4fcc-9bdb-b1dd90925c28 tempest-VolumesExtendTest-20761872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-11861a7f-e521-4210-85ae-d999ab579b19.882b3c27-7470-463c-a81b-43cc19364bb3" returned: 0 in 0.344s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:28:43 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-73d20b57-8eb0-4fcc-9bdb-b1dd90925c28 tempest-VolumesExtendTest-20761872 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11861a7f-e521-4210-85ae-d999ab579b19(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87747) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 03:28:43 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e95295d-47d2-4670-bf86-2fdc57fb30af]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:28:43 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-73d20b57-8eb0-4fcc-9bdb-b1dd90925c28 tempest-VolumesExtendTest-20761872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-11861a7f-e521-4210-85ae-d999ab579b19 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:28:43 devstack sudo[102046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-11861a7f-e521-4210-85ae-d999ab579b19 Jul 22 03:28:43 devstack sudo[102046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:28:43 devstack sudo[102046]: pam_unix(sudo:session): session closed for user root Jul 22 03:28:43 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-73d20b57-8eb0-4fcc-9bdb-b1dd90925c28 tempest-VolumesExtendTest-20761872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-11861a7f-e521-4210-85ae-d999ab579b19" returned: 0 in 0.353s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:28:43 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-73d20b57-8eb0-4fcc-9bdb-b1dd90925c28 tempest-VolumesExtendTest-20761872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-11861a7f-e521-4210-85ae-d999ab579b19.882b3c27-7470-463c-a81b-43cc19364bb3 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:28:43 devstack sudo[102051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-11861a7f-e521-4210-85ae-d999ab579b19.882b3c27-7470-463c-a81b-43cc19364bb3 Jul 22 03:28:43 devstack sudo[102051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:28:44 devstack sudo[102051]: pam_unix(sudo:session): session closed for user root Jul 22 03:28:44 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-73d20b57-8eb0-4fcc-9bdb-b1dd90925c28 tempest-VolumesExtendTest-20761872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-11861a7f-e521-4210-85ae-d999ab579b19.882b3c27-7470-463c-a81b-43cc19364bb3" returned: 0 in 0.356s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:28:44 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-73d20b57-8eb0-4fcc-9bdb-b1dd90925c28 tempest-VolumesExtendTest-20761872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-11861a7f-e521-4210-85ae-d999ab579b19.882b3c27-7470-463c-a81b-43cc19364bb3 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:28:44 devstack sudo[102056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-11861a7f-e521-4210-85ae-d999ab579b19.882b3c27-7470-463c-a81b-43cc19364bb3 Jul 22 03:28:44 devstack sudo[102056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:28:44 devstack sudo[102056]: pam_unix(sudo:session): session closed for user root Jul 22 03:28:44 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-73d20b57-8eb0-4fcc-9bdb-b1dd90925c28 tempest-VolumesExtendTest-20761872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-11861a7f-e521-4210-85ae-d999ab579b19.882b3c27-7470-463c-a81b-43cc19364bb3" returned: 0 in 0.238s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:28:44 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-73d20b57-8eb0-4fcc-9bdb-b1dd90925c28 tempest-VolumesExtendTest-20761872 None] Lock "cinder-quobyte-882b3c27-7470-463c-a81b-43cc19364bb3" released by "_delete_snapshot" :: held 1.386s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:28:44 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-73d20b57-8eb0-4fcc-9bdb-b1dd90925c28 tempest-VolumesExtendTest-20761872 None] Lock "cinder-quobyte-11861a7f-e521-4210-85ae-d999ab579b19" released by "delete_snapshot" :: held 1.405s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:28:44 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-73d20b57-8eb0-4fcc-9bdb-b1dd90925c28 tempest-VolumesExtendTest-20761872 None] Created reservations ['10bf2601-3fe1-469b-9579-9c504b4a7f69', '73de137e-e21f-431e-b9b0-55b97c177bad', '6854a59d-8882-497e-96d1-0246a7a7d32d', '74ace7c2-7622-4dbe-9178-4d07a944491e'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:28:44 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-73d20b57-8eb0-4fcc-9bdb-b1dd90925c28 tempest-VolumesExtendTest-20761872 None] Delete snapshot completed successfully. Jul 22 03:28:44 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-73d20b57-8eb0-4fcc-9bdb-b1dd90925c28 tempest-VolumesExtendTest-20761872 None] Lock "cinder-882b3c27-7470-463c-a81b-43cc19364bb3-delete_snapshot" released by "delete_snapshot" :: held 1.523s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:28:45 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-1dbb5296-fef5-48bc-abc7-ce81312e3ffb tempest-VolumesExtendTest-20761872 None] Acquiring lock "cinder-11861a7f-e521-4210-85ae-d999ab579b19-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:28:45 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-1dbb5296-fef5-48bc-abc7-ce81312e3ffb tempest-VolumesExtendTest-20761872 None] Lock "cinder-11861a7f-e521-4210-85ae-d999ab579b19-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:28:45 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-1dbb5296-fef5-48bc-abc7-ce81312e3ffb tempest-VolumesExtendTest-20761872 None] Acquiring lock "cinder-quobyte-11861a7f-e521-4210-85ae-d999ab579b19" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:28:45 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-1dbb5296-fef5-48bc-abc7-ce81312e3ffb tempest-VolumesExtendTest-20761872 None] Lock "cinder-quobyte-11861a7f-e521-4210-85ae-d999ab579b19" acquired by "delete_volume" :: waited 0.015s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:28:45 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[44e92f30-0e38-48ca-93cc-29e4cf78d0c8]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:28:45 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-1dbb5296-fef5-48bc-abc7-ce81312e3ffb tempest-VolumesExtendTest-20761872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-11861a7f-e521-4210-85ae-d999ab579b19 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:28:45 devstack sudo[102065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-11861a7f-e521-4210-85ae-d999ab579b19 Jul 22 03:28:45 devstack sudo[102065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:28:45 devstack sudo[102065]: pam_unix(sudo:session): session closed for user root Jul 22 03:28:45 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-1dbb5296-fef5-48bc-abc7-ce81312e3ffb tempest-VolumesExtendTest-20761872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-11861a7f-e521-4210-85ae-d999ab579b19" returned: 0 in 0.355s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:28:45 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-1dbb5296-fef5-48bc-abc7-ce81312e3ffb tempest-VolumesExtendTest-20761872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-11861a7f-e521-4210-85ae-d999ab579b19 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:28:45 devstack sudo[102070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-11861a7f-e521-4210-85ae-d999ab579b19 Jul 22 03:28:45 devstack sudo[102070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:28:45 devstack sudo[102070]: pam_unix(sudo:session): session closed for user root Jul 22 03:28:45 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-1dbb5296-fef5-48bc-abc7-ce81312e3ffb tempest-VolumesExtendTest-20761872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-11861a7f-e521-4210-85ae-d999ab579b19" returned: 0 in 0.237s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:28:45 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-1dbb5296-fef5-48bc-abc7-ce81312e3ffb tempest-VolumesExtendTest-20761872 None] Lock "cinder-quobyte-11861a7f-e521-4210-85ae-d999ab579b19" released by "delete_volume" :: held 0.648s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:28:45 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-1dbb5296-fef5-48bc-abc7-ce81312e3ffb tempest-VolumesExtendTest-20761872 None] Created reservations ['02bced23-1781-4c83-b330-e63e72177fc8', 'ba70f39e-3c1d-4d8b-a223-4eddf02d4d92', '719a3a10-85d4-4b08-b293-8b069a4b0823', 'e3209623-bf8f-41c5-b58a-d531577b061b'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:28:45 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-1dbb5296-fef5-48bc-abc7-ce81312e3ffb tempest-VolumesExtendTest-20761872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:28:45 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-1dbb5296-fef5-48bc-abc7-ce81312e3ffb tempest-VolumesExtendTest-20761872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:28:45 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-1dbb5296-fef5-48bc-abc7-ce81312e3ffb tempest-VolumesExtendTest-20761872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:28:45 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-1dbb5296-fef5-48bc-abc7-ce81312e3ffb tempest-VolumesExtendTest-20761872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:28:45 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-1dbb5296-fef5-48bc-abc7-ce81312e3ffb tempest-VolumesExtendTest-20761872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:28:45 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-1dbb5296-fef5-48bc-abc7-ce81312e3ffb tempest-VolumesExtendTest-20761872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:28:45 devstack sudo[102073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:28:45 devstack sudo[102073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:28:46 devstack sudo[102073]: pam_unix(sudo:session): session closed for user root Jul 22 03:28:46 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-1dbb5296-fef5-48bc-abc7-ce81312e3ffb tempest-VolumesExtendTest-20761872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.243s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:28:46 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-1dbb5296-fef5-48bc-abc7-ce81312e3ffb tempest-VolumesExtendTest-20761872 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:28:46 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-1dbb5296-fef5-48bc-abc7-ce81312e3ffb tempest-VolumesExtendTest-20761872 None] Deleted volume successfully. Jul 22 03:28:46 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-1dbb5296-fef5-48bc-abc7-ce81312e3ffb tempest-VolumesExtendTest-20761872 None] Lock "cinder-11861a7f-e521-4210-85ae-d999ab579b19-delete_volume" released by "delete_volume" :: held 1.082s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:28:48 devstack cinder-volume[87747]: DEBUG dbcounter [-] [87747] Writing DB stats cinder:SELECT=149,cinder:INSERT=58,cinder:UPDATE=183,cinder:DELETE=16 {{(pid=87747) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 03:28:48 devstack cinder-volume[87747]: DEBUG dbcounter [-] [87747] Writing DB stats cinder:SELECT=138,cinder:INSERT=48,cinder:UPDATE=204,cinder:DELETE=15 {{(pid=87747) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 03:28:48 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fa66c1e-8c6c-4165-8855-6c3c4fb9b90e tempest-VolumesGetTest-1419827919 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:28:48 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-1fa66c1e-8c6c-4165-8855-6c3c4fb9b90e tempest-VolumesGetTest-1419827919 None] Flow 'volume_create_manager' (9c23e4d8-da83-48e2-95e9-0bb032480924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:28:48 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-1fa66c1e-8c6c-4165-8855-6c3c4fb9b90e tempest-VolumesGetTest-1419827919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bd608a1-480c-4a08-a459-fec4e45448be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:28:48 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-1fa66c1e-8c6c-4165-8855-6c3c4fb9b90e tempest-VolumesGetTest-1419827919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bd608a1-480c-4a08-a459-fec4e45448be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:28:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-679805685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea08e89d-ff66-4f65-a06b-2eb9fa005020,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a3825839898349d585f9a61920bf5883',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:28:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:28:49Z,use_quota=True,user_id='a5e934656f2b40f3b0af6e623fe0c4a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:28:48 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-1fa66c1e-8c6c-4165-8855-6c3c4fb9b90e tempest-VolumesGetTest-1419827919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8a1bb6a-ab56-42c0-8792-89119faec78c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:28:48 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-1fa66c1e-8c6c-4165-8855-6c3c4fb9b90e tempest-VolumesGetTest-1419827919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8a1bb6a-ab56-42c0-8792-89119faec78c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:28:48 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-1fa66c1e-8c6c-4165-8855-6c3c4fb9b90e tempest-VolumesGetTest-1419827919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aaa9f86e-cbb0-4f30-9f32-d60e80d8ab5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:28:48 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-1fa66c1e-8c6c-4165-8855-6c3c4fb9b90e tempest-VolumesGetTest-1419827919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aaa9f86e-cbb0-4f30-9f32-d60e80d8ab5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea08e89d-ff66-4f65-a06b-2eb9fa005020', 'volume_name': 'volume-ea08e89d-ff66-4f65-a06b-2eb9fa005020', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:28:48 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-1fa66c1e-8c6c-4165-8855-6c3c4fb9b90e tempest-VolumesGetTest-1419827919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (922610da-c813-4116-a968-95fd11eb7839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:28:48 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-1fa66c1e-8c6c-4165-8855-6c3c4fb9b90e tempest-VolumesGetTest-1419827919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (922610da-c813-4116-a968-95fd11eb7839) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:28:48 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-1fa66c1e-8c6c-4165-8855-6c3c4fb9b90e tempest-VolumesGetTest-1419827919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5357f567-9c15-40d6-8385-54cc21e1212d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:28:48 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-1fa66c1e-8c6c-4165-8855-6c3c4fb9b90e tempest-VolumesGetTest-1419827919 None] Volume ea08e89d-ff66-4f65-a06b-2eb9fa005020: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea08e89d-ff66-4f65-a06b-2eb9fa005020', 'volume_size': 1} Jul 22 03:28:48 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-1fa66c1e-8c6c-4165-8855-6c3c4fb9b90e tempest-VolumesGetTest-1419827919 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:28:48 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-1fa66c1e-8c6c-4165-8855-6c3c4fb9b90e tempest-VolumesGetTest-1419827919 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:28:48 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-1fa66c1e-8c6c-4165-8855-6c3c4fb9b90e tempest-VolumesGetTest-1419827919 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:28:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-679805685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea08e89d-ff66-4f65-a06b-2eb9fa005020,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a3825839898349d585f9a61920bf5883',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:28:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:28:49Z,use_quota=True,user_id='a5e934656f2b40f3b0af6e623fe0c4a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:28:48 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-1fa66c1e-8c6c-4165-8855-6c3c4fb9b90e tempest-VolumesGetTest-1419827919 None] Creating volume ea08e89d-ff66-4f65-a06b-2eb9fa005020 {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:28:48 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-1fa66c1e-8c6c-4165-8855-6c3c4fb9b90e tempest-VolumesGetTest-1419827919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:28:48 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-1fa66c1e-8c6c-4165-8855-6c3c4fb9b90e tempest-VolumesGetTest-1419827919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:28:48 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-1fa66c1e-8c6c-4165-8855-6c3c4fb9b90e tempest-VolumesGetTest-1419827919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:28:48 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-1fa66c1e-8c6c-4165-8855-6c3c4fb9b90e tempest-VolumesGetTest-1419827919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:28:48 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-1fa66c1e-8c6c-4165-8855-6c3c4fb9b90e tempest-VolumesGetTest-1419827919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:28:48 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-1fa66c1e-8c6c-4165-8855-6c3c4fb9b90e tempest-VolumesGetTest-1419827919 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:28:48 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-1fa66c1e-8c6c-4165-8855-6c3c4fb9b90e tempest-VolumesGetTest-1419827919 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:28:48 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-1fa66c1e-8c6c-4165-8855-6c3c4fb9b90e tempest-VolumesGetTest-1419827919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ea08e89d-ff66-4f65-a06b-2eb9fa005020 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:28:48 devstack sudo[102076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ea08e89d-ff66-4f65-a06b-2eb9fa005020 1073741824 Jul 22 03:28:48 devstack sudo[102076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:28:49 devstack sudo[102076]: pam_unix(sudo:session): session closed for user root Jul 22 03:28:49 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-1fa66c1e-8c6c-4165-8855-6c3c4fb9b90e tempest-VolumesGetTest-1419827919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ea08e89d-ff66-4f65-a06b-2eb9fa005020 1073741824" returned: 0 in 0.422s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:28:49 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-1fa66c1e-8c6c-4165-8855-6c3c4fb9b90e tempest-VolumesGetTest-1419827919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ea08e89d-ff66-4f65-a06b-2eb9fa005020 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:28:49 devstack sudo[102081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ea08e89d-ff66-4f65-a06b-2eb9fa005020 Jul 22 03:28:49 devstack sudo[102081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:28:49 devstack sudo[102081]: pam_unix(sudo:session): session closed for user root Jul 22 03:28:49 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-1fa66c1e-8c6c-4165-8855-6c3c4fb9b90e tempest-VolumesGetTest-1419827919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ea08e89d-ff66-4f65-a06b-2eb9fa005020" returned: 0 in 0.245s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:28:49 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-1fa66c1e-8c6c-4165-8855-6c3c4fb9b90e tempest-VolumesGetTest-1419827919 None] <== create_volume: return (724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:28:49 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-1fa66c1e-8c6c-4165-8855-6c3c4fb9b90e tempest-VolumesGetTest-1419827919 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.726s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:28:49 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-1fa66c1e-8c6c-4165-8855-6c3c4fb9b90e tempest-VolumesGetTest-1419827919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5357f567-9c15-40d6-8385-54cc21e1212d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea08e89d-ff66-4f65-a06b-2eb9fa005020', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:28:49 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-1fa66c1e-8c6c-4165-8855-6c3c4fb9b90e tempest-VolumesGetTest-1419827919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1e1f243-8a8f-4d88-afe8-cf8229f3333e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:28:49 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-1fa66c1e-8c6c-4165-8855-6c3c4fb9b90e tempest-VolumesGetTest-1419827919 None] Volume volume-ea08e89d-ff66-4f65-a06b-2eb9fa005020 (ea08e89d-ff66-4f65-a06b-2eb9fa005020): created successfully Jul 22 03:28:49 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-1fa66c1e-8c6c-4165-8855-6c3c4fb9b90e tempest-VolumesGetTest-1419827919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1e1f243-8a8f-4d88-afe8-cf8229f3333e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:28:49 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-1fa66c1e-8c6c-4165-8855-6c3c4fb9b90e tempest-VolumesGetTest-1419827919 None] Flow 'volume_create_manager' (9c23e4d8-da83-48e2-95e9-0bb032480924) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:28:49 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-1fa66c1e-8c6c-4165-8855-6c3c4fb9b90e tempest-VolumesGetTest-1419827919 None] Created volume successfully. Jul 22 03:28:50 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-057a562f-b25a-42bf-94a4-7f1bd8638a42 tempest-VolumesGetTest-1419827919 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:28:50 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-057a562f-b25a-42bf-94a4-7f1bd8638a42 tempest-VolumesGetTest-1419827919 None] Flow 'volume_create_manager' (47488a6b-204b-4d01-a23d-85dc939b09bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:28:50 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-057a562f-b25a-42bf-94a4-7f1bd8638a42 tempest-VolumesGetTest-1419827919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6944ee7e-11ce-4622-8894-d75cc25bc33e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:28:50 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-057a562f-b25a-42bf-94a4-7f1bd8638a42 tempest-VolumesGetTest-1419827919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6944ee7e-11ce-4622-8894-d75cc25bc33e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:28:50Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-163985050',display_name='tempest-VolumesGetTest-Volume-694334055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe24efc8-7c06-4eea-b11f-3d454774170e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3825839898349d585f9a61920bf5883',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:28:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:28:50Z,use_quota=True,user_id='a5e934656f2b40f3b0af6e623fe0c4a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:28:50 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-057a562f-b25a-42bf-94a4-7f1bd8638a42 tempest-VolumesGetTest-1419827919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a130ef7-bcda-4096-9100-a77b1a7711a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:28:50 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-057a562f-b25a-42bf-94a4-7f1bd8638a42 tempest-VolumesGetTest-1419827919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a130ef7-bcda-4096-9100-a77b1a7711a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:28:50 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-057a562f-b25a-42bf-94a4-7f1bd8638a42 tempest-VolumesGetTest-1419827919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ea07e2e-8918-4a46-9f31-69908573c97c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:28:50 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-057a562f-b25a-42bf-94a4-7f1bd8638a42 tempest-VolumesGetTest-1419827919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ea07e2e-8918-4a46-9f31-69908573c97c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe24efc8-7c06-4eea-b11f-3d454774170e', 'volume_name': 'volume-fe24efc8-7c06-4eea-b11f-3d454774170e', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:28:50 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-057a562f-b25a-42bf-94a4-7f1bd8638a42 tempest-VolumesGetTest-1419827919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f62864f-4a47-4886-8f16-2cfdf47df162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:28:50 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-057a562f-b25a-42bf-94a4-7f1bd8638a42 tempest-VolumesGetTest-1419827919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f62864f-4a47-4886-8f16-2cfdf47df162) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:28:50 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-057a562f-b25a-42bf-94a4-7f1bd8638a42 tempest-VolumesGetTest-1419827919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (132919d4-d94d-40c5-a52f-9aae3328d8b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:28:50 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-057a562f-b25a-42bf-94a4-7f1bd8638a42 tempest-VolumesGetTest-1419827919 None] Volume fe24efc8-7c06-4eea-b11f-3d454774170e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe24efc8-7c06-4eea-b11f-3d454774170e', 'volume_size': 1} Jul 22 03:28:50 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-057a562f-b25a-42bf-94a4-7f1bd8638a42 tempest-VolumesGetTest-1419827919 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:28:50 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-057a562f-b25a-42bf-94a4-7f1bd8638a42 tempest-VolumesGetTest-1419827919 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:28:50 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-057a562f-b25a-42bf-94a4-7f1bd8638a42 tempest-VolumesGetTest-1419827919 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:28:50Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-163985050',display_name='tempest-VolumesGetTest-Volume-694334055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe24efc8-7c06-4eea-b11f-3d454774170e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3825839898349d585f9a61920bf5883',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:28:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:28:50Z,use_quota=True,user_id='a5e934656f2b40f3b0af6e623fe0c4a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:28:50 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-057a562f-b25a-42bf-94a4-7f1bd8638a42 tempest-VolumesGetTest-1419827919 None] Creating volume fe24efc8-7c06-4eea-b11f-3d454774170e {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:28:50 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-057a562f-b25a-42bf-94a4-7f1bd8638a42 tempest-VolumesGetTest-1419827919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:28:50 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-057a562f-b25a-42bf-94a4-7f1bd8638a42 tempest-VolumesGetTest-1419827919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:28:50 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-057a562f-b25a-42bf-94a4-7f1bd8638a42 tempest-VolumesGetTest-1419827919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:28:50 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-057a562f-b25a-42bf-94a4-7f1bd8638a42 tempest-VolumesGetTest-1419827919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:28:50 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-057a562f-b25a-42bf-94a4-7f1bd8638a42 tempest-VolumesGetTest-1419827919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:28:50 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-057a562f-b25a-42bf-94a4-7f1bd8638a42 tempest-VolumesGetTest-1419827919 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:28:50 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-057a562f-b25a-42bf-94a4-7f1bd8638a42 tempest-VolumesGetTest-1419827919 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:28:50 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-057a562f-b25a-42bf-94a4-7f1bd8638a42 tempest-VolumesGetTest-1419827919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-fe24efc8-7c06-4eea-b11f-3d454774170e 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:28:50 devstack sudo[102084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-fe24efc8-7c06-4eea-b11f-3d454774170e 1073741824 Jul 22 03:28:50 devstack sudo[102084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:28:50 devstack sudo[102084]: pam_unix(sudo:session): session closed for user root Jul 22 03:28:50 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-057a562f-b25a-42bf-94a4-7f1bd8638a42 tempest-VolumesGetTest-1419827919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-fe24efc8-7c06-4eea-b11f-3d454774170e 1073741824" returned: 0 in 0.387s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:28:50 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-057a562f-b25a-42bf-94a4-7f1bd8638a42 tempest-VolumesGetTest-1419827919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-fe24efc8-7c06-4eea-b11f-3d454774170e {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:28:50 devstack sudo[102089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-fe24efc8-7c06-4eea-b11f-3d454774170e Jul 22 03:28:50 devstack sudo[102089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:28:51 devstack sudo[102089]: pam_unix(sudo:session): session closed for user root Jul 22 03:28:51 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-057a562f-b25a-42bf-94a4-7f1bd8638a42 tempest-VolumesGetTest-1419827919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-fe24efc8-7c06-4eea-b11f-3d454774170e" returned: 0 in 0.233s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:28:51 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-057a562f-b25a-42bf-94a4-7f1bd8638a42 tempest-VolumesGetTest-1419827919 None] <== create_volume: return (659ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:28:51 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-057a562f-b25a-42bf-94a4-7f1bd8638a42 tempest-VolumesGetTest-1419827919 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.662s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:28:51 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-057a562f-b25a-42bf-94a4-7f1bd8638a42 tempest-VolumesGetTest-1419827919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (132919d4-d94d-40c5-a52f-9aae3328d8b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe24efc8-7c06-4eea-b11f-3d454774170e', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:28:51 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-057a562f-b25a-42bf-94a4-7f1bd8638a42 tempest-VolumesGetTest-1419827919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2844466b-5c29-4baa-830a-cbef63f35244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:28:51 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-057a562f-b25a-42bf-94a4-7f1bd8638a42 tempest-VolumesGetTest-1419827919 None] Volume volume-fe24efc8-7c06-4eea-b11f-3d454774170e (fe24efc8-7c06-4eea-b11f-3d454774170e): created successfully Jul 22 03:28:51 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-057a562f-b25a-42bf-94a4-7f1bd8638a42 tempest-VolumesGetTest-1419827919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2844466b-5c29-4baa-830a-cbef63f35244) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:28:51 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-057a562f-b25a-42bf-94a4-7f1bd8638a42 tempest-VolumesGetTest-1419827919 None] Flow 'volume_create_manager' (47488a6b-204b-4d01-a23d-85dc939b09bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:28:51 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-057a562f-b25a-42bf-94a4-7f1bd8638a42 tempest-VolumesGetTest-1419827919 None] Created volume successfully. Jul 22 03:28:51 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-07e28da8-e1cc-4409-b74d-5b0f1118b117 tempest-VolumesGetTest-1419827919 None] Acquiring lock "cinder-fe24efc8-7c06-4eea-b11f-3d454774170e-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:28:51 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-07e28da8-e1cc-4409-b74d-5b0f1118b117 tempest-VolumesGetTest-1419827919 None] Lock "cinder-fe24efc8-7c06-4eea-b11f-3d454774170e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:28:51 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-07e28da8-e1cc-4409-b74d-5b0f1118b117 tempest-VolumesGetTest-1419827919 None] Acquiring lock "cinder-quobyte-fe24efc8-7c06-4eea-b11f-3d454774170e" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:28:51 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-07e28da8-e1cc-4409-b74d-5b0f1118b117 tempest-VolumesGetTest-1419827919 None] Lock "cinder-quobyte-fe24efc8-7c06-4eea-b11f-3d454774170e" acquired by "delete_volume" :: waited 0.015s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:28:51 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7201ae3-8c75-4a69-b7cc-333b48368914]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:28:51 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-07e28da8-e1cc-4409-b74d-5b0f1118b117 tempest-VolumesGetTest-1419827919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-fe24efc8-7c06-4eea-b11f-3d454774170e {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:28:51 devstack sudo[102092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-fe24efc8-7c06-4eea-b11f-3d454774170e Jul 22 03:28:51 devstack sudo[102092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:28:51 devstack sudo[102092]: pam_unix(sudo:session): session closed for user root Jul 22 03:28:51 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-07e28da8-e1cc-4409-b74d-5b0f1118b117 tempest-VolumesGetTest-1419827919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-fe24efc8-7c06-4eea-b11f-3d454774170e" returned: 0 in 0.345s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:28:51 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-07e28da8-e1cc-4409-b74d-5b0f1118b117 tempest-VolumesGetTest-1419827919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-fe24efc8-7c06-4eea-b11f-3d454774170e {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:28:51 devstack sudo[102097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-fe24efc8-7c06-4eea-b11f-3d454774170e Jul 22 03:28:51 devstack sudo[102097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:28:52 devstack sudo[102097]: pam_unix(sudo:session): session closed for user root Jul 22 03:28:52 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-07e28da8-e1cc-4409-b74d-5b0f1118b117 tempest-VolumesGetTest-1419827919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-fe24efc8-7c06-4eea-b11f-3d454774170e" returned: 0 in 0.234s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:28:52 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-07e28da8-e1cc-4409-b74d-5b0f1118b117 tempest-VolumesGetTest-1419827919 None] Lock "cinder-quobyte-fe24efc8-7c06-4eea-b11f-3d454774170e" released by "delete_volume" :: held 0.615s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:28:52 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-07e28da8-e1cc-4409-b74d-5b0f1118b117 tempest-VolumesGetTest-1419827919 None] Created reservations ['5c268ea5-ed6d-457b-810f-07677dbf209d', '7a0a6743-8037-4949-95d7-23365b41553d', '5fddca96-88dc-408b-9ebb-86fd0b6613fc', 'daea76ee-a4bd-4fc0-9778-b6b82363c799'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:28:52 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-07e28da8-e1cc-4409-b74d-5b0f1118b117 tempest-VolumesGetTest-1419827919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:28:52 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-07e28da8-e1cc-4409-b74d-5b0f1118b117 tempest-VolumesGetTest-1419827919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:28:52 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-07e28da8-e1cc-4409-b74d-5b0f1118b117 tempest-VolumesGetTest-1419827919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:28:52 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-07e28da8-e1cc-4409-b74d-5b0f1118b117 tempest-VolumesGetTest-1419827919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:28:52 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-07e28da8-e1cc-4409-b74d-5b0f1118b117 tempest-VolumesGetTest-1419827919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:28:52 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-07e28da8-e1cc-4409-b74d-5b0f1118b117 tempest-VolumesGetTest-1419827919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:28:52 devstack sudo[102100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:28:52 devstack sudo[102100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:28:52 devstack sudo[102100]: pam_unix(sudo:session): session closed for user root Jul 22 03:28:52 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-07e28da8-e1cc-4409-b74d-5b0f1118b117 tempest-VolumesGetTest-1419827919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.239s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:28:52 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-07e28da8-e1cc-4409-b74d-5b0f1118b117 tempest-VolumesGetTest-1419827919 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:28:52 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-07e28da8-e1cc-4409-b74d-5b0f1118b117 tempest-VolumesGetTest-1419827919 None] Deleted volume successfully. Jul 22 03:28:52 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-07e28da8-e1cc-4409-b74d-5b0f1118b117 tempest-VolumesGetTest-1419827919 None] Lock "cinder-fe24efc8-7c06-4eea-b11f-3d454774170e-delete_volume" released by "delete_volume" :: held 1.039s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:28:52 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-e13e82ef-80c6-4f57-8c80-57f48ecec4ce tempest-VolumesGetTest-1419827919 None] Acquiring lock "cinder-ea08e89d-ff66-4f65-a06b-2eb9fa005020-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:28:52 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-e13e82ef-80c6-4f57-8c80-57f48ecec4ce tempest-VolumesGetTest-1419827919 None] Lock "cinder-ea08e89d-ff66-4f65-a06b-2eb9fa005020-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:28:52 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-e13e82ef-80c6-4f57-8c80-57f48ecec4ce tempest-VolumesGetTest-1419827919 None] Acquiring lock "cinder-quobyte-ea08e89d-ff66-4f65-a06b-2eb9fa005020" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:28:52 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-e13e82ef-80c6-4f57-8c80-57f48ecec4ce tempest-VolumesGetTest-1419827919 None] Lock "cinder-quobyte-ea08e89d-ff66-4f65-a06b-2eb9fa005020" acquired by "delete_volume" :: waited 0.014s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:28:52 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9dbc7b2-b796-4cc9-8e55-e3451eed1173]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:28:52 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-e13e82ef-80c6-4f57-8c80-57f48ecec4ce tempest-VolumesGetTest-1419827919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ea08e89d-ff66-4f65-a06b-2eb9fa005020 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:28:52 devstack sudo[102103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ea08e89d-ff66-4f65-a06b-2eb9fa005020 Jul 22 03:28:52 devstack sudo[102103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:28:53 devstack sudo[102103]: pam_unix(sudo:session): session closed for user root Jul 22 03:28:53 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-e13e82ef-80c6-4f57-8c80-57f48ecec4ce tempest-VolumesGetTest-1419827919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ea08e89d-ff66-4f65-a06b-2eb9fa005020" returned: 0 in 0.347s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:28:53 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-e13e82ef-80c6-4f57-8c80-57f48ecec4ce tempest-VolumesGetTest-1419827919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ea08e89d-ff66-4f65-a06b-2eb9fa005020 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:28:53 devstack sudo[102108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ea08e89d-ff66-4f65-a06b-2eb9fa005020 Jul 22 03:28:53 devstack sudo[102108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:28:53 devstack sudo[102108]: pam_unix(sudo:session): session closed for user root Jul 22 03:28:53 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-e13e82ef-80c6-4f57-8c80-57f48ecec4ce tempest-VolumesGetTest-1419827919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-ea08e89d-ff66-4f65-a06b-2eb9fa005020" returned: 0 in 0.239s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:28:53 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-e13e82ef-80c6-4f57-8c80-57f48ecec4ce tempest-VolumesGetTest-1419827919 None] Lock "cinder-quobyte-ea08e89d-ff66-4f65-a06b-2eb9fa005020" released by "delete_volume" :: held 0.624s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:28:53 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-e13e82ef-80c6-4f57-8c80-57f48ecec4ce tempest-VolumesGetTest-1419827919 None] Created reservations ['907409ca-3f5a-4ce2-abd7-a290a446b72a', '0cb45404-f679-4bb5-a774-b9ab6b718650', '3d06ee99-5bdb-4202-8164-2618a3e7a1f5', 'ec56b785-79c6-4fa0-b8db-6dc615ec4b58'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:28:53 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-e13e82ef-80c6-4f57-8c80-57f48ecec4ce tempest-VolumesGetTest-1419827919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:28:53 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-e13e82ef-80c6-4f57-8c80-57f48ecec4ce tempest-VolumesGetTest-1419827919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:28:53 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-e13e82ef-80c6-4f57-8c80-57f48ecec4ce tempest-VolumesGetTest-1419827919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:28:53 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-e13e82ef-80c6-4f57-8c80-57f48ecec4ce tempest-VolumesGetTest-1419827919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:28:53 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-e13e82ef-80c6-4f57-8c80-57f48ecec4ce tempest-VolumesGetTest-1419827919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:28:53 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-e13e82ef-80c6-4f57-8c80-57f48ecec4ce tempest-VolumesGetTest-1419827919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:28:53 devstack sudo[102112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:28:53 devstack sudo[102112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:28:53 devstack sudo[102112]: pam_unix(sudo:session): session closed for user root Jul 22 03:28:53 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-e13e82ef-80c6-4f57-8c80-57f48ecec4ce tempest-VolumesGetTest-1419827919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.233s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:28:53 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-e13e82ef-80c6-4f57-8c80-57f48ecec4ce tempest-VolumesGetTest-1419827919 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:28:53 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-e13e82ef-80c6-4f57-8c80-57f48ecec4ce tempest-VolumesGetTest-1419827919 None] Deleted volume successfully. Jul 22 03:28:53 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-e13e82ef-80c6-4f57-8c80-57f48ecec4ce tempest-VolumesGetTest-1419827919 None] Lock "cinder-ea08e89d-ff66-4f65-a06b-2eb9fa005020-delete_volume" released by "delete_volume" :: held 1.036s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:28:54 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc2bed96-7e1d-474c-af7e-c9e1cdd4d63d tempest-VolumesGetTest-1419827919 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:28:54 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-dc2bed96-7e1d-474c-af7e-c9e1cdd4d63d tempest-VolumesGetTest-1419827919 None] Flow 'volume_create_manager' (5d00121c-225a-4855-80d3-06cc55c37cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:28:54 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-dc2bed96-7e1d-474c-af7e-c9e1cdd4d63d tempest-VolumesGetTest-1419827919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f5270c7-d505-4c2e-97fa-59fced91231f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:28:54 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-dc2bed96-7e1d-474c-af7e-c9e1cdd4d63d tempest-VolumesGetTest-1419827919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f5270c7-d505-4c2e-97fa-59fced91231f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:28:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1096881694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cc1abb8-6389-4439-9f43-81b67863c03b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3825839898349d585f9a61920bf5883',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:28:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:28:54Z,use_quota=True,user_id='a5e934656f2b40f3b0af6e623fe0c4a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:28:54 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-dc2bed96-7e1d-474c-af7e-c9e1cdd4d63d tempest-VolumesGetTest-1419827919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (213ff4fc-2b6e-4585-9811-a2a49aa16700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:28:54 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-dc2bed96-7e1d-474c-af7e-c9e1cdd4d63d tempest-VolumesGetTest-1419827919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (213ff4fc-2b6e-4585-9811-a2a49aa16700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:28:54 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-dc2bed96-7e1d-474c-af7e-c9e1cdd4d63d tempest-VolumesGetTest-1419827919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d6137b1-c7e9-48a2-ae76-860b3fa51699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:28:54 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-dc2bed96-7e1d-474c-af7e-c9e1cdd4d63d tempest-VolumesGetTest-1419827919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d6137b1-c7e9-48a2-ae76-860b3fa51699) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8cc1abb8-6389-4439-9f43-81b67863c03b', 'volume_name': 'volume-8cc1abb8-6389-4439-9f43-81b67863c03b', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:28:54 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-dc2bed96-7e1d-474c-af7e-c9e1cdd4d63d tempest-VolumesGetTest-1419827919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d80c2ce9-b63a-4e82-a15f-aa8b01ef4558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:28:54 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-dc2bed96-7e1d-474c-af7e-c9e1cdd4d63d tempest-VolumesGetTest-1419827919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d80c2ce9-b63a-4e82-a15f-aa8b01ef4558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:28:54 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-dc2bed96-7e1d-474c-af7e-c9e1cdd4d63d tempest-VolumesGetTest-1419827919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (129ded47-24a3-47b1-8e0d-454efc8b419c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:28:54 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-dc2bed96-7e1d-474c-af7e-c9e1cdd4d63d tempest-VolumesGetTest-1419827919 None] Volume 8cc1abb8-6389-4439-9f43-81b67863c03b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8cc1abb8-6389-4439-9f43-81b67863c03b', 'volume_size': 1} Jul 22 03:28:54 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-dc2bed96-7e1d-474c-af7e-c9e1cdd4d63d tempest-VolumesGetTest-1419827919 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:28:54 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-dc2bed96-7e1d-474c-af7e-c9e1cdd4d63d tempest-VolumesGetTest-1419827919 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:28:54 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-dc2bed96-7e1d-474c-af7e-c9e1cdd4d63d tempest-VolumesGetTest-1419827919 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:28:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1096881694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cc1abb8-6389-4439-9f43-81b67863c03b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3825839898349d585f9a61920bf5883',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:28:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:28:54Z,use_quota=True,user_id='a5e934656f2b40f3b0af6e623fe0c4a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:28:54 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-dc2bed96-7e1d-474c-af7e-c9e1cdd4d63d tempest-VolumesGetTest-1419827919 None] Creating volume 8cc1abb8-6389-4439-9f43-81b67863c03b {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:28:54 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-dc2bed96-7e1d-474c-af7e-c9e1cdd4d63d tempest-VolumesGetTest-1419827919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:28:54 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-dc2bed96-7e1d-474c-af7e-c9e1cdd4d63d tempest-VolumesGetTest-1419827919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:28:54 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-dc2bed96-7e1d-474c-af7e-c9e1cdd4d63d tempest-VolumesGetTest-1419827919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:28:54 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-dc2bed96-7e1d-474c-af7e-c9e1cdd4d63d tempest-VolumesGetTest-1419827919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:28:54 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-dc2bed96-7e1d-474c-af7e-c9e1cdd4d63d tempest-VolumesGetTest-1419827919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:28:54 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-dc2bed96-7e1d-474c-af7e-c9e1cdd4d63d tempest-VolumesGetTest-1419827919 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:28:54 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-dc2bed96-7e1d-474c-af7e-c9e1cdd4d63d tempest-VolumesGetTest-1419827919 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:28:54 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-dc2bed96-7e1d-474c-af7e-c9e1cdd4d63d tempest-VolumesGetTest-1419827919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-8cc1abb8-6389-4439-9f43-81b67863c03b 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:28:54 devstack sudo[102115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-8cc1abb8-6389-4439-9f43-81b67863c03b 1073741824 Jul 22 03:28:54 devstack sudo[102115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:28:54 devstack sudo[102115]: pam_unix(sudo:session): session closed for user root Jul 22 03:28:54 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-dc2bed96-7e1d-474c-af7e-c9e1cdd4d63d tempest-VolumesGetTest-1419827919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-8cc1abb8-6389-4439-9f43-81b67863c03b 1073741824" returned: 0 in 0.412s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:28:54 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-dc2bed96-7e1d-474c-af7e-c9e1cdd4d63d tempest-VolumesGetTest-1419827919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-8cc1abb8-6389-4439-9f43-81b67863c03b {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:28:54 devstack sudo[102120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-8cc1abb8-6389-4439-9f43-81b67863c03b Jul 22 03:28:54 devstack sudo[102120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:28:55 devstack sudo[102120]: pam_unix(sudo:session): session closed for user root Jul 22 03:28:55 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-dc2bed96-7e1d-474c-af7e-c9e1cdd4d63d tempest-VolumesGetTest-1419827919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-8cc1abb8-6389-4439-9f43-81b67863c03b" returned: 0 in 0.234s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:28:55 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-dc2bed96-7e1d-474c-af7e-c9e1cdd4d63d tempest-VolumesGetTest-1419827919 None] <== create_volume: return (686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:28:55 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-dc2bed96-7e1d-474c-af7e-c9e1cdd4d63d tempest-VolumesGetTest-1419827919 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.688s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:28:55 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-dc2bed96-7e1d-474c-af7e-c9e1cdd4d63d tempest-VolumesGetTest-1419827919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (129ded47-24a3-47b1-8e0d-454efc8b419c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8cc1abb8-6389-4439-9f43-81b67863c03b', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:28:55 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-dc2bed96-7e1d-474c-af7e-c9e1cdd4d63d tempest-VolumesGetTest-1419827919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1d2d5a2-2c60-4536-be2c-019dd0f514c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:28:55 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-dc2bed96-7e1d-474c-af7e-c9e1cdd4d63d tempest-VolumesGetTest-1419827919 None] Volume volume-8cc1abb8-6389-4439-9f43-81b67863c03b (8cc1abb8-6389-4439-9f43-81b67863c03b): created successfully Jul 22 03:28:55 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-dc2bed96-7e1d-474c-af7e-c9e1cdd4d63d tempest-VolumesGetTest-1419827919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1d2d5a2-2c60-4536-be2c-019dd0f514c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:28:55 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-dc2bed96-7e1d-474c-af7e-c9e1cdd4d63d tempest-VolumesGetTest-1419827919 None] Flow 'volume_create_manager' (5d00121c-225a-4855-80d3-06cc55c37cfa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:28:55 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-dc2bed96-7e1d-474c-af7e-c9e1cdd4d63d tempest-VolumesGetTest-1419827919 None] Created volume successfully. Jul 22 03:28:55 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-634c8b50-5c67-4544-8028-ea88391feff9 tempest-VolumesGetTest-1419827919 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:28:55 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-634c8b50-5c67-4544-8028-ea88391feff9 tempest-VolumesGetTest-1419827919 None] Flow 'volume_create_manager' (a7243825-a823-49e6-b390-bd71d0bc1d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:28:55 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-634c8b50-5c67-4544-8028-ea88391feff9 tempest-VolumesGetTest-1419827919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3101b319-7512-4cb5-a386-0223e638e985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:28:55 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-634c8b50-5c67-4544-8028-ea88391feff9 tempest-VolumesGetTest-1419827919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3101b319-7512-4cb5-a386-0223e638e985) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:28:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2066737431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f931d02-9bd8-4851-bfa5-1094e9f05912,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a3825839898349d585f9a61920bf5883',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:28:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=8cc1abb8-6389-4439-9f43-81b67863c03b,status='creating',terminated_at=None,updated_at=2026-07-22T01:28:56Z,use_quota=True,user_id='a5e934656f2b40f3b0af6e623fe0c4a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:28:55 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-634c8b50-5c67-4544-8028-ea88391feff9 tempest-VolumesGetTest-1419827919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0877d369-553b-4ccf-8909-b4876d7b4789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:28:55 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-634c8b50-5c67-4544-8028-ea88391feff9 tempest-VolumesGetTest-1419827919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0877d369-553b-4ccf-8909-b4876d7b4789) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:28:55 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-634c8b50-5c67-4544-8028-ea88391feff9 tempest-VolumesGetTest-1419827919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (572d2c97-7e48-4a97-b2aa-280646b4e918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:28:55 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-634c8b50-5c67-4544-8028-ea88391feff9 tempest-VolumesGetTest-1419827919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (572d2c97-7e48-4a97-b2aa-280646b4e918) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '0f931d02-9bd8-4851-bfa5-1094e9f05912', 'volume_name': 'volume-0f931d02-9bd8-4851-bfa5-1094e9f05912', 'volume_size': 1, 'source_volid': '8cc1abb8-6389-4439-9f43-81b67863c03b', 'source_volstatus': 'available'}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:28:55 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-634c8b50-5c67-4544-8028-ea88391feff9 tempest-VolumesGetTest-1419827919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c09cdc2-6224-4451-9fcc-b0ac2068eba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:28:55 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-634c8b50-5c67-4544-8028-ea88391feff9 tempest-VolumesGetTest-1419827919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c09cdc2-6224-4451-9fcc-b0ac2068eba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:28:55 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-634c8b50-5c67-4544-8028-ea88391feff9 tempest-VolumesGetTest-1419827919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66dbb849-50ec-4d41-afe5-2dcca0677fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:28:55 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-634c8b50-5c67-4544-8028-ea88391feff9 tempest-VolumesGetTest-1419827919 None] Volume 0f931d02-9bd8-4851-bfa5-1094e9f05912: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-0f931d02-9bd8-4851-bfa5-1094e9f05912', 'volume_size': 1, 'source_volid': '8cc1abb8-6389-4439-9f43-81b67863c03b', 'source_volstatus': 'available'} Jul 22 03:28:55 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-634c8b50-5c67-4544-8028-ea88391feff9 tempest-VolumesGetTest-1419827919 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:28:55 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-634c8b50-5c67-4544-8028-ea88391feff9 tempest-VolumesGetTest-1419827919 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:28:55 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-634c8b50-5c67-4544-8028-ea88391feff9 tempest-VolumesGetTest-1419827919 None] Cloning volume 8cc1abb8-6389-4439-9f43-81b67863c03b to volume 0f931d02-9bd8-4851-bfa5-1094e9f05912 Jul 22 03:28:55 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-634c8b50-5c67-4544-8028-ea88391feff9 tempest-VolumesGetTest-1419827919 None] Creating offline snapshot 352c4d5b-67ad-4696-8177-fb21c0ba75f7 of volume 8cc1abb8-6389-4439-9f43-81b67863c03b {{(pid=87747) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 03:28:55 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[57cbab9b-de32-4ef8-98a8-9d8e59e34ee9]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:28:55 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-634c8b50-5c67-4544-8028-ea88391feff9 tempest-VolumesGetTest-1419827919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-8cc1abb8-6389-4439-9f43-81b67863c03b {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:28:56 devstack sudo[102123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-8cc1abb8-6389-4439-9f43-81b67863c03b Jul 22 03:28:56 devstack sudo[102123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:28:56 devstack sudo[102123]: pam_unix(sudo:session): session closed for user root Jul 22 03:28:56 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-634c8b50-5c67-4544-8028-ea88391feff9 tempest-VolumesGetTest-1419827919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-8cc1abb8-6389-4439-9f43-81b67863c03b" returned: 0 in 0.347s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:28:56 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-634c8b50-5c67-4544-8028-ea88391feff9 tempest-VolumesGetTest-1419827919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-8cc1abb8-6389-4439-9f43-81b67863c03b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-8cc1abb8-6389-4439-9f43-81b67863c03b.352c4d5b-67ad-4696-8177-fb21c0ba75f7 1G {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:28:56 devstack sudo[102129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-8cc1abb8-6389-4439-9f43-81b67863c03b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-8cc1abb8-6389-4439-9f43-81b67863c03b.352c4d5b-67ad-4696-8177-fb21c0ba75f7 1G Jul 22 03:28:56 devstack sudo[102129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:28:56 devstack sudo[102129]: pam_unix(sudo:session): session closed for user root Jul 22 03:28:56 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-634c8b50-5c67-4544-8028-ea88391feff9 tempest-VolumesGetTest-1419827919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-8cc1abb8-6389-4439-9f43-81b67863c03b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-8cc1abb8-6389-4439-9f43-81b67863c03b.352c4d5b-67ad-4696-8177-fb21c0ba75f7 1G" returned: 0 in 0.386s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:28:56 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-634c8b50-5c67-4544-8028-ea88391feff9 tempest-VolumesGetTest-1419827919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8cc1abb8-6389-4439-9f43-81b67863c03b -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-8cc1abb8-6389-4439-9f43-81b67863c03b.352c4d5b-67ad-4696-8177-fb21c0ba75f7 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:28:56 devstack sudo[102134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8cc1abb8-6389-4439-9f43-81b67863c03b -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-8cc1abb8-6389-4439-9f43-81b67863c03b.352c4d5b-67ad-4696-8177-fb21c0ba75f7 Jul 22 03:28:56 devstack sudo[102134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:28:56 devstack sudo[102134]: pam_unix(sudo:session): session closed for user root Jul 22 03:28:56 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-634c8b50-5c67-4544-8028-ea88391feff9 tempest-VolumesGetTest-1419827919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8cc1abb8-6389-4439-9f43-81b67863c03b -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-8cc1abb8-6389-4439-9f43-81b67863c03b.352c4d5b-67ad-4696-8177-fb21c0ba75f7" returned: 0 in 0.288s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:28:56 devstack cinder-volume[87747]: WARNING cinder.volume.drivers.remotefs [None req-634c8b50-5c67-4544-8028-ea88391feff9 tempest-VolumesGetTest-1419827919 None] /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-8cc1abb8-6389-4439-9f43-81b67863c03b.352c4d5b-67ad-4696-8177-fb21c0ba75f7 is being set with open permissions: ugo+rw Jul 22 03:28:56 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-634c8b50-5c67-4544-8028-ea88391feff9 tempest-VolumesGetTest-1419827919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-8cc1abb8-6389-4439-9f43-81b67863c03b.352c4d5b-67ad-4696-8177-fb21c0ba75f7 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:28:56 devstack sudo[102139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-8cc1abb8-6389-4439-9f43-81b67863c03b.352c4d5b-67ad-4696-8177-fb21c0ba75f7 Jul 22 03:28:56 devstack sudo[102139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:28:57 devstack sudo[102139]: pam_unix(sudo:session): session closed for user root Jul 22 03:28:57 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-634c8b50-5c67-4544-8028-ea88391feff9 tempest-VolumesGetTest-1419827919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-8cc1abb8-6389-4439-9f43-81b67863c03b.352c4d5b-67ad-4696-8177-fb21c0ba75f7" returned: 0 in 0.236s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:28:57 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-634c8b50-5c67-4544-8028-ea88391feff9 tempest-VolumesGetTest-1419827919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-8cc1abb8-6389-4439-9f43-81b67863c03b.info {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:28:57 devstack sudo[102142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-8cc1abb8-6389-4439-9f43-81b67863c03b.info Jul 22 03:28:57 devstack sudo[102142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:28:57 devstack sudo[102142]: pam_unix(sudo:session): session closed for user root Jul 22 03:28:57 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-634c8b50-5c67-4544-8028-ea88391feff9 tempest-VolumesGetTest-1419827919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-8cc1abb8-6389-4439-9f43-81b67863c03b.info" returned: 0 in 0.246s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:28:57 devstack cinder-volume[87747]: WARNING cinder.volume.drivers.remotefs [None req-634c8b50-5c67-4544-8028-ea88391feff9 tempest-VolumesGetTest-1419827919 None] /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-8cc1abb8-6389-4439-9f43-81b67863c03b.info is being set with open permissions: ugo+rw Jul 22 03:28:57 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-634c8b50-5c67-4544-8028-ea88391feff9 tempest-VolumesGetTest-1419827919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-8cc1abb8-6389-4439-9f43-81b67863c03b.info {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:28:57 devstack sudo[102145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-8cc1abb8-6389-4439-9f43-81b67863c03b.info Jul 22 03:28:57 devstack sudo[102145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:28:57 devstack sudo[102145]: pam_unix(sudo:session): session closed for user root Jul 22 03:28:57 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-634c8b50-5c67-4544-8028-ea88391feff9 tempest-VolumesGetTest-1419827919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-8cc1abb8-6389-4439-9f43-81b67863c03b.info" returned: 0 in 0.239s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:28:57 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-634c8b50-5c67-4544-8028-ea88391feff9 tempest-VolumesGetTest-1419827919 None] Acquiring lock "cinder-quobyte-0f931d02-9bd8-4851-bfa5-1094e9f05912" by "_copy_volume_from_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:28:57 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-634c8b50-5c67-4544-8028-ea88391feff9 tempest-VolumesGetTest-1419827919 None] Lock "cinder-quobyte-0f931d02-9bd8-4851-bfa5-1094e9f05912" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:28:57 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-634c8b50-5c67-4544-8028-ea88391feff9 tempest-VolumesGetTest-1419827919 None] snapshot: 352c4d5b-67ad-4696-8177-fb21c0ba75f7, volume: 0f931d02-9bd8-4851-bfa5-1094e9f05912, {{(pid=87747) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 22 03:28:57 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-634c8b50-5c67-4544-8028-ea88391feff9 tempest-VolumesGetTest-1419827919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:28:57 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-634c8b50-5c67-4544-8028-ea88391feff9 tempest-VolumesGetTest-1419827919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:28:57 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-634c8b50-5c67-4544-8028-ea88391feff9 tempest-VolumesGetTest-1419827919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:28:57 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-634c8b50-5c67-4544-8028-ea88391feff9 tempest-VolumesGetTest-1419827919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:28:57 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-634c8b50-5c67-4544-8028-ea88391feff9 tempest-VolumesGetTest-1419827919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:28:57 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[aad0248c-a0ed-441d-9225-a2f2ad55b08e]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:28:57 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-634c8b50-5c67-4544-8028-ea88391feff9 tempest-VolumesGetTest-1419827919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-8cc1abb8-6389-4439-9f43-81b67863c03b.352c4d5b-67ad-4696-8177-fb21c0ba75f7 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:28:57 devstack sudo[102148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-8cc1abb8-6389-4439-9f43-81b67863c03b.352c4d5b-67ad-4696-8177-fb21c0ba75f7 Jul 22 03:28:57 devstack sudo[102148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:28:58 devstack sudo[102148]: pam_unix(sudo:session): session closed for user root Jul 22 03:28:58 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-634c8b50-5c67-4544-8028-ea88391feff9 tempest-VolumesGetTest-1419827919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-8cc1abb8-6389-4439-9f43-81b67863c03b.352c4d5b-67ad-4696-8177-fb21c0ba75f7" returned: 0 in 0.343s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:28:58 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-634c8b50-5c67-4544-8028-ea88391feff9 tempest-VolumesGetTest-1419827919 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8cc1abb8-6389-4439-9f43-81b67863c03b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87747) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 03:28:58 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-634c8b50-5c67-4544-8028-ea88391feff9 tempest-VolumesGetTest-1419827919 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-8cc1abb8-6389-4439-9f43-81b67863c03b {{(pid=87747) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 22 03:28:58 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-634c8b50-5c67-4544-8028-ea88391feff9 tempest-VolumesGetTest-1419827919 None] Creating direct copy from snapshot {{(pid=87747) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 22 03:28:58 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffbb26f9-905e-49cf-8bb2-3cfc5fd7fc9a]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:28:58 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-634c8b50-5c67-4544-8028-ea88391feff9 tempest-VolumesGetTest-1419827919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-8cc1abb8-6389-4439-9f43-81b67863c03b {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:28:58 devstack sudo[102153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-8cc1abb8-6389-4439-9f43-81b67863c03b Jul 22 03:28:58 devstack sudo[102153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:28:58 devstack sudo[102153]: pam_unix(sudo:session): session closed for user root Jul 22 03:28:58 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-634c8b50-5c67-4544-8028-ea88391feff9 tempest-VolumesGetTest-1419827919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-8cc1abb8-6389-4439-9f43-81b67863c03b" returned: 0 in 0.350s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:28:58 devstack cinder-volume[87747]: DEBUG cinder.utils [None req-634c8b50-5c67-4544-8028-ea88391feff9 tempest-VolumesGetTest-1419827919 None] Path /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0f931d02-9bd8-4851-bfa5-1094e9f05912 not found in is_blk_device check {{(pid=87747) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 22 03:28:58 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-634c8b50-5c67-4544-8028-ea88391feff9 tempest-VolumesGetTest-1419827919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-8cc1abb8-6389-4439-9f43-81b67863c03b /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0f931d02-9bd8-4851-bfa5-1094e9f05912 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:28:58 devstack sudo[102158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-8cc1abb8-6389-4439-9f43-81b67863c03b /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0f931d02-9bd8-4851-bfa5-1094e9f05912 Jul 22 03:28:58 devstack sudo[102158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:29:02 devstack sudo[102158]: pam_unix(sudo:session): session closed for user root Jul 22 03:29:02 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-634c8b50-5c67-4544-8028-ea88391feff9 tempest-VolumesGetTest-1419827919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-8cc1abb8-6389-4439-9f43-81b67863c03b /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0f931d02-9bd8-4851-bfa5-1094e9f05912" returned: 0 in 3.977s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:29:02 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[7951a662-6368-4f41-9c43-f5764f4fcceb]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:29:02 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-634c8b50-5c67-4544-8028-ea88391feff9 tempest-VolumesGetTest-1419827919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-8cc1abb8-6389-4439-9f43-81b67863c03b {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:29:02 devstack sudo[102173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-8cc1abb8-6389-4439-9f43-81b67863c03b Jul 22 03:29:02 devstack sudo[102173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:29:02 devstack sudo[102173]: pam_unix(sudo:session): session closed for user root Jul 22 03:29:02 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-634c8b50-5c67-4544-8028-ea88391feff9 tempest-VolumesGetTest-1419827919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-8cc1abb8-6389-4439-9f43-81b67863c03b" returned: 0 in 0.523s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:29:02 devstack cinder-volume[87747]: DEBUG cinder.image.image_utils [None req-634c8b50-5c67-4544-8028-ea88391feff9 tempest-VolumesGetTest-1419827919 None] Image conversion details: src /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-8cc1abb8-6389-4439-9f43-81b67863c03b, size 1024.00 MB, duration 3.98 sec, destination /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0f931d02-9bd8-4851-bfa5-1094e9f05912 {{(pid=87747) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 22 03:29:02 devstack cinder-volume[87747]: INFO cinder.image.image_utils [None req-634c8b50-5c67-4544-8028-ea88391feff9 tempest-VolumesGetTest-1419827919 None] Converted 1024.00 MB image at 257.37 MB/s Jul 22 03:29:02 devstack cinder-volume[87747]: WARNING cinder.volume.drivers.remotefs [None req-634c8b50-5c67-4544-8028-ea88391feff9 tempest-VolumesGetTest-1419827919 None] /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0f931d02-9bd8-4851-bfa5-1094e9f05912 is being set with open permissions: ugo+rw Jul 22 03:29:02 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-634c8b50-5c67-4544-8028-ea88391feff9 tempest-VolumesGetTest-1419827919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0f931d02-9bd8-4851-bfa5-1094e9f05912 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:29:03 devstack sudo[102178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0f931d02-9bd8-4851-bfa5-1094e9f05912 Jul 22 03:29:03 devstack sudo[102178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:29:03 devstack sudo[102178]: pam_unix(sudo:session): session closed for user root Jul 22 03:29:03 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-634c8b50-5c67-4544-8028-ea88391feff9 tempest-VolumesGetTest-1419827919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0f931d02-9bd8-4851-bfa5-1094e9f05912" returned: 0 in 0.239s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:29:03 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-634c8b50-5c67-4544-8028-ea88391feff9 tempest-VolumesGetTest-1419827919 None] Lock "cinder-quobyte-0f931d02-9bd8-4851-bfa5-1094e9f05912" released by "_copy_volume_from_snapshot" :: held 5.512s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:29:03 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-634c8b50-5c67-4544-8028-ea88391feff9 tempest-VolumesGetTest-1419827919 None] Acquiring lock "cinder-quobyte-352c4d5b-67ad-4696-8177-fb21c0ba75f7" by "_delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:29:03 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-634c8b50-5c67-4544-8028-ea88391feff9 tempest-VolumesGetTest-1419827919 None] Lock "cinder-quobyte-352c4d5b-67ad-4696-8177-fb21c0ba75f7" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:29:03 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-634c8b50-5c67-4544-8028-ea88391feff9 tempest-VolumesGetTest-1419827919 None] Deleting offline snapshot 352c4d5b-67ad-4696-8177-fb21c0ba75f7 of volume 8cc1abb8-6389-4439-9f43-81b67863c03b {{(pid=87747) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 03:29:03 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-634c8b50-5c67-4544-8028-ea88391feff9 tempest-VolumesGetTest-1419827919 None] snapshot_file for this snap is: volume-8cc1abb8-6389-4439-9f43-81b67863c03b.352c4d5b-67ad-4696-8177-fb21c0ba75f7 {{(pid=87747) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 03:29:03 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[fccb0fa5-f7e9-4a82-bf51-918a6ec5617b]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:29:03 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-634c8b50-5c67-4544-8028-ea88391feff9 tempest-VolumesGetTest-1419827919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-8cc1abb8-6389-4439-9f43-81b67863c03b.352c4d5b-67ad-4696-8177-fb21c0ba75f7 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:29:03 devstack sudo[102182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-8cc1abb8-6389-4439-9f43-81b67863c03b.352c4d5b-67ad-4696-8177-fb21c0ba75f7 Jul 22 03:29:03 devstack sudo[102182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:29:03 devstack sudo[102182]: pam_unix(sudo:session): session closed for user root Jul 22 03:29:03 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-634c8b50-5c67-4544-8028-ea88391feff9 tempest-VolumesGetTest-1419827919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-8cc1abb8-6389-4439-9f43-81b67863c03b.352c4d5b-67ad-4696-8177-fb21c0ba75f7" returned: 0 in 0.345s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:29:03 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-634c8b50-5c67-4544-8028-ea88391feff9 tempest-VolumesGetTest-1419827919 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8cc1abb8-6389-4439-9f43-81b67863c03b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87747) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 03:29:03 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[77cc3baf-d04b-4b1e-9bda-676c5330cafe]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:29:03 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-634c8b50-5c67-4544-8028-ea88391feff9 tempest-VolumesGetTest-1419827919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-8cc1abb8-6389-4439-9f43-81b67863c03b {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:29:03 devstack sudo[102187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-8cc1abb8-6389-4439-9f43-81b67863c03b Jul 22 03:29:03 devstack sudo[102187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:29:03 devstack sudo[102187]: pam_unix(sudo:session): session closed for user root Jul 22 03:29:03 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-634c8b50-5c67-4544-8028-ea88391feff9 tempest-VolumesGetTest-1419827919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-8cc1abb8-6389-4439-9f43-81b67863c03b" returned: 0 in 0.347s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:29:03 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-634c8b50-5c67-4544-8028-ea88391feff9 tempest-VolumesGetTest-1419827919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-8cc1abb8-6389-4439-9f43-81b67863c03b.352c4d5b-67ad-4696-8177-fb21c0ba75f7 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:29:04 devstack sudo[102192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-8cc1abb8-6389-4439-9f43-81b67863c03b.352c4d5b-67ad-4696-8177-fb21c0ba75f7 Jul 22 03:29:04 devstack sudo[102192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:29:04 devstack sudo[102192]: pam_unix(sudo:session): session closed for user root Jul 22 03:29:04 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-634c8b50-5c67-4544-8028-ea88391feff9 tempest-VolumesGetTest-1419827919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-8cc1abb8-6389-4439-9f43-81b67863c03b.352c4d5b-67ad-4696-8177-fb21c0ba75f7" returned: 0 in 0.318s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:29:04 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-634c8b50-5c67-4544-8028-ea88391feff9 tempest-VolumesGetTest-1419827919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-8cc1abb8-6389-4439-9f43-81b67863c03b.352c4d5b-67ad-4696-8177-fb21c0ba75f7 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:29:04 devstack sudo[102197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-8cc1abb8-6389-4439-9f43-81b67863c03b.352c4d5b-67ad-4696-8177-fb21c0ba75f7 Jul 22 03:29:04 devstack sudo[102197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:29:04 devstack sudo[102197]: pam_unix(sudo:session): session closed for user root Jul 22 03:29:04 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-634c8b50-5c67-4544-8028-ea88391feff9 tempest-VolumesGetTest-1419827919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-8cc1abb8-6389-4439-9f43-81b67863c03b.352c4d5b-67ad-4696-8177-fb21c0ba75f7" returned: 0 in 0.240s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:29:04 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-634c8b50-5c67-4544-8028-ea88391feff9 tempest-VolumesGetTest-1419827919 None] Lock "cinder-quobyte-352c4d5b-67ad-4696-8177-fb21c0ba75f7" released by "_delete_snapshot" :: held 1.329s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:29:04 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-634c8b50-5c67-4544-8028-ea88391feff9 tempest-VolumesGetTest-1419827919 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.753s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:29:04 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-634c8b50-5c67-4544-8028-ea88391feff9 tempest-VolumesGetTest-1419827919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66dbb849-50ec-4d41-afe5-2dcca0677fe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f931d02-9bd8-4851-bfa5-1094e9f05912', 'volume_size': 1, 'source_volid': '8cc1abb8-6389-4439-9f43-81b67863c03b', 'source_volstatus': 'available'}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:29:04 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-634c8b50-5c67-4544-8028-ea88391feff9 tempest-VolumesGetTest-1419827919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (350de30f-554f-43e2-82d4-16cfeb39bc02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:29:04 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-634c8b50-5c67-4544-8028-ea88391feff9 tempest-VolumesGetTest-1419827919 None] Volume volume-0f931d02-9bd8-4851-bfa5-1094e9f05912 (0f931d02-9bd8-4851-bfa5-1094e9f05912): created successfully Jul 22 03:29:04 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-634c8b50-5c67-4544-8028-ea88391feff9 tempest-VolumesGetTest-1419827919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (350de30f-554f-43e2-82d4-16cfeb39bc02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:29:04 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-634c8b50-5c67-4544-8028-ea88391feff9 tempest-VolumesGetTest-1419827919 None] Flow 'volume_create_manager' (a7243825-a823-49e6-b390-bd71d0bc1d96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:29:04 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-634c8b50-5c67-4544-8028-ea88391feff9 tempest-VolumesGetTest-1419827919 None] Created volume successfully. Jul 22 03:29:06 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7c3c167-1d23-4b11-a728-4970b861ff2f tempest-VolumesGetTest-1419827919 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:29:06 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b7c3c167-1d23-4b11-a728-4970b861ff2f tempest-VolumesGetTest-1419827919 None] Flow 'volume_create_manager' (e0f96fda-c32e-4ca7-b759-999cee313dc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:29:06 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b7c3c167-1d23-4b11-a728-4970b861ff2f tempest-VolumesGetTest-1419827919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81d8b619-a1d5-49cd-94f5-390e98b81aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:29:06 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b7c3c167-1d23-4b11-a728-4970b861ff2f tempest-VolumesGetTest-1419827919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81d8b619-a1d5-49cd-94f5-390e98b81aa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:29:06Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-772093951',display_name='tempest-VolumesGetTest-Volume-926857198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fa3bc31-739a-457a-b240-2573c7f22b7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3825839898349d585f9a61920bf5883',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:29:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:29:06Z,use_quota=True,user_id='a5e934656f2b40f3b0af6e623fe0c4a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:29:06 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b7c3c167-1d23-4b11-a728-4970b861ff2f tempest-VolumesGetTest-1419827919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39aedd36-e2ed-49c9-87f2-a97995cfeed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:29:06 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b7c3c167-1d23-4b11-a728-4970b861ff2f tempest-VolumesGetTest-1419827919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39aedd36-e2ed-49c9-87f2-a97995cfeed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:29:06 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b7c3c167-1d23-4b11-a728-4970b861ff2f tempest-VolumesGetTest-1419827919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24a7371c-eeea-493c-875b-17db5a4b8b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:29:06 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b7c3c167-1d23-4b11-a728-4970b861ff2f tempest-VolumesGetTest-1419827919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24a7371c-eeea-493c-875b-17db5a4b8b93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3fa3bc31-739a-457a-b240-2573c7f22b7e', 'volume_name': 'volume-3fa3bc31-739a-457a-b240-2573c7f22b7e', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:29:06 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b7c3c167-1d23-4b11-a728-4970b861ff2f tempest-VolumesGetTest-1419827919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60165bda-f03c-414d-82b4-2a92d8681697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:29:06 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b7c3c167-1d23-4b11-a728-4970b861ff2f tempest-VolumesGetTest-1419827919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60165bda-f03c-414d-82b4-2a92d8681697) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:29:06 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b7c3c167-1d23-4b11-a728-4970b861ff2f tempest-VolumesGetTest-1419827919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea8c79c6-e9bc-4d02-a5eb-541138e022e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:29:06 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-b7c3c167-1d23-4b11-a728-4970b861ff2f tempest-VolumesGetTest-1419827919 None] Volume 3fa3bc31-739a-457a-b240-2573c7f22b7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3fa3bc31-739a-457a-b240-2573c7f22b7e', 'volume_size': 1} Jul 22 03:29:06 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b7c3c167-1d23-4b11-a728-4970b861ff2f tempest-VolumesGetTest-1419827919 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:29:06 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b7c3c167-1d23-4b11-a728-4970b861ff2f tempest-VolumesGetTest-1419827919 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:29:06 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-b7c3c167-1d23-4b11-a728-4970b861ff2f tempest-VolumesGetTest-1419827919 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:29:06Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-772093951',display_name='tempest-VolumesGetTest-Volume-926857198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fa3bc31-739a-457a-b240-2573c7f22b7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3825839898349d585f9a61920bf5883',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:29:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:29:06Z,use_quota=True,user_id='a5e934656f2b40f3b0af6e623fe0c4a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:29:06 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-b7c3c167-1d23-4b11-a728-4970b861ff2f tempest-VolumesGetTest-1419827919 None] Creating volume 3fa3bc31-739a-457a-b240-2573c7f22b7e {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:29:06 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b7c3c167-1d23-4b11-a728-4970b861ff2f tempest-VolumesGetTest-1419827919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:29:06 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b7c3c167-1d23-4b11-a728-4970b861ff2f tempest-VolumesGetTest-1419827919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:29:06 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-b7c3c167-1d23-4b11-a728-4970b861ff2f tempest-VolumesGetTest-1419827919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:29:06 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-b7c3c167-1d23-4b11-a728-4970b861ff2f tempest-VolumesGetTest-1419827919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:29:06 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b7c3c167-1d23-4b11-a728-4970b861ff2f tempest-VolumesGetTest-1419827919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:29:06 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-b7c3c167-1d23-4b11-a728-4970b861ff2f tempest-VolumesGetTest-1419827919 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:29:06 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-b7c3c167-1d23-4b11-a728-4970b861ff2f tempest-VolumesGetTest-1419827919 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:29:06 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b7c3c167-1d23-4b11-a728-4970b861ff2f tempest-VolumesGetTest-1419827919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3fa3bc31-739a-457a-b240-2573c7f22b7e 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:29:06 devstack sudo[102200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3fa3bc31-739a-457a-b240-2573c7f22b7e 1073741824 Jul 22 03:29:06 devstack sudo[102200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:29:06 devstack sudo[102200]: pam_unix(sudo:session): session closed for user root Jul 22 03:29:06 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b7c3c167-1d23-4b11-a728-4970b861ff2f tempest-VolumesGetTest-1419827919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3fa3bc31-739a-457a-b240-2573c7f22b7e 1073741824" returned: 0 in 0.395s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:29:06 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b7c3c167-1d23-4b11-a728-4970b861ff2f tempest-VolumesGetTest-1419827919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3fa3bc31-739a-457a-b240-2573c7f22b7e {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:29:06 devstack sudo[102206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3fa3bc31-739a-457a-b240-2573c7f22b7e Jul 22 03:29:06 devstack sudo[102206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:29:06 devstack sudo[102206]: pam_unix(sudo:session): session closed for user root Jul 22 03:29:06 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b7c3c167-1d23-4b11-a728-4970b861ff2f tempest-VolumesGetTest-1419827919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3fa3bc31-739a-457a-b240-2573c7f22b7e" returned: 0 in 0.240s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:29:06 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-b7c3c167-1d23-4b11-a728-4970b861ff2f tempest-VolumesGetTest-1419827919 None] <== create_volume: return (672ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:29:06 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b7c3c167-1d23-4b11-a728-4970b861ff2f tempest-VolumesGetTest-1419827919 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.675s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:29:06 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b7c3c167-1d23-4b11-a728-4970b861ff2f tempest-VolumesGetTest-1419827919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea8c79c6-e9bc-4d02-a5eb-541138e022e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fa3bc31-739a-457a-b240-2573c7f22b7e', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:29:06 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b7c3c167-1d23-4b11-a728-4970b861ff2f tempest-VolumesGetTest-1419827919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e5b28d8-7545-4228-98bc-098023cace85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:29:06 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-b7c3c167-1d23-4b11-a728-4970b861ff2f tempest-VolumesGetTest-1419827919 None] Volume volume-3fa3bc31-739a-457a-b240-2573c7f22b7e (3fa3bc31-739a-457a-b240-2573c7f22b7e): created successfully Jul 22 03:29:06 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b7c3c167-1d23-4b11-a728-4970b861ff2f tempest-VolumesGetTest-1419827919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e5b28d8-7545-4228-98bc-098023cace85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:29:06 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b7c3c167-1d23-4b11-a728-4970b861ff2f tempest-VolumesGetTest-1419827919 None] Flow 'volume_create_manager' (e0f96fda-c32e-4ca7-b759-999cee313dc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:29:06 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-b7c3c167-1d23-4b11-a728-4970b861ff2f tempest-VolumesGetTest-1419827919 None] Created volume successfully. Jul 22 03:29:07 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-118e29c6-26fd-46e2-b46a-08ef38b0ee0e tempest-VolumesGetTest-1419827919 None] Acquiring lock "cinder-3fa3bc31-739a-457a-b240-2573c7f22b7e-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:29:07 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-118e29c6-26fd-46e2-b46a-08ef38b0ee0e tempest-VolumesGetTest-1419827919 None] Lock "cinder-3fa3bc31-739a-457a-b240-2573c7f22b7e-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:29:07 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-118e29c6-26fd-46e2-b46a-08ef38b0ee0e tempest-VolumesGetTest-1419827919 None] Acquiring lock "cinder-quobyte-3fa3bc31-739a-457a-b240-2573c7f22b7e" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:29:07 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-118e29c6-26fd-46e2-b46a-08ef38b0ee0e tempest-VolumesGetTest-1419827919 None] Lock "cinder-quobyte-3fa3bc31-739a-457a-b240-2573c7f22b7e" acquired by "delete_volume" :: waited 0.015s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:29:07 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6c2f76d-5b48-4a1f-b260-c64daae9fbc1]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:29:07 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-118e29c6-26fd-46e2-b46a-08ef38b0ee0e tempest-VolumesGetTest-1419827919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3fa3bc31-739a-457a-b240-2573c7f22b7e {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:29:07 devstack sudo[102209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3fa3bc31-739a-457a-b240-2573c7f22b7e Jul 22 03:29:07 devstack sudo[102209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:29:07 devstack sudo[102209]: pam_unix(sudo:session): session closed for user root Jul 22 03:29:07 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-118e29c6-26fd-46e2-b46a-08ef38b0ee0e tempest-VolumesGetTest-1419827919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3fa3bc31-739a-457a-b240-2573c7f22b7e" returned: 0 in 0.350s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:29:07 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-118e29c6-26fd-46e2-b46a-08ef38b0ee0e tempest-VolumesGetTest-1419827919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3fa3bc31-739a-457a-b240-2573c7f22b7e {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:29:07 devstack sudo[102214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3fa3bc31-739a-457a-b240-2573c7f22b7e Jul 22 03:29:07 devstack sudo[102214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:29:07 devstack sudo[102214]: pam_unix(sudo:session): session closed for user root Jul 22 03:29:07 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-118e29c6-26fd-46e2-b46a-08ef38b0ee0e tempest-VolumesGetTest-1419827919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3fa3bc31-739a-457a-b240-2573c7f22b7e" returned: 0 in 0.239s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:29:07 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-118e29c6-26fd-46e2-b46a-08ef38b0ee0e tempest-VolumesGetTest-1419827919 None] Lock "cinder-quobyte-3fa3bc31-739a-457a-b240-2573c7f22b7e" released by "delete_volume" :: held 0.626s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:29:07 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-118e29c6-26fd-46e2-b46a-08ef38b0ee0e tempest-VolumesGetTest-1419827919 None] Created reservations ['6a5603f1-c303-4438-a0c7-46e092b68dc4', '8c9bcb7e-0b0e-4025-8a97-f4b697e7c772', '18613790-f975-4f16-8938-14b359709ea5', 'c09840c4-77a9-46af-b6ad-4ea5131e2cce'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:29:07 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-118e29c6-26fd-46e2-b46a-08ef38b0ee0e tempest-VolumesGetTest-1419827919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:29:07 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-118e29c6-26fd-46e2-b46a-08ef38b0ee0e tempest-VolumesGetTest-1419827919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:29:07 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-118e29c6-26fd-46e2-b46a-08ef38b0ee0e tempest-VolumesGetTest-1419827919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:29:07 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-118e29c6-26fd-46e2-b46a-08ef38b0ee0e tempest-VolumesGetTest-1419827919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:29:07 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-118e29c6-26fd-46e2-b46a-08ef38b0ee0e tempest-VolumesGetTest-1419827919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:29:07 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-118e29c6-26fd-46e2-b46a-08ef38b0ee0e tempest-VolumesGetTest-1419827919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:29:07 devstack sudo[102217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:29:07 devstack sudo[102217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:29:08 devstack sudo[102217]: pam_unix(sudo:session): session closed for user root Jul 22 03:29:08 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-118e29c6-26fd-46e2-b46a-08ef38b0ee0e tempest-VolumesGetTest-1419827919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.235s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:29:08 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-118e29c6-26fd-46e2-b46a-08ef38b0ee0e tempest-VolumesGetTest-1419827919 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:29:08 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-118e29c6-26fd-46e2-b46a-08ef38b0ee0e tempest-VolumesGetTest-1419827919 None] Deleted volume successfully. Jul 22 03:29:08 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-118e29c6-26fd-46e2-b46a-08ef38b0ee0e tempest-VolumesGetTest-1419827919 None] Lock "cinder-3fa3bc31-739a-457a-b240-2573c7f22b7e-delete_volume" released by "delete_volume" :: held 1.049s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:29:08 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-aef28144-b17d-4836-94b9-557ac7061db8 tempest-VolumesGetTest-1419827919 None] Acquiring lock "cinder-0f931d02-9bd8-4851-bfa5-1094e9f05912-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:29:08 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-aef28144-b17d-4836-94b9-557ac7061db8 tempest-VolumesGetTest-1419827919 None] Lock "cinder-0f931d02-9bd8-4851-bfa5-1094e9f05912-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:29:08 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-aef28144-b17d-4836-94b9-557ac7061db8 tempest-VolumesGetTest-1419827919 None] Acquiring lock "cinder-quobyte-0f931d02-9bd8-4851-bfa5-1094e9f05912" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:29:08 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-aef28144-b17d-4836-94b9-557ac7061db8 tempest-VolumesGetTest-1419827919 None] Lock "cinder-quobyte-0f931d02-9bd8-4851-bfa5-1094e9f05912" acquired by "delete_volume" :: waited 0.016s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:29:08 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[193c61e4-836a-4922-8b30-cb2de5555860]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:29:08 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-aef28144-b17d-4836-94b9-557ac7061db8 tempest-VolumesGetTest-1419827919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0f931d02-9bd8-4851-bfa5-1094e9f05912 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:29:08 devstack sudo[102220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0f931d02-9bd8-4851-bfa5-1094e9f05912 Jul 22 03:29:08 devstack sudo[102220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:29:08 devstack sudo[102220]: pam_unix(sudo:session): session closed for user root Jul 22 03:29:08 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-aef28144-b17d-4836-94b9-557ac7061db8 tempest-VolumesGetTest-1419827919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0f931d02-9bd8-4851-bfa5-1094e9f05912" returned: 0 in 0.342s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:29:08 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-aef28144-b17d-4836-94b9-557ac7061db8 tempest-VolumesGetTest-1419827919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0f931d02-9bd8-4851-bfa5-1094e9f05912 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:29:08 devstack sudo[102225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0f931d02-9bd8-4851-bfa5-1094e9f05912 Jul 22 03:29:08 devstack sudo[102225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:29:09 devstack sudo[102225]: pam_unix(sudo:session): session closed for user root Jul 22 03:29:09 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-aef28144-b17d-4836-94b9-557ac7061db8 tempest-VolumesGetTest-1419827919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0f931d02-9bd8-4851-bfa5-1094e9f05912" returned: 0 in 0.236s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:29:09 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-aef28144-b17d-4836-94b9-557ac7061db8 tempest-VolumesGetTest-1419827919 None] Lock "cinder-quobyte-0f931d02-9bd8-4851-bfa5-1094e9f05912" released by "delete_volume" :: held 0.615s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:29:09 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-aef28144-b17d-4836-94b9-557ac7061db8 tempest-VolumesGetTest-1419827919 None] Created reservations ['99896f76-7d4c-4daf-8e8b-1913c6d21d4a', 'f6a33b8c-adbc-435f-b7ca-d71d9bc53775', '970cde16-9cb5-48b6-ad10-213e0a483ba4', 'bd54ce88-c202-4051-ab8e-7d5722d1289f'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:29:09 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-aef28144-b17d-4836-94b9-557ac7061db8 tempest-VolumesGetTest-1419827919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:29:09 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-aef28144-b17d-4836-94b9-557ac7061db8 tempest-VolumesGetTest-1419827919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:29:09 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-aef28144-b17d-4836-94b9-557ac7061db8 tempest-VolumesGetTest-1419827919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:29:09 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-aef28144-b17d-4836-94b9-557ac7061db8 tempest-VolumesGetTest-1419827919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:29:09 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-aef28144-b17d-4836-94b9-557ac7061db8 tempest-VolumesGetTest-1419827919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:29:09 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-aef28144-b17d-4836-94b9-557ac7061db8 tempest-VolumesGetTest-1419827919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:29:09 devstack sudo[102228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:29:09 devstack sudo[102228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:29:09 devstack sudo[102228]: pam_unix(sudo:session): session closed for user root Jul 22 03:29:09 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-aef28144-b17d-4836-94b9-557ac7061db8 tempest-VolumesGetTest-1419827919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.236s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:29:09 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-aef28144-b17d-4836-94b9-557ac7061db8 tempest-VolumesGetTest-1419827919 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:29:09 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-aef28144-b17d-4836-94b9-557ac7061db8 tempest-VolumesGetTest-1419827919 None] Deleted volume successfully. Jul 22 03:29:09 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-aef28144-b17d-4836-94b9-557ac7061db8 tempest-VolumesGetTest-1419827919 None] Lock "cinder-0f931d02-9bd8-4851-bfa5-1094e9f05912-delete_volume" released by "delete_volume" :: held 1.047s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:29:09 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-c644c697-907d-4e02-bbdc-264a6a8b978b tempest-VolumesGetTest-1419827919 None] Acquiring lock "cinder-8cc1abb8-6389-4439-9f43-81b67863c03b-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:29:09 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-c644c697-907d-4e02-bbdc-264a6a8b978b tempest-VolumesGetTest-1419827919 None] Lock "cinder-8cc1abb8-6389-4439-9f43-81b67863c03b-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:29:09 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-c644c697-907d-4e02-bbdc-264a6a8b978b tempest-VolumesGetTest-1419827919 None] Acquiring lock "cinder-quobyte-8cc1abb8-6389-4439-9f43-81b67863c03b" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:29:09 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-c644c697-907d-4e02-bbdc-264a6a8b978b tempest-VolumesGetTest-1419827919 None] Lock "cinder-quobyte-8cc1abb8-6389-4439-9f43-81b67863c03b" acquired by "delete_volume" :: waited 0.017s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:29:09 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba82b5f-43a6-40f9-810b-4e6f587b0106]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:29:09 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-c644c697-907d-4e02-bbdc-264a6a8b978b tempest-VolumesGetTest-1419827919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-8cc1abb8-6389-4439-9f43-81b67863c03b {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:29:09 devstack sudo[102231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-8cc1abb8-6389-4439-9f43-81b67863c03b Jul 22 03:29:09 devstack sudo[102231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:29:10 devstack sudo[102231]: pam_unix(sudo:session): session closed for user root Jul 22 03:29:10 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-c644c697-907d-4e02-bbdc-264a6a8b978b tempest-VolumesGetTest-1419827919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-8cc1abb8-6389-4439-9f43-81b67863c03b" returned: 0 in 0.352s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:29:10 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-c644c697-907d-4e02-bbdc-264a6a8b978b tempest-VolumesGetTest-1419827919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-8cc1abb8-6389-4439-9f43-81b67863c03b {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:29:10 devstack sudo[102236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-8cc1abb8-6389-4439-9f43-81b67863c03b Jul 22 03:29:10 devstack sudo[102236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:29:10 devstack sudo[102236]: pam_unix(sudo:session): session closed for user root Jul 22 03:29:10 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-c644c697-907d-4e02-bbdc-264a6a8b978b tempest-VolumesGetTest-1419827919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-8cc1abb8-6389-4439-9f43-81b67863c03b" returned: 0 in 0.242s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:29:10 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-c644c697-907d-4e02-bbdc-264a6a8b978b tempest-VolumesGetTest-1419827919 None] Lock "cinder-quobyte-8cc1abb8-6389-4439-9f43-81b67863c03b" released by "delete_volume" :: held 0.642s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:29:10 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-c644c697-907d-4e02-bbdc-264a6a8b978b tempest-VolumesGetTest-1419827919 None] Created reservations ['c97d3450-b239-41d7-9e5a-018c0e7eb3a8', 'c2cc22ec-ee42-4efe-9706-11033461bb01', 'e777d0ac-4bf4-4f9b-9284-4cf4c08d00c6', 'b8d00171-0e4e-41d7-9e93-7f960a4ec6ab'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:29:10 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-c644c697-907d-4e02-bbdc-264a6a8b978b tempest-VolumesGetTest-1419827919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:29:10 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-c644c697-907d-4e02-bbdc-264a6a8b978b tempest-VolumesGetTest-1419827919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:29:10 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-c644c697-907d-4e02-bbdc-264a6a8b978b tempest-VolumesGetTest-1419827919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:29:10 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-c644c697-907d-4e02-bbdc-264a6a8b978b tempest-VolumesGetTest-1419827919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:29:10 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-c644c697-907d-4e02-bbdc-264a6a8b978b tempest-VolumesGetTest-1419827919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:29:10 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-c644c697-907d-4e02-bbdc-264a6a8b978b tempest-VolumesGetTest-1419827919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:29:10 devstack sudo[102239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:29:10 devstack sudo[102239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:29:10 devstack sudo[102239]: pam_unix(sudo:session): session closed for user root Jul 22 03:29:10 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-c644c697-907d-4e02-bbdc-264a6a8b978b tempest-VolumesGetTest-1419827919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.236s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:29:10 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-c644c697-907d-4e02-bbdc-264a6a8b978b tempest-VolumesGetTest-1419827919 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:29:10 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-c644c697-907d-4e02-bbdc-264a6a8b978b tempest-VolumesGetTest-1419827919 None] Deleted volume successfully. Jul 22 03:29:10 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-c644c697-907d-4e02-bbdc-264a6a8b978b tempest-VolumesGetTest-1419827919 None] Lock "cinder-8cc1abb8-6389-4439-9f43-81b67863c03b-delete_volume" released by "delete_volume" :: held 1.070s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:29:11 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b2fd4e2-d745-41d4-9007-34b0e9ebaf89 tempest-VolumesGetTest-1419827919 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:29:11 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-8b2fd4e2-d745-41d4-9007-34b0e9ebaf89 tempest-VolumesGetTest-1419827919 None] Flow 'volume_create_manager' (4b8e9779-cdaa-44a4-ae03-864fb1530821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:29:11 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-8b2fd4e2-d745-41d4-9007-34b0e9ebaf89 tempest-VolumesGetTest-1419827919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (111ecfd1-2e2b-4b6d-ad5b-625c6732d8dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:29:11 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-8b2fd4e2-d745-41d4-9007-34b0e9ebaf89 tempest-VolumesGetTest-1419827919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (111ecfd1-2e2b-4b6d-ad5b-625c6732d8dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:29:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-719822923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14668822-b72f-4bdf-8c6a-283d7fee8d88,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a3825839898349d585f9a61920bf5883',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:29:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:29:11Z,use_quota=True,user_id='a5e934656f2b40f3b0af6e623fe0c4a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:29:11 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-8b2fd4e2-d745-41d4-9007-34b0e9ebaf89 tempest-VolumesGetTest-1419827919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (212b4ee2-aba7-4407-852c-c84677d6ca2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:29:11 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-8b2fd4e2-d745-41d4-9007-34b0e9ebaf89 tempest-VolumesGetTest-1419827919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (212b4ee2-aba7-4407-852c-c84677d6ca2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:29:11 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-8b2fd4e2-d745-41d4-9007-34b0e9ebaf89 tempest-VolumesGetTest-1419827919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9de498b9-11f8-4a4f-ae62-9ed2210bebab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:29:11 devstack cinder-volume[87747]: DEBUG cinder.image.glance [None req-8b2fd4e2-d745-41d4-9007-34b0e9ebaf89 tempest-VolumesGetTest-1419827919 None] Creating Keystone auth plugin from conf {{(pid=87747) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 22 03:29:11 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-8b2fd4e2-d745-41d4-9007-34b0e9ebaf89 tempest-VolumesGetTest-1419827919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9de498b9-11f8-4a4f-ae62-9ed2210bebab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '14668822-b72f-4bdf-8c6a-283d7fee8d88', 'volume_name': 'volume-14668822-b72f-4bdf-8c6a-283d7fee8d88', 'volume_size': 1, 'image_id': 'a3efde48-babd-4b04-b205-71cd843dec16', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a3efde48-babd-4b04-b205-71cd843dec16', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '37328413017b49c4b4fe75bae83dd2ac', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a3efde48-babd-4b04-b205-71cd843dec16', 'created_at': datetime.datetime(2026, 7, 22, 1, 8, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 22, 1, 8, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a3efde48-babd-4b04-b205-71cd843dec16/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:29:11 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-8b2fd4e2-d745-41d4-9007-34b0e9ebaf89 tempest-VolumesGetTest-1419827919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c410256e-6b59-4d2f-a3e7-0485d2445e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:29:11 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-8b2fd4e2-d745-41d4-9007-34b0e9ebaf89 tempest-VolumesGetTest-1419827919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c410256e-6b59-4d2f-a3e7-0485d2445e26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:29:11 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-8b2fd4e2-d745-41d4-9007-34b0e9ebaf89 tempest-VolumesGetTest-1419827919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da29e58e-9a35-4c7a-88c0-e3406f8dc952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:29:11 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-8b2fd4e2-d745-41d4-9007-34b0e9ebaf89 tempest-VolumesGetTest-1419827919 None] Volume 14668822-b72f-4bdf-8c6a-283d7fee8d88: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-14668822-b72f-4bdf-8c6a-283d7fee8d88', 'volume_size': 1, 'image_id': 'a3efde48-babd-4b04-b205-71cd843dec16', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a3efde48-babd-4b04-b205-71cd843dec16', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '37328413017b49c4b4fe75bae83dd2ac', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a3efde48-babd-4b04-b205-71cd843dec16', 'created_at': datetime.datetime(2026, 7, 22, 1, 8, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 22, 1, 8, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a3efde48-babd-4b04-b205-71cd843dec16/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 22 03:29:11 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b2fd4e2-d745-41d4-9007-34b0e9ebaf89 tempest-VolumesGetTest-1419827919 None] Trying to clone 14668822-b72f-4bdf-8c6a-283d7fee8d88 from image a3efde48-babd-4b04-b205-71cd843dec16 at location (None, [{'url': 'file:///opt/stack/data/glance/images/a3efde48-babd-4b04-b205-71cd843dec16', 'metadata': {}}]). {{(pid=87747) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 22 03:29:12 devstack cinder-volume[87747]: DEBUG cinder.image.image_utils [None req-8b2fd4e2-d745-41d4-9007-34b0e9ebaf89 tempest-VolumesGetTest-1419827919 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a3efde48-babd-4b04-b205-71cd843dec16_q1b4_tiddevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87747) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 22 03:29:12 devstack cinder-volume[87747]: INFO cinder.image.image_utils [None req-8b2fd4e2-d745-41d4-9007-34b0e9ebaf89 tempest-VolumesGetTest-1419827919 None] Image download 20.69 MB at 20.69 MB/s Jul 22 03:29:12 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[4153e9b3-970e-4216-b538-ce986d3995be]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:29:12 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-8b2fd4e2-d745-41d4-9007-34b0e9ebaf89 tempest-VolumesGetTest-1419827919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a3efde48-babd-4b04-b205-71cd843dec16_q1b4_tiddevstack@QuobyteHD {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:29:12 devstack sudo[102243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a3efde48-babd-4b04-b205-71cd843dec16_q1b4_tiddevstack@QuobyteHD Jul 22 03:29:12 devstack sudo[102243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:29:12 devstack sudo[102243]: pam_unix(sudo:session): session closed for user root Jul 22 03:29:12 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-8b2fd4e2-d745-41d4-9007-34b0e9ebaf89 tempest-VolumesGetTest-1419827919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a3efde48-babd-4b04-b205-71cd843dec16_q1b4_tiddevstack@QuobyteHD" returned: 0 in 0.329s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:29:12 devstack cinder-volume[87747]: DEBUG cinder.image.image_utils [None req-8b2fd4e2-d745-41d4-9007-34b0e9ebaf89 tempest-VolumesGetTest-1419827919 None] Temporary image a3efde48-babd-4b04-b205-71cd843dec16 is fetched for user a5e934656f2b40f3b0af6e623fe0c4a7. {{(pid=87747) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 22 03:29:12 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[94fc7118-9ca6-49cf-9363-a12b94d9e0af]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:29:12 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-8b2fd4e2-d745-41d4-9007-34b0e9ebaf89 tempest-VolumesGetTest-1419827919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a3efde48-babd-4b04-b205-71cd843dec16_q1b4_tiddevstack@QuobyteHD {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:29:12 devstack sudo[102248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a3efde48-babd-4b04-b205-71cd843dec16_q1b4_tiddevstack@QuobyteHD Jul 22 03:29:12 devstack sudo[102248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:29:12 devstack sudo[102248]: pam_unix(sudo:session): session closed for user root Jul 22 03:29:12 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-8b2fd4e2-d745-41d4-9007-34b0e9ebaf89 tempest-VolumesGetTest-1419827919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a3efde48-babd-4b04-b205-71cd843dec16_q1b4_tiddevstack@QuobyteHD" returned: 0 in 0.315s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:29:12 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-8b2fd4e2-d745-41d4-9007-34b0e9ebaf89 tempest-VolumesGetTest-1419827919 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:29:12 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-8b2fd4e2-d745-41d4-9007-34b0e9ebaf89 tempest-VolumesGetTest-1419827919 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:29:12 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-8b2fd4e2-d745-41d4-9007-34b0e9ebaf89 tempest-VolumesGetTest-1419827919 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:29:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-719822923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14668822-b72f-4bdf-8c6a-283d7fee8d88,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a3825839898349d585f9a61920bf5883',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:29:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:29:11Z,use_quota=True,user_id='a5e934656f2b40f3b0af6e623fe0c4a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:29:12 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-8b2fd4e2-d745-41d4-9007-34b0e9ebaf89 tempest-VolumesGetTest-1419827919 None] Creating volume 14668822-b72f-4bdf-8c6a-283d7fee8d88 {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:29:12 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-8b2fd4e2-d745-41d4-9007-34b0e9ebaf89 tempest-VolumesGetTest-1419827919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:29:12 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-8b2fd4e2-d745-41d4-9007-34b0e9ebaf89 tempest-VolumesGetTest-1419827919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:29:12 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-8b2fd4e2-d745-41d4-9007-34b0e9ebaf89 tempest-VolumesGetTest-1419827919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:29:12 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-8b2fd4e2-d745-41d4-9007-34b0e9ebaf89 tempest-VolumesGetTest-1419827919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:29:12 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-8b2fd4e2-d745-41d4-9007-34b0e9ebaf89 tempest-VolumesGetTest-1419827919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:29:12 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-8b2fd4e2-d745-41d4-9007-34b0e9ebaf89 tempest-VolumesGetTest-1419827919 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:29:12 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-8b2fd4e2-d745-41d4-9007-34b0e9ebaf89 tempest-VolumesGetTest-1419827919 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:29:12 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-8b2fd4e2-d745-41d4-9007-34b0e9ebaf89 tempest-VolumesGetTest-1419827919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-14668822-b72f-4bdf-8c6a-283d7fee8d88 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:29:12 devstack sudo[102253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-14668822-b72f-4bdf-8c6a-283d7fee8d88 1073741824 Jul 22 03:29:12 devstack sudo[102253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:29:13 devstack sudo[102253]: pam_unix(sudo:session): session closed for user root Jul 22 03:29:13 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-8b2fd4e2-d745-41d4-9007-34b0e9ebaf89 tempest-VolumesGetTest-1419827919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-14668822-b72f-4bdf-8c6a-283d7fee8d88 1073741824" returned: 0 in 0.394s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:29:13 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-8b2fd4e2-d745-41d4-9007-34b0e9ebaf89 tempest-VolumesGetTest-1419827919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-14668822-b72f-4bdf-8c6a-283d7fee8d88 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:29:13 devstack sudo[102259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-14668822-b72f-4bdf-8c6a-283d7fee8d88 Jul 22 03:29:13 devstack sudo[102259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:29:13 devstack sudo[102259]: pam_unix(sudo:session): session closed for user root Jul 22 03:29:13 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-8b2fd4e2-d745-41d4-9007-34b0e9ebaf89 tempest-VolumesGetTest-1419827919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-14668822-b72f-4bdf-8c6a-283d7fee8d88" returned: 0 in 0.244s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:29:13 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-8b2fd4e2-d745-41d4-9007-34b0e9ebaf89 tempest-VolumesGetTest-1419827919 None] <== create_volume: return (678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:29:13 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-8b2fd4e2-d745-41d4-9007-34b0e9ebaf89 tempest-VolumesGetTest-1419827919 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.680s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:29:13 devstack cinder-volume[87747]: DEBUG cinder.volume.volume_utils [None req-8b2fd4e2-d745-41d4-9007-34b0e9ebaf89 tempest-VolumesGetTest-1419827919 None] Attempting download of a3efde48-babd-4b04-b205-71cd843dec16 ((None, [{'url': 'file:///opt/stack/data/glance/images/a3efde48-babd-4b04-b205-71cd843dec16', 'metadata': {}}])) to volume 14668822-b72f-4bdf-8c6a-283d7fee8d88. {{(pid=87747) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 22 03:29:13 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[00eacee9-3052-4a40-9b0e-828b6e223ea0]: (4, 'raw') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:29:13 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-8b2fd4e2-d745-41d4-9007-34b0e9ebaf89 tempest-VolumesGetTest-1419827919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a3efde48-babd-4b04-b205-71cd843dec16_xtiw4xj0 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:29:13 devstack sudo[102262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a3efde48-babd-4b04-b205-71cd843dec16_xtiw4xj0 Jul 22 03:29:13 devstack sudo[102262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:29:13 devstack sudo[102262]: pam_unix(sudo:session): session closed for user root Jul 22 03:29:13 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-8b2fd4e2-d745-41d4-9007-34b0e9ebaf89 tempest-VolumesGetTest-1419827919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a3efde48-babd-4b04-b205-71cd843dec16_xtiw4xj0" returned: 0 in 0.322s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:29:13 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-8b2fd4e2-d745-41d4-9007-34b0e9ebaf89 tempest-VolumesGetTest-1419827919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a3efde48-babd-4b04-b205-71cd843dec16_xtiw4xj0 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:29:13 devstack sudo[102266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a3efde48-babd-4b04-b205-71cd843dec16_xtiw4xj0 Jul 22 03:29:13 devstack sudo[102266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:29:14 devstack sudo[102266]: pam_unix(sudo:session): session closed for user root Jul 22 03:29:14 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-8b2fd4e2-d745-41d4-9007-34b0e9ebaf89 tempest-VolumesGetTest-1419827919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a3efde48-babd-4b04-b205-71cd843dec16_xtiw4xj0" returned: 1 in 0.318s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:29:14 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-8b2fd4e2-d745-41d4-9007-34b0e9ebaf89 tempest-VolumesGetTest-1419827919 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a3efde48-babd-4b04-b205-71cd843dec16_xtiw4xj0' failed. Not Retrying. {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 22 03:29:14 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[57a8183c-f5f7-4b69-b303-ef1f2e5a6ec2]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:29:14 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-8b2fd4e2-d745-41d4-9007-34b0e9ebaf89 tempest-VolumesGetTest-1419827919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a3efde48-babd-4b04-b205-71cd843dec16_q1b4_tiddevstack@QuobyteHD {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:29:14 devstack sudo[102270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a3efde48-babd-4b04-b205-71cd843dec16_q1b4_tiddevstack@QuobyteHD Jul 22 03:29:14 devstack sudo[102270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:29:14 devstack sudo[102270]: pam_unix(sudo:session): session closed for user root Jul 22 03:29:14 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-8b2fd4e2-d745-41d4-9007-34b0e9ebaf89 tempest-VolumesGetTest-1419827919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a3efde48-babd-4b04-b205-71cd843dec16_q1b4_tiddevstack@QuobyteHD" returned: 0 in 0.323s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:29:14 devstack cinder-volume[87747]: DEBUG cinder.image.image_utils [None req-8b2fd4e2-d745-41d4-9007-34b0e9ebaf89 tempest-VolumesGetTest-1419827919 None] a3efde48-babd-4b04-b205-71cd843dec16 was qcow2, converting to qcow2 {{(pid=87747) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 22 03:29:14 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-8b2fd4e2-d745-41d4-9007-34b0e9ebaf89 tempest-VolumesGetTest-1419827919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a3efde48-babd-4b04-b205-71cd843dec16_q1b4_tiddevstack@QuobyteHD /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-14668822-b72f-4bdf-8c6a-283d7fee8d88 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:29:14 devstack sudo[102275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a3efde48-babd-4b04-b205-71cd843dec16_q1b4_tiddevstack@QuobyteHD /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-14668822-b72f-4bdf-8c6a-283d7fee8d88 Jul 22 03:29:14 devstack sudo[102275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:29:16 devstack sudo[102275]: pam_unix(sudo:session): session closed for user root Jul 22 03:29:16 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-8b2fd4e2-d745-41d4-9007-34b0e9ebaf89 tempest-VolumesGetTest-1419827919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a3efde48-babd-4b04-b205-71cd843dec16_q1b4_tiddevstack@QuobyteHD /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-14668822-b72f-4bdf-8c6a-283d7fee8d88" returned: 0 in 1.539s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:29:16 devstack cinder-volume[87747]: DEBUG cinder.image.image_utils [None req-8b2fd4e2-d745-41d4-9007-34b0e9ebaf89 tempest-VolumesGetTest-1419827919 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a3efde48-babd-4b04-b205-71cd843dec16_q1b4_tiddevstack@QuobyteHD, size 112.00 MB, duration 1.54 sec, destination /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-14668822-b72f-4bdf-8c6a-283d7fee8d88 {{(pid=87747) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 22 03:29:16 devstack cinder-volume[87747]: INFO cinder.image.image_utils [None req-8b2fd4e2-d745-41d4-9007-34b0e9ebaf89 tempest-VolumesGetTest-1419827919 None] Converted 112.00 MB image at 72.73 MB/s Jul 22 03:29:16 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-8b2fd4e2-d745-41d4-9007-34b0e9ebaf89 tempest-VolumesGetTest-1419827919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-14668822-b72f-4bdf-8c6a-283d7fee8d88 1G {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:29:16 devstack sudo[102284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-14668822-b72f-4bdf-8c6a-283d7fee8d88 1G Jul 22 03:29:16 devstack sudo[102284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:29:16 devstack sudo[102284]: pam_unix(sudo:session): session closed for user root Jul 22 03:29:16 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-8b2fd4e2-d745-41d4-9007-34b0e9ebaf89 tempest-VolumesGetTest-1419827919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-14668822-b72f-4bdf-8c6a-283d7fee8d88 1G" returned: 0 in 0.296s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:29:16 devstack cinder-volume[87747]: DEBUG cinder.volume.volume_utils [None req-8b2fd4e2-d745-41d4-9007-34b0e9ebaf89 tempest-VolumesGetTest-1419827919 None] Downloaded image a3efde48-babd-4b04-b205-71cd843dec16 ((None, [{'url': 'file:///opt/stack/data/glance/images/a3efde48-babd-4b04-b205-71cd843dec16', 'metadata': {}}])) to volume 14668822-b72f-4bdf-8c6a-283d7fee8d88 successfully. {{(pid=87747) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 22 03:29:16 devstack cinder-volume[87747]: DEBUG cinder.image.image_utils [None req-8b2fd4e2-d745-41d4-9007-34b0e9ebaf89 tempest-VolumesGetTest-1419827919 None] Temporary image a3efde48-babd-4b04-b205-71cd843dec16 for user a5e934656f2b40f3b0af6e623fe0c4a7 is deleted. {{(pid=87747) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 22 03:29:16 devstack cinder-volume[87747]: DEBUG cinder.volume.volume_utils [None req-8b2fd4e2-d745-41d4-9007-34b0e9ebaf89 tempest-VolumesGetTest-1419827919 None] Marking volume 14668822-b72f-4bdf-8c6a-283d7fee8d88 as bootable. {{(pid=87747) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 22 03:29:16 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b2fd4e2-d745-41d4-9007-34b0e9ebaf89 tempest-VolumesGetTest-1419827919 None] Copying metadata from image a3efde48-babd-4b04-b205-71cd843dec16 to 14668822-b72f-4bdf-8c6a-283d7fee8d88. {{(pid=87747) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 22 03:29:16 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b2fd4e2-d745-41d4-9007-34b0e9ebaf89 tempest-VolumesGetTest-1419827919 None] Creating volume glance metadata for volume 14668822-b72f-4bdf-8c6a-283d7fee8d88 backed by image a3efde48-babd-4b04-b205-71cd843dec16 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'a3efde48-babd-4b04-b205-71cd843dec16', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87747) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 22 03:29:16 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-8b2fd4e2-d745-41d4-9007-34b0e9ebaf89 tempest-VolumesGetTest-1419827919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da29e58e-9a35-4c7a-88c0-e3406f8dc952) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14668822-b72f-4bdf-8c6a-283d7fee8d88', 'volume_size': 1, 'image_id': 'a3efde48-babd-4b04-b205-71cd843dec16', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a3efde48-babd-4b04-b205-71cd843dec16', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '37328413017b49c4b4fe75bae83dd2ac', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a3efde48-babd-4b04-b205-71cd843dec16', 'created_at': datetime.datetime(2026, 7, 22, 1, 8, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 22, 1, 8, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a3efde48-babd-4b04-b205-71cd843dec16/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:29:16 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-8b2fd4e2-d745-41d4-9007-34b0e9ebaf89 tempest-VolumesGetTest-1419827919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b8ca581-4c0c-4bf7-8681-8ad5067ce807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:29:16 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-8b2fd4e2-d745-41d4-9007-34b0e9ebaf89 tempest-VolumesGetTest-1419827919 None] Volume volume-14668822-b72f-4bdf-8c6a-283d7fee8d88 (14668822-b72f-4bdf-8c6a-283d7fee8d88): created successfully Jul 22 03:29:16 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-8b2fd4e2-d745-41d4-9007-34b0e9ebaf89 tempest-VolumesGetTest-1419827919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b8ca581-4c0c-4bf7-8681-8ad5067ce807) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:29:16 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-8b2fd4e2-d745-41d4-9007-34b0e9ebaf89 tempest-VolumesGetTest-1419827919 None] Flow 'volume_create_manager' (4b8e9779-cdaa-44a4-ae03-864fb1530821) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:29:16 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-8b2fd4e2-d745-41d4-9007-34b0e9ebaf89 tempest-VolumesGetTest-1419827919 None] Created volume successfully. Jul 22 03:29:18 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d776ff5-d328-4384-b0ce-68eedf75a909 tempest-VolumesGetTest-1419827919 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:29:18 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2d776ff5-d328-4384-b0ce-68eedf75a909 tempest-VolumesGetTest-1419827919 None] Flow 'volume_create_manager' (5b64d63b-5323-428b-9468-6ca210d0acba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:29:18 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2d776ff5-d328-4384-b0ce-68eedf75a909 tempest-VolumesGetTest-1419827919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff5eccb1-ecac-49b0-b05a-1e69af449913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:29:18 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2d776ff5-d328-4384-b0ce-68eedf75a909 tempest-VolumesGetTest-1419827919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff5eccb1-ecac-49b0-b05a-1e69af449913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:29:18Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1104037676',display_name='tempest-VolumesGetTest-Volume-1400493886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a1b1e27-4260-461c-a665-cf4edfb4fbd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3825839898349d585f9a61920bf5883',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:29:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:29:18Z,use_quota=True,user_id='a5e934656f2b40f3b0af6e623fe0c4a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:29:18 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2d776ff5-d328-4384-b0ce-68eedf75a909 tempest-VolumesGetTest-1419827919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b6c4023-6aca-4921-99d9-c9ff8d656502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:29:18 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2d776ff5-d328-4384-b0ce-68eedf75a909 tempest-VolumesGetTest-1419827919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b6c4023-6aca-4921-99d9-c9ff8d656502) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:29:18 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2d776ff5-d328-4384-b0ce-68eedf75a909 tempest-VolumesGetTest-1419827919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cab2a7d5-1771-407c-a74d-9efd134502ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:29:18 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2d776ff5-d328-4384-b0ce-68eedf75a909 tempest-VolumesGetTest-1419827919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cab2a7d5-1771-407c-a74d-9efd134502ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a1b1e27-4260-461c-a665-cf4edfb4fbd4', 'volume_name': 'volume-7a1b1e27-4260-461c-a665-cf4edfb4fbd4', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:29:18 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2d776ff5-d328-4384-b0ce-68eedf75a909 tempest-VolumesGetTest-1419827919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a211236-602b-4800-9ea0-04d6b186b529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:29:18 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2d776ff5-d328-4384-b0ce-68eedf75a909 tempest-VolumesGetTest-1419827919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a211236-602b-4800-9ea0-04d6b186b529) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:29:18 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2d776ff5-d328-4384-b0ce-68eedf75a909 tempest-VolumesGetTest-1419827919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9f68d51-902d-4b7c-a1ff-59ae9a56358b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:29:18 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-2d776ff5-d328-4384-b0ce-68eedf75a909 tempest-VolumesGetTest-1419827919 None] Volume 7a1b1e27-4260-461c-a665-cf4edfb4fbd4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a1b1e27-4260-461c-a665-cf4edfb4fbd4', 'volume_size': 1} Jul 22 03:29:18 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-2d776ff5-d328-4384-b0ce-68eedf75a909 tempest-VolumesGetTest-1419827919 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:29:18 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-2d776ff5-d328-4384-b0ce-68eedf75a909 tempest-VolumesGetTest-1419827919 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:29:18 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-2d776ff5-d328-4384-b0ce-68eedf75a909 tempest-VolumesGetTest-1419827919 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:29:18Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1104037676',display_name='tempest-VolumesGetTest-Volume-1400493886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a1b1e27-4260-461c-a665-cf4edfb4fbd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3825839898349d585f9a61920bf5883',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:29:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:29:18Z,use_quota=True,user_id='a5e934656f2b40f3b0af6e623fe0c4a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:29:18 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-2d776ff5-d328-4384-b0ce-68eedf75a909 tempest-VolumesGetTest-1419827919 None] Creating volume 7a1b1e27-4260-461c-a665-cf4edfb4fbd4 {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:29:18 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-2d776ff5-d328-4384-b0ce-68eedf75a909 tempest-VolumesGetTest-1419827919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:29:18 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-2d776ff5-d328-4384-b0ce-68eedf75a909 tempest-VolumesGetTest-1419827919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:29:18 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-2d776ff5-d328-4384-b0ce-68eedf75a909 tempest-VolumesGetTest-1419827919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:29:18 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-2d776ff5-d328-4384-b0ce-68eedf75a909 tempest-VolumesGetTest-1419827919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:29:18 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-2d776ff5-d328-4384-b0ce-68eedf75a909 tempest-VolumesGetTest-1419827919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:29:18 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-2d776ff5-d328-4384-b0ce-68eedf75a909 tempest-VolumesGetTest-1419827919 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:29:18 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-2d776ff5-d328-4384-b0ce-68eedf75a909 tempest-VolumesGetTest-1419827919 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:29:18 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2d776ff5-d328-4384-b0ce-68eedf75a909 tempest-VolumesGetTest-1419827919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-7a1b1e27-4260-461c-a665-cf4edfb4fbd4 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:29:18 devstack sudo[102289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-7a1b1e27-4260-461c-a665-cf4edfb4fbd4 1073741824 Jul 22 03:29:18 devstack sudo[102289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:29:18 devstack sudo[102289]: pam_unix(sudo:session): session closed for user root Jul 22 03:29:18 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2d776ff5-d328-4384-b0ce-68eedf75a909 tempest-VolumesGetTest-1419827919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-7a1b1e27-4260-461c-a665-cf4edfb4fbd4 1073741824" returned: 0 in 0.392s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:29:18 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2d776ff5-d328-4384-b0ce-68eedf75a909 tempest-VolumesGetTest-1419827919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-7a1b1e27-4260-461c-a665-cf4edfb4fbd4 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:29:18 devstack sudo[102296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-7a1b1e27-4260-461c-a665-cf4edfb4fbd4 Jul 22 03:29:18 devstack sudo[102296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:29:18 devstack sudo[102296]: pam_unix(sudo:session): session closed for user root Jul 22 03:29:18 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2d776ff5-d328-4384-b0ce-68eedf75a909 tempest-VolumesGetTest-1419827919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-7a1b1e27-4260-461c-a665-cf4edfb4fbd4" returned: 0 in 0.237s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:29:18 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-2d776ff5-d328-4384-b0ce-68eedf75a909 tempest-VolumesGetTest-1419827919 None] <== create_volume: return (667ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:29:18 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-2d776ff5-d328-4384-b0ce-68eedf75a909 tempest-VolumesGetTest-1419827919 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.669s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:29:19 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2d776ff5-d328-4384-b0ce-68eedf75a909 tempest-VolumesGetTest-1419827919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9f68d51-902d-4b7c-a1ff-59ae9a56358b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a1b1e27-4260-461c-a665-cf4edfb4fbd4', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:29:19 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2d776ff5-d328-4384-b0ce-68eedf75a909 tempest-VolumesGetTest-1419827919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f1a05ff-878f-4c73-b36b-6e5007c22cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:29:19 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-2d776ff5-d328-4384-b0ce-68eedf75a909 tempest-VolumesGetTest-1419827919 None] Volume volume-7a1b1e27-4260-461c-a665-cf4edfb4fbd4 (7a1b1e27-4260-461c-a665-cf4edfb4fbd4): created successfully Jul 22 03:29:19 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2d776ff5-d328-4384-b0ce-68eedf75a909 tempest-VolumesGetTest-1419827919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f1a05ff-878f-4c73-b36b-6e5007c22cb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:29:19 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2d776ff5-d328-4384-b0ce-68eedf75a909 tempest-VolumesGetTest-1419827919 None] Flow 'volume_create_manager' (5b64d63b-5323-428b-9468-6ca210d0acba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:29:19 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-2d776ff5-d328-4384-b0ce-68eedf75a909 tempest-VolumesGetTest-1419827919 None] Created volume successfully. Jul 22 03:29:19 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-57ef3441-84ec-463b-9fdd-b8724e75d7fe tempest-VolumesGetTest-1419827919 None] Acquiring lock "cinder-7a1b1e27-4260-461c-a665-cf4edfb4fbd4-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:29:19 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-57ef3441-84ec-463b-9fdd-b8724e75d7fe tempest-VolumesGetTest-1419827919 None] Lock "cinder-7a1b1e27-4260-461c-a665-cf4edfb4fbd4-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:29:19 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-57ef3441-84ec-463b-9fdd-b8724e75d7fe tempest-VolumesGetTest-1419827919 None] Acquiring lock "cinder-quobyte-7a1b1e27-4260-461c-a665-cf4edfb4fbd4" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:29:19 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-57ef3441-84ec-463b-9fdd-b8724e75d7fe tempest-VolumesGetTest-1419827919 None] Lock "cinder-quobyte-7a1b1e27-4260-461c-a665-cf4edfb4fbd4" acquired by "delete_volume" :: waited 0.016s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:29:19 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[bada7b2d-a44e-4e6f-a89a-9773511eea67]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:29:19 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-57ef3441-84ec-463b-9fdd-b8724e75d7fe tempest-VolumesGetTest-1419827919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-7a1b1e27-4260-461c-a665-cf4edfb4fbd4 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:29:19 devstack sudo[102299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-7a1b1e27-4260-461c-a665-cf4edfb4fbd4 Jul 22 03:29:19 devstack sudo[102299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:29:19 devstack sudo[102299]: pam_unix(sudo:session): session closed for user root Jul 22 03:29:19 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-57ef3441-84ec-463b-9fdd-b8724e75d7fe tempest-VolumesGetTest-1419827919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-7a1b1e27-4260-461c-a665-cf4edfb4fbd4" returned: 0 in 0.341s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:29:19 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-57ef3441-84ec-463b-9fdd-b8724e75d7fe tempest-VolumesGetTest-1419827919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-7a1b1e27-4260-461c-a665-cf4edfb4fbd4 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:29:19 devstack sudo[102304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-7a1b1e27-4260-461c-a665-cf4edfb4fbd4 Jul 22 03:29:19 devstack sudo[102304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:29:20 devstack sudo[102304]: pam_unix(sudo:session): session closed for user root Jul 22 03:29:20 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-57ef3441-84ec-463b-9fdd-b8724e75d7fe tempest-VolumesGetTest-1419827919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-7a1b1e27-4260-461c-a665-cf4edfb4fbd4" returned: 0 in 0.255s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:29:20 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-57ef3441-84ec-463b-9fdd-b8724e75d7fe tempest-VolumesGetTest-1419827919 None] Lock "cinder-quobyte-7a1b1e27-4260-461c-a665-cf4edfb4fbd4" released by "delete_volume" :: held 0.633s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:29:20 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-57ef3441-84ec-463b-9fdd-b8724e75d7fe tempest-VolumesGetTest-1419827919 None] Created reservations ['45564a84-cb21-4613-98b0-5cac2f30eb77', '586ae95d-d77c-4eaa-ac8e-41e1574255eb', 'c0e8f23e-addb-45fa-94cc-fc344ffe9112', 'ce83cbbf-5d9c-4801-bac4-9d3290871c60'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:29:20 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-57ef3441-84ec-463b-9fdd-b8724e75d7fe tempest-VolumesGetTest-1419827919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:29:20 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-57ef3441-84ec-463b-9fdd-b8724e75d7fe tempest-VolumesGetTest-1419827919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:29:20 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-57ef3441-84ec-463b-9fdd-b8724e75d7fe tempest-VolumesGetTest-1419827919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:29:20 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-57ef3441-84ec-463b-9fdd-b8724e75d7fe tempest-VolumesGetTest-1419827919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:29:20 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-57ef3441-84ec-463b-9fdd-b8724e75d7fe tempest-VolumesGetTest-1419827919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:29:20 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-57ef3441-84ec-463b-9fdd-b8724e75d7fe tempest-VolumesGetTest-1419827919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:29:20 devstack sudo[102308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:29:20 devstack sudo[102308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:29:20 devstack sudo[102308]: pam_unix(sudo:session): session closed for user root Jul 22 03:29:20 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-57ef3441-84ec-463b-9fdd-b8724e75d7fe tempest-VolumesGetTest-1419827919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.261s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:29:20 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-57ef3441-84ec-463b-9fdd-b8724e75d7fe tempest-VolumesGetTest-1419827919 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:29:20 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-57ef3441-84ec-463b-9fdd-b8724e75d7fe tempest-VolumesGetTest-1419827919 None] Deleted volume successfully. Jul 22 03:29:20 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-57ef3441-84ec-463b-9fdd-b8724e75d7fe tempest-VolumesGetTest-1419827919 None] Lock "cinder-7a1b1e27-4260-461c-a665-cf4edfb4fbd4-delete_volume" released by "delete_volume" :: held 1.107s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:29:20 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-e18c288f-3c2a-4d16-ae66-8158d22e5a99 tempest-VolumesGetTest-1419827919 None] Acquiring lock "cinder-14668822-b72f-4bdf-8c6a-283d7fee8d88-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:29:20 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-e18c288f-3c2a-4d16-ae66-8158d22e5a99 tempest-VolumesGetTest-1419827919 None] Lock "cinder-14668822-b72f-4bdf-8c6a-283d7fee8d88-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:29:20 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-e18c288f-3c2a-4d16-ae66-8158d22e5a99 tempest-VolumesGetTest-1419827919 None] Acquiring lock "cinder-quobyte-14668822-b72f-4bdf-8c6a-283d7fee8d88" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:29:20 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-e18c288f-3c2a-4d16-ae66-8158d22e5a99 tempest-VolumesGetTest-1419827919 None] Lock "cinder-quobyte-14668822-b72f-4bdf-8c6a-283d7fee8d88" acquired by "delete_volume" :: waited 0.018s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:29:20 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb73c27f-14c1-4342-9541-0768844002cf]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:29:20 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-e18c288f-3c2a-4d16-ae66-8158d22e5a99 tempest-VolumesGetTest-1419827919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-14668822-b72f-4bdf-8c6a-283d7fee8d88 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:29:20 devstack sudo[102311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-14668822-b72f-4bdf-8c6a-283d7fee8d88 Jul 22 03:29:20 devstack sudo[102311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:29:21 devstack sudo[102311]: pam_unix(sudo:session): session closed for user root Jul 22 03:29:21 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-e18c288f-3c2a-4d16-ae66-8158d22e5a99 tempest-VolumesGetTest-1419827919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-14668822-b72f-4bdf-8c6a-283d7fee8d88" returned: 0 in 0.350s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:29:21 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-e18c288f-3c2a-4d16-ae66-8158d22e5a99 tempest-VolumesGetTest-1419827919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-14668822-b72f-4bdf-8c6a-283d7fee8d88 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:29:21 devstack sudo[102316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-14668822-b72f-4bdf-8c6a-283d7fee8d88 Jul 22 03:29:21 devstack sudo[102316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:29:21 devstack sudo[102316]: pam_unix(sudo:session): session closed for user root Jul 22 03:29:21 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-e18c288f-3c2a-4d16-ae66-8158d22e5a99 tempest-VolumesGetTest-1419827919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-14668822-b72f-4bdf-8c6a-283d7fee8d88" returned: 0 in 0.242s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:29:21 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-e18c288f-3c2a-4d16-ae66-8158d22e5a99 tempest-VolumesGetTest-1419827919 None] Lock "cinder-quobyte-14668822-b72f-4bdf-8c6a-283d7fee8d88" released by "delete_volume" :: held 0.635s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:29:21 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-e18c288f-3c2a-4d16-ae66-8158d22e5a99 tempest-VolumesGetTest-1419827919 None] Created reservations ['df04b6c7-8d56-4198-96a9-9fc9b52b9ae0', '41bc088d-230c-41ef-9f25-efde95c3f049', 'a4a4350e-26a8-451c-aa88-0e04336d9c64', 'b7a4ec61-cf01-4143-9baf-ae71b83d6c23'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:29:21 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-e18c288f-3c2a-4d16-ae66-8158d22e5a99 tempest-VolumesGetTest-1419827919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:29:21 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-e18c288f-3c2a-4d16-ae66-8158d22e5a99 tempest-VolumesGetTest-1419827919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:29:21 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-e18c288f-3c2a-4d16-ae66-8158d22e5a99 tempest-VolumesGetTest-1419827919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:29:21 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-e18c288f-3c2a-4d16-ae66-8158d22e5a99 tempest-VolumesGetTest-1419827919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:29:21 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-e18c288f-3c2a-4d16-ae66-8158d22e5a99 tempest-VolumesGetTest-1419827919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:29:21 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-e18c288f-3c2a-4d16-ae66-8158d22e5a99 tempest-VolumesGetTest-1419827919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:29:21 devstack sudo[102319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:29:21 devstack sudo[102319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:29:21 devstack sudo[102319]: pam_unix(sudo:session): session closed for user root Jul 22 03:29:21 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-e18c288f-3c2a-4d16-ae66-8158d22e5a99 tempest-VolumesGetTest-1419827919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.238s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:29:21 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-e18c288f-3c2a-4d16-ae66-8158d22e5a99 tempest-VolumesGetTest-1419827919 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:29:21 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-e18c288f-3c2a-4d16-ae66-8158d22e5a99 tempest-VolumesGetTest-1419827919 None] Deleted volume successfully. Jul 22 03:29:21 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-e18c288f-3c2a-4d16-ae66-8158d22e5a99 tempest-VolumesGetTest-1419827919 None] Lock "cinder-14668822-b72f-4bdf-8c6a-283d7fee8d88-delete_volume" released by "delete_volume" :: held 1.066s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:29:22 devstack cinder-volume[87747]: DEBUG oslo_service.periodic_task [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87747) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 03:29:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:29:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:29:22 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:29:22 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:29:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:29:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:29:22 devstack sudo[102322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:29:22 devstack sudo[102322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:29:22 devstack sudo[102322]: pam_unix(sudo:session): session closed for user root Jul 22 03:29:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.242s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:29:22 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:29:22 devstack cinder-volume[87747]: DEBUG oslo_service.periodic_task [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Running periodic task VolumeManager._thread_info {{(pid=87747) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 03:29:22 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] thread count: 28 {{(pid=87747) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 22 03:29:22 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] thread info: [<_MainThread(MainThread, started 132775275860096)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87747) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 22 03:29:26 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-9761f055-61d4-4686-be90-08aba05c2692 tempest-VolumesSnapshotListTestJSON-1605804499 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:29:26 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-9761f055-61d4-4686-be90-08aba05c2692 tempest-VolumesSnapshotListTestJSON-1605804499 None] Flow 'volume_create_manager' (2c3a8663-3780-4220-8635-c753f3477190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:29:26 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-9761f055-61d4-4686-be90-08aba05c2692 tempest-VolumesSnapshotListTestJSON-1605804499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24363336-e3fa-4354-9931-cf8309dd46a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:29:26 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-9761f055-61d4-4686-be90-08aba05c2692 tempest-VolumesSnapshotListTestJSON-1605804499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24363336-e3fa-4354-9931-cf8309dd46a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:29:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-840123057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=157cd78a-ea82-441e-9e94-cb56d764c4be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62e53739b78147409e98e8f773b23592',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:29:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:29:26Z,use_quota=True,user_id='95eee3d6f12d46c2a658cffa24ae5eef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:29:26 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-9761f055-61d4-4686-be90-08aba05c2692 tempest-VolumesSnapshotListTestJSON-1605804499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58e4464f-0eda-4f16-b89c-688cedfd4b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:29:26 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-9761f055-61d4-4686-be90-08aba05c2692 tempest-VolumesSnapshotListTestJSON-1605804499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58e4464f-0eda-4f16-b89c-688cedfd4b60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:29:26 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-9761f055-61d4-4686-be90-08aba05c2692 tempest-VolumesSnapshotListTestJSON-1605804499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eab7842b-601e-41cd-9e72-7dc005b047b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:29:26 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-9761f055-61d4-4686-be90-08aba05c2692 tempest-VolumesSnapshotListTestJSON-1605804499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eab7842b-601e-41cd-9e72-7dc005b047b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '157cd78a-ea82-441e-9e94-cb56d764c4be', 'volume_name': 'volume-157cd78a-ea82-441e-9e94-cb56d764c4be', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:29:26 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-9761f055-61d4-4686-be90-08aba05c2692 tempest-VolumesSnapshotListTestJSON-1605804499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38524e2d-dc04-4d9d-917e-8202bb6f3516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:29:26 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-9761f055-61d4-4686-be90-08aba05c2692 tempest-VolumesSnapshotListTestJSON-1605804499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38524e2d-dc04-4d9d-917e-8202bb6f3516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:29:26 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-9761f055-61d4-4686-be90-08aba05c2692 tempest-VolumesSnapshotListTestJSON-1605804499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (378efe44-050d-4ee6-bb15-fb2f13cf5086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:29:26 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-9761f055-61d4-4686-be90-08aba05c2692 tempest-VolumesSnapshotListTestJSON-1605804499 None] Volume 157cd78a-ea82-441e-9e94-cb56d764c4be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-157cd78a-ea82-441e-9e94-cb56d764c4be', 'volume_size': 1} Jul 22 03:29:26 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-9761f055-61d4-4686-be90-08aba05c2692 tempest-VolumesSnapshotListTestJSON-1605804499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:29:26 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-9761f055-61d4-4686-be90-08aba05c2692 tempest-VolumesSnapshotListTestJSON-1605804499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:29:26 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-9761f055-61d4-4686-be90-08aba05c2692 tempest-VolumesSnapshotListTestJSON-1605804499 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:29:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-840123057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=157cd78a-ea82-441e-9e94-cb56d764c4be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62e53739b78147409e98e8f773b23592',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:29:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:29:26Z,use_quota=True,user_id='95eee3d6f12d46c2a658cffa24ae5eef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:29:26 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-9761f055-61d4-4686-be90-08aba05c2692 tempest-VolumesSnapshotListTestJSON-1605804499 None] Creating volume 157cd78a-ea82-441e-9e94-cb56d764c4be {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:29:26 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-9761f055-61d4-4686-be90-08aba05c2692 tempest-VolumesSnapshotListTestJSON-1605804499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:29:26 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-9761f055-61d4-4686-be90-08aba05c2692 tempest-VolumesSnapshotListTestJSON-1605804499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:29:26 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-9761f055-61d4-4686-be90-08aba05c2692 tempest-VolumesSnapshotListTestJSON-1605804499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:29:26 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-9761f055-61d4-4686-be90-08aba05c2692 tempest-VolumesSnapshotListTestJSON-1605804499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:29:26 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-9761f055-61d4-4686-be90-08aba05c2692 tempest-VolumesSnapshotListTestJSON-1605804499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:29:26 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-9761f055-61d4-4686-be90-08aba05c2692 tempest-VolumesSnapshotListTestJSON-1605804499 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:29:26 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-9761f055-61d4-4686-be90-08aba05c2692 tempest-VolumesSnapshotListTestJSON-1605804499 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:29:26 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-9761f055-61d4-4686-be90-08aba05c2692 tempest-VolumesSnapshotListTestJSON-1605804499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-157cd78a-ea82-441e-9e94-cb56d764c4be 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:29:26 devstack sudo[102327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-157cd78a-ea82-441e-9e94-cb56d764c4be 1073741824 Jul 22 03:29:26 devstack sudo[102327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:29:26 devstack sudo[102327]: pam_unix(sudo:session): session closed for user root Jul 22 03:29:27 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-9761f055-61d4-4686-be90-08aba05c2692 tempest-VolumesSnapshotListTestJSON-1605804499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-157cd78a-ea82-441e-9e94-cb56d764c4be 1073741824" returned: 0 in 0.406s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:29:27 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-9761f055-61d4-4686-be90-08aba05c2692 tempest-VolumesSnapshotListTestJSON-1605804499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-157cd78a-ea82-441e-9e94-cb56d764c4be {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:29:27 devstack sudo[102332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-157cd78a-ea82-441e-9e94-cb56d764c4be Jul 22 03:29:27 devstack sudo[102332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:29:27 devstack sudo[102332]: pam_unix(sudo:session): session closed for user root Jul 22 03:29:27 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-9761f055-61d4-4686-be90-08aba05c2692 tempest-VolumesSnapshotListTestJSON-1605804499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-157cd78a-ea82-441e-9e94-cb56d764c4be" returned: 0 in 0.246s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:29:27 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-9761f055-61d4-4686-be90-08aba05c2692 tempest-VolumesSnapshotListTestJSON-1605804499 None] <== create_volume: return (691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:29:27 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-9761f055-61d4-4686-be90-08aba05c2692 tempest-VolumesSnapshotListTestJSON-1605804499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.693s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:29:27 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-9761f055-61d4-4686-be90-08aba05c2692 tempest-VolumesSnapshotListTestJSON-1605804499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (378efe44-050d-4ee6-bb15-fb2f13cf5086) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-157cd78a-ea82-441e-9e94-cb56d764c4be', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:29:27 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-9761f055-61d4-4686-be90-08aba05c2692 tempest-VolumesSnapshotListTestJSON-1605804499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33ee3473-ea2c-4591-b275-e207d6eae9ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:29:27 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-9761f055-61d4-4686-be90-08aba05c2692 tempest-VolumesSnapshotListTestJSON-1605804499 None] Volume volume-157cd78a-ea82-441e-9e94-cb56d764c4be (157cd78a-ea82-441e-9e94-cb56d764c4be): created successfully Jul 22 03:29:27 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-9761f055-61d4-4686-be90-08aba05c2692 tempest-VolumesSnapshotListTestJSON-1605804499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33ee3473-ea2c-4591-b275-e207d6eae9ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:29:27 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-9761f055-61d4-4686-be90-08aba05c2692 tempest-VolumesSnapshotListTestJSON-1605804499 None] Flow 'volume_create_manager' (2c3a8663-3780-4220-8635-c753f3477190) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:29:27 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-9761f055-61d4-4686-be90-08aba05c2692 tempest-VolumesSnapshotListTestJSON-1605804499 None] Created volume successfully. Jul 22 03:29:27 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-9b28bab7-902a-4c12-a247-62539f6f330b tempest-VolumesSnapshotListTestJSON-1605804499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:29:27 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-9b28bab7-902a-4c12-a247-62539f6f330b tempest-VolumesSnapshotListTestJSON-1605804499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:29:27 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-9b28bab7-902a-4c12-a247-62539f6f330b tempest-VolumesSnapshotListTestJSON-1605804499 None] Creating offline snapshot 1dc8d7a5-3ff3-4951-9c65-2d45f225f8e3 of volume 157cd78a-ea82-441e-9e94-cb56d764c4be {{(pid=87747) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 03:29:27 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[6db371c8-72f1-476b-bf19-39142f53f09f]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:29:27 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-9b28bab7-902a-4c12-a247-62539f6f330b tempest-VolumesSnapshotListTestJSON-1605804499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-157cd78a-ea82-441e-9e94-cb56d764c4be {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:29:27 devstack sudo[102335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-157cd78a-ea82-441e-9e94-cb56d764c4be Jul 22 03:29:27 devstack sudo[102335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:29:28 devstack sudo[102335]: pam_unix(sudo:session): session closed for user root Jul 22 03:29:28 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-9b28bab7-902a-4c12-a247-62539f6f330b tempest-VolumesSnapshotListTestJSON-1605804499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-157cd78a-ea82-441e-9e94-cb56d764c4be" returned: 0 in 0.348s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:29:28 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-9b28bab7-902a-4c12-a247-62539f6f330b tempest-VolumesSnapshotListTestJSON-1605804499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-157cd78a-ea82-441e-9e94-cb56d764c4be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-157cd78a-ea82-441e-9e94-cb56d764c4be.1dc8d7a5-3ff3-4951-9c65-2d45f225f8e3 1G {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:29:28 devstack sudo[102340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-157cd78a-ea82-441e-9e94-cb56d764c4be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-157cd78a-ea82-441e-9e94-cb56d764c4be.1dc8d7a5-3ff3-4951-9c65-2d45f225f8e3 1G Jul 22 03:29:28 devstack sudo[102340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:29:28 devstack sudo[102340]: pam_unix(sudo:session): session closed for user root Jul 22 03:29:28 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-9b28bab7-902a-4c12-a247-62539f6f330b tempest-VolumesSnapshotListTestJSON-1605804499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-157cd78a-ea82-441e-9e94-cb56d764c4be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-157cd78a-ea82-441e-9e94-cb56d764c4be.1dc8d7a5-3ff3-4951-9c65-2d45f225f8e3 1G" returned: 0 in 0.382s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:29:28 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-9b28bab7-902a-4c12-a247-62539f6f330b tempest-VolumesSnapshotListTestJSON-1605804499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-157cd78a-ea82-441e-9e94-cb56d764c4be -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-157cd78a-ea82-441e-9e94-cb56d764c4be.1dc8d7a5-3ff3-4951-9c65-2d45f225f8e3 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:29:28 devstack sudo[102345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-157cd78a-ea82-441e-9e94-cb56d764c4be -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-157cd78a-ea82-441e-9e94-cb56d764c4be.1dc8d7a5-3ff3-4951-9c65-2d45f225f8e3 Jul 22 03:29:28 devstack sudo[102345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:29:28 devstack sudo[102345]: pam_unix(sudo:session): session closed for user root Jul 22 03:29:28 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-9b28bab7-902a-4c12-a247-62539f6f330b tempest-VolumesSnapshotListTestJSON-1605804499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-157cd78a-ea82-441e-9e94-cb56d764c4be -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-157cd78a-ea82-441e-9e94-cb56d764c4be.1dc8d7a5-3ff3-4951-9c65-2d45f225f8e3" returned: 0 in 0.286s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:29:28 devstack cinder-volume[87747]: WARNING cinder.volume.drivers.remotefs [None req-9b28bab7-902a-4c12-a247-62539f6f330b tempest-VolumesSnapshotListTestJSON-1605804499 None] /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-157cd78a-ea82-441e-9e94-cb56d764c4be.1dc8d7a5-3ff3-4951-9c65-2d45f225f8e3 is being set with open permissions: ugo+rw Jul 22 03:29:28 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-9b28bab7-902a-4c12-a247-62539f6f330b tempest-VolumesSnapshotListTestJSON-1605804499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-157cd78a-ea82-441e-9e94-cb56d764c4be.1dc8d7a5-3ff3-4951-9c65-2d45f225f8e3 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:29:28 devstack sudo[102350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-157cd78a-ea82-441e-9e94-cb56d764c4be.1dc8d7a5-3ff3-4951-9c65-2d45f225f8e3 Jul 22 03:29:28 devstack sudo[102350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:29:28 devstack sudo[102350]: pam_unix(sudo:session): session closed for user root Jul 22 03:29:28 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-9b28bab7-902a-4c12-a247-62539f6f330b tempest-VolumesSnapshotListTestJSON-1605804499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-157cd78a-ea82-441e-9e94-cb56d764c4be.1dc8d7a5-3ff3-4951-9c65-2d45f225f8e3" returned: 0 in 0.236s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:29:29 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-9b28bab7-902a-4c12-a247-62539f6f330b tempest-VolumesSnapshotListTestJSON-1605804499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-157cd78a-ea82-441e-9e94-cb56d764c4be.info {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:29:29 devstack sudo[102353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-157cd78a-ea82-441e-9e94-cb56d764c4be.info Jul 22 03:29:29 devstack sudo[102353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:29:29 devstack sudo[102353]: pam_unix(sudo:session): session closed for user root Jul 22 03:29:29 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-9b28bab7-902a-4c12-a247-62539f6f330b tempest-VolumesSnapshotListTestJSON-1605804499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-157cd78a-ea82-441e-9e94-cb56d764c4be.info" returned: 0 in 0.244s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:29:29 devstack cinder-volume[87747]: WARNING cinder.volume.drivers.remotefs [None req-9b28bab7-902a-4c12-a247-62539f6f330b tempest-VolumesSnapshotListTestJSON-1605804499 None] /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-157cd78a-ea82-441e-9e94-cb56d764c4be.info is being set with open permissions: ugo+rw Jul 22 03:29:29 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-9b28bab7-902a-4c12-a247-62539f6f330b tempest-VolumesSnapshotListTestJSON-1605804499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-157cd78a-ea82-441e-9e94-cb56d764c4be.info {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:29:29 devstack sudo[102356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-157cd78a-ea82-441e-9e94-cb56d764c4be.info Jul 22 03:29:29 devstack sudo[102356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:29:29 devstack sudo[102356]: pam_unix(sudo:session): session closed for user root Jul 22 03:29:29 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-9b28bab7-902a-4c12-a247-62539f6f330b tempest-VolumesSnapshotListTestJSON-1605804499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-157cd78a-ea82-441e-9e94-cb56d764c4be.info" returned: 0 in 0.235s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:29:29 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-9b28bab7-902a-4c12-a247-62539f6f330b tempest-VolumesSnapshotListTestJSON-1605804499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.816s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:29:29 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-9b28bab7-902a-4c12-a247-62539f6f330b tempest-VolumesSnapshotListTestJSON-1605804499 None] Create snapshot completed successfully Jul 22 03:29:29 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-758c0280-733d-4100-9390-bbe56ddbd02c tempest-VolumesSnapshotListTestJSON-1605804499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:29:29 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-758c0280-733d-4100-9390-bbe56ddbd02c tempest-VolumesSnapshotListTestJSON-1605804499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:29:29 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-758c0280-733d-4100-9390-bbe56ddbd02c tempest-VolumesSnapshotListTestJSON-1605804499 None] Creating offline snapshot bc77d582-d997-4ef4-9bc3-8bbae064b7c9 of volume 157cd78a-ea82-441e-9e94-cb56d764c4be {{(pid=87747) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 03:29:29 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[0252e07b-7be0-41f1-8e97-4ba2e30f27b0]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:29:29 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-758c0280-733d-4100-9390-bbe56ddbd02c tempest-VolumesSnapshotListTestJSON-1605804499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-157cd78a-ea82-441e-9e94-cb56d764c4be.1dc8d7a5-3ff3-4951-9c65-2d45f225f8e3 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:29:30 devstack sudo[102359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-157cd78a-ea82-441e-9e94-cb56d764c4be.1dc8d7a5-3ff3-4951-9c65-2d45f225f8e3 Jul 22 03:29:30 devstack sudo[102359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:29:30 devstack sudo[102359]: pam_unix(sudo:session): session closed for user root Jul 22 03:29:30 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-758c0280-733d-4100-9390-bbe56ddbd02c tempest-VolumesSnapshotListTestJSON-1605804499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-157cd78a-ea82-441e-9e94-cb56d764c4be.1dc8d7a5-3ff3-4951-9c65-2d45f225f8e3" returned: 0 in 0.353s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:29:30 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-758c0280-733d-4100-9390-bbe56ddbd02c tempest-VolumesSnapshotListTestJSON-1605804499 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-157cd78a-ea82-441e-9e94-cb56d764c4be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87747) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 03:29:30 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-758c0280-733d-4100-9390-bbe56ddbd02c tempest-VolumesSnapshotListTestJSON-1605804499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-157cd78a-ea82-441e-9e94-cb56d764c4be.1dc8d7a5-3ff3-4951-9c65-2d45f225f8e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-157cd78a-ea82-441e-9e94-cb56d764c4be.bc77d582-d997-4ef4-9bc3-8bbae064b7c9 1G {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:29:30 devstack sudo[102364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-157cd78a-ea82-441e-9e94-cb56d764c4be.1dc8d7a5-3ff3-4951-9c65-2d45f225f8e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-157cd78a-ea82-441e-9e94-cb56d764c4be.bc77d582-d997-4ef4-9bc3-8bbae064b7c9 1G Jul 22 03:29:30 devstack sudo[102364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:29:30 devstack sudo[102364]: pam_unix(sudo:session): session closed for user root Jul 22 03:29:30 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-758c0280-733d-4100-9390-bbe56ddbd02c tempest-VolumesSnapshotListTestJSON-1605804499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-157cd78a-ea82-441e-9e94-cb56d764c4be.1dc8d7a5-3ff3-4951-9c65-2d45f225f8e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-157cd78a-ea82-441e-9e94-cb56d764c4be.bc77d582-d997-4ef4-9bc3-8bbae064b7c9 1G" returned: 0 in 0.414s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:29:30 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-758c0280-733d-4100-9390-bbe56ddbd02c tempest-VolumesSnapshotListTestJSON-1605804499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-157cd78a-ea82-441e-9e94-cb56d764c4be.1dc8d7a5-3ff3-4951-9c65-2d45f225f8e3 -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-157cd78a-ea82-441e-9e94-cb56d764c4be.bc77d582-d997-4ef4-9bc3-8bbae064b7c9 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:29:30 devstack sudo[102370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-157cd78a-ea82-441e-9e94-cb56d764c4be.1dc8d7a5-3ff3-4951-9c65-2d45f225f8e3 -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-157cd78a-ea82-441e-9e94-cb56d764c4be.bc77d582-d997-4ef4-9bc3-8bbae064b7c9 Jul 22 03:29:30 devstack sudo[102370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:29:31 devstack sudo[102370]: pam_unix(sudo:session): session closed for user root Jul 22 03:29:31 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-758c0280-733d-4100-9390-bbe56ddbd02c tempest-VolumesSnapshotListTestJSON-1605804499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-157cd78a-ea82-441e-9e94-cb56d764c4be.1dc8d7a5-3ff3-4951-9c65-2d45f225f8e3 -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-157cd78a-ea82-441e-9e94-cb56d764c4be.bc77d582-d997-4ef4-9bc3-8bbae064b7c9" returned: 0 in 0.281s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:29:31 devstack cinder-volume[87747]: WARNING cinder.volume.drivers.remotefs [None req-758c0280-733d-4100-9390-bbe56ddbd02c tempest-VolumesSnapshotListTestJSON-1605804499 None] /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-157cd78a-ea82-441e-9e94-cb56d764c4be.bc77d582-d997-4ef4-9bc3-8bbae064b7c9 is being set with open permissions: ugo+rw Jul 22 03:29:31 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-758c0280-733d-4100-9390-bbe56ddbd02c tempest-VolumesSnapshotListTestJSON-1605804499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-157cd78a-ea82-441e-9e94-cb56d764c4be.bc77d582-d997-4ef4-9bc3-8bbae064b7c9 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:29:31 devstack sudo[102375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-157cd78a-ea82-441e-9e94-cb56d764c4be.bc77d582-d997-4ef4-9bc3-8bbae064b7c9 Jul 22 03:29:31 devstack sudo[102375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:29:31 devstack sudo[102375]: pam_unix(sudo:session): session closed for user root Jul 22 03:29:31 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-758c0280-733d-4100-9390-bbe56ddbd02c tempest-VolumesSnapshotListTestJSON-1605804499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-157cd78a-ea82-441e-9e94-cb56d764c4be.bc77d582-d997-4ef4-9bc3-8bbae064b7c9" returned: 0 in 0.242s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:29:31 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-758c0280-733d-4100-9390-bbe56ddbd02c tempest-VolumesSnapshotListTestJSON-1605804499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.381s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:29:31 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-758c0280-733d-4100-9390-bbe56ddbd02c tempest-VolumesSnapshotListTestJSON-1605804499 None] Create snapshot completed successfully Jul 22 03:29:32 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-2b838580-185d-4587-b789-08ce213de493 tempest-VolumesSnapshotListTestJSON-1605804499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:29:32 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-2b838580-185d-4587-b789-08ce213de493 tempest-VolumesSnapshotListTestJSON-1605804499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:29:32 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-2b838580-185d-4587-b789-08ce213de493 tempest-VolumesSnapshotListTestJSON-1605804499 None] Creating offline snapshot 8559fed1-0a97-4835-9e6d-0cb288609f40 of volume 157cd78a-ea82-441e-9e94-cb56d764c4be {{(pid=87747) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 03:29:32 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[905bfcb7-8502-441a-ba43-e74e9fe317c9]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:29:32 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2b838580-185d-4587-b789-08ce213de493 tempest-VolumesSnapshotListTestJSON-1605804499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-157cd78a-ea82-441e-9e94-cb56d764c4be.bc77d582-d997-4ef4-9bc3-8bbae064b7c9 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:29:32 devstack sudo[102378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-157cd78a-ea82-441e-9e94-cb56d764c4be.bc77d582-d997-4ef4-9bc3-8bbae064b7c9 Jul 22 03:29:32 devstack sudo[102378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:29:32 devstack sudo[102378]: pam_unix(sudo:session): session closed for user root Jul 22 03:29:32 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2b838580-185d-4587-b789-08ce213de493 tempest-VolumesSnapshotListTestJSON-1605804499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-157cd78a-ea82-441e-9e94-cb56d764c4be.bc77d582-d997-4ef4-9bc3-8bbae064b7c9" returned: 0 in 0.343s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:29:32 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-2b838580-185d-4587-b789-08ce213de493 tempest-VolumesSnapshotListTestJSON-1605804499 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-157cd78a-ea82-441e-9e94-cb56d764c4be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87747) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 03:29:32 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2b838580-185d-4587-b789-08ce213de493 tempest-VolumesSnapshotListTestJSON-1605804499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-157cd78a-ea82-441e-9e94-cb56d764c4be.bc77d582-d997-4ef4-9bc3-8bbae064b7c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-157cd78a-ea82-441e-9e94-cb56d764c4be.8559fed1-0a97-4835-9e6d-0cb288609f40 1G {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:29:32 devstack sudo[102383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-157cd78a-ea82-441e-9e94-cb56d764c4be.bc77d582-d997-4ef4-9bc3-8bbae064b7c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-157cd78a-ea82-441e-9e94-cb56d764c4be.8559fed1-0a97-4835-9e6d-0cb288609f40 1G Jul 22 03:29:32 devstack sudo[102383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:29:33 devstack sudo[102383]: pam_unix(sudo:session): session closed for user root Jul 22 03:29:33 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2b838580-185d-4587-b789-08ce213de493 tempest-VolumesSnapshotListTestJSON-1605804499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-157cd78a-ea82-441e-9e94-cb56d764c4be.bc77d582-d997-4ef4-9bc3-8bbae064b7c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-157cd78a-ea82-441e-9e94-cb56d764c4be.8559fed1-0a97-4835-9e6d-0cb288609f40 1G" returned: 0 in 0.435s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:29:33 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2b838580-185d-4587-b789-08ce213de493 tempest-VolumesSnapshotListTestJSON-1605804499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-157cd78a-ea82-441e-9e94-cb56d764c4be.bc77d582-d997-4ef4-9bc3-8bbae064b7c9 -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-157cd78a-ea82-441e-9e94-cb56d764c4be.8559fed1-0a97-4835-9e6d-0cb288609f40 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:29:33 devstack sudo[102388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-157cd78a-ea82-441e-9e94-cb56d764c4be.bc77d582-d997-4ef4-9bc3-8bbae064b7c9 -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-157cd78a-ea82-441e-9e94-cb56d764c4be.8559fed1-0a97-4835-9e6d-0cb288609f40 Jul 22 03:29:33 devstack sudo[102388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:29:33 devstack sudo[102388]: pam_unix(sudo:session): session closed for user root Jul 22 03:29:33 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2b838580-185d-4587-b789-08ce213de493 tempest-VolumesSnapshotListTestJSON-1605804499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-157cd78a-ea82-441e-9e94-cb56d764c4be.bc77d582-d997-4ef4-9bc3-8bbae064b7c9 -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-157cd78a-ea82-441e-9e94-cb56d764c4be.8559fed1-0a97-4835-9e6d-0cb288609f40" returned: 0 in 0.276s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:29:33 devstack cinder-volume[87747]: WARNING cinder.volume.drivers.remotefs [None req-2b838580-185d-4587-b789-08ce213de493 tempest-VolumesSnapshotListTestJSON-1605804499 None] /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-157cd78a-ea82-441e-9e94-cb56d764c4be.8559fed1-0a97-4835-9e6d-0cb288609f40 is being set with open permissions: ugo+rw Jul 22 03:29:33 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2b838580-185d-4587-b789-08ce213de493 tempest-VolumesSnapshotListTestJSON-1605804499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-157cd78a-ea82-441e-9e94-cb56d764c4be.8559fed1-0a97-4835-9e6d-0cb288609f40 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:29:33 devstack sudo[102394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-157cd78a-ea82-441e-9e94-cb56d764c4be.8559fed1-0a97-4835-9e6d-0cb288609f40 Jul 22 03:29:33 devstack sudo[102394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:29:33 devstack sudo[102394]: pam_unix(sudo:session): session closed for user root Jul 22 03:29:33 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2b838580-185d-4587-b789-08ce213de493 tempest-VolumesSnapshotListTestJSON-1605804499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-157cd78a-ea82-441e-9e94-cb56d764c4be.8559fed1-0a97-4835-9e6d-0cb288609f40" returned: 0 in 0.240s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:29:33 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-2b838580-185d-4587-b789-08ce213de493 tempest-VolumesSnapshotListTestJSON-1605804499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.381s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:29:33 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-2b838580-185d-4587-b789-08ce213de493 tempest-VolumesSnapshotListTestJSON-1605804499 None] Create snapshot completed successfully Jul 22 03:29:34 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-999b20d5-b1ee-494f-bdd0-a2cd8b6af28f tempest-VolumesSnapshotListTestJSON-1605804499 None] Acquiring lock "cinder-8559fed1-0a97-4835-9e6d-0cb288609f40-delete_snapshot" by "delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:29:34 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-999b20d5-b1ee-494f-bdd0-a2cd8b6af28f tempest-VolumesSnapshotListTestJSON-1605804499 None] Lock "cinder-8559fed1-0a97-4835-9e6d-0cb288609f40-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:29:34 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-999b20d5-b1ee-494f-bdd0-a2cd8b6af28f tempest-VolumesSnapshotListTestJSON-1605804499 None] Acquiring lock "cinder-quobyte-157cd78a-ea82-441e-9e94-cb56d764c4be" by "delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:29:34 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-999b20d5-b1ee-494f-bdd0-a2cd8b6af28f tempest-VolumesSnapshotListTestJSON-1605804499 None] Lock "cinder-quobyte-157cd78a-ea82-441e-9e94-cb56d764c4be" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:29:34 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-999b20d5-b1ee-494f-bdd0-a2cd8b6af28f tempest-VolumesSnapshotListTestJSON-1605804499 None] Acquiring lock "cinder-quobyte-8559fed1-0a97-4835-9e6d-0cb288609f40" by "_delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:29:34 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-999b20d5-b1ee-494f-bdd0-a2cd8b6af28f tempest-VolumesSnapshotListTestJSON-1605804499 None] Lock "cinder-quobyte-8559fed1-0a97-4835-9e6d-0cb288609f40" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:29:34 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-999b20d5-b1ee-494f-bdd0-a2cd8b6af28f tempest-VolumesSnapshotListTestJSON-1605804499 None] Deleting offline snapshot 8559fed1-0a97-4835-9e6d-0cb288609f40 of volume 157cd78a-ea82-441e-9e94-cb56d764c4be {{(pid=87747) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 03:29:35 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-999b20d5-b1ee-494f-bdd0-a2cd8b6af28f tempest-VolumesSnapshotListTestJSON-1605804499 None] snapshot_file for this snap is: volume-157cd78a-ea82-441e-9e94-cb56d764c4be.8559fed1-0a97-4835-9e6d-0cb288609f40 {{(pid=87747) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 03:29:35 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[f978eb91-7a0c-4aff-bd3e-a53b12743718]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:29:35 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-999b20d5-b1ee-494f-bdd0-a2cd8b6af28f tempest-VolumesSnapshotListTestJSON-1605804499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-157cd78a-ea82-441e-9e94-cb56d764c4be.8559fed1-0a97-4835-9e6d-0cb288609f40 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:29:35 devstack sudo[102397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-157cd78a-ea82-441e-9e94-cb56d764c4be.8559fed1-0a97-4835-9e6d-0cb288609f40 Jul 22 03:29:35 devstack sudo[102397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:29:35 devstack sudo[102397]: pam_unix(sudo:session): session closed for user root Jul 22 03:29:35 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-999b20d5-b1ee-494f-bdd0-a2cd8b6af28f tempest-VolumesSnapshotListTestJSON-1605804499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-157cd78a-ea82-441e-9e94-cb56d764c4be.8559fed1-0a97-4835-9e6d-0cb288609f40" returned: 0 in 0.339s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:29:35 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-999b20d5-b1ee-494f-bdd0-a2cd8b6af28f tempest-VolumesSnapshotListTestJSON-1605804499 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-157cd78a-ea82-441e-9e94-cb56d764c4be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87747) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 03:29:35 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6deecaa-8c04-4bba-b989-4bf783195dc3]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:29:35 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-999b20d5-b1ee-494f-bdd0-a2cd8b6af28f tempest-VolumesSnapshotListTestJSON-1605804499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-157cd78a-ea82-441e-9e94-cb56d764c4be.bc77d582-d997-4ef4-9bc3-8bbae064b7c9 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:29:35 devstack sudo[102402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-157cd78a-ea82-441e-9e94-cb56d764c4be.bc77d582-d997-4ef4-9bc3-8bbae064b7c9 Jul 22 03:29:35 devstack sudo[102402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:29:35 devstack sudo[102402]: pam_unix(sudo:session): session closed for user root Jul 22 03:29:35 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-999b20d5-b1ee-494f-bdd0-a2cd8b6af28f tempest-VolumesSnapshotListTestJSON-1605804499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-157cd78a-ea82-441e-9e94-cb56d764c4be.bc77d582-d997-4ef4-9bc3-8bbae064b7c9" returned: 0 in 0.345s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:29:35 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-999b20d5-b1ee-494f-bdd0-a2cd8b6af28f tempest-VolumesSnapshotListTestJSON-1605804499 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-157cd78a-ea82-441e-9e94-cb56d764c4be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87747) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 03:29:35 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-999b20d5-b1ee-494f-bdd0-a2cd8b6af28f tempest-VolumesSnapshotListTestJSON-1605804499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-157cd78a-ea82-441e-9e94-cb56d764c4be.8559fed1-0a97-4835-9e6d-0cb288609f40 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:29:35 devstack sudo[102407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-157cd78a-ea82-441e-9e94-cb56d764c4be.8559fed1-0a97-4835-9e6d-0cb288609f40 Jul 22 03:29:35 devstack sudo[102407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:29:36 devstack sudo[102407]: pam_unix(sudo:session): session closed for user root Jul 22 03:29:36 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-999b20d5-b1ee-494f-bdd0-a2cd8b6af28f tempest-VolumesSnapshotListTestJSON-1605804499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-157cd78a-ea82-441e-9e94-cb56d764c4be.8559fed1-0a97-4835-9e6d-0cb288609f40" returned: 0 in 0.402s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:29:36 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-999b20d5-b1ee-494f-bdd0-a2cd8b6af28f tempest-VolumesSnapshotListTestJSON-1605804499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-157cd78a-ea82-441e-9e94-cb56d764c4be.8559fed1-0a97-4835-9e6d-0cb288609f40 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:29:36 devstack sudo[102413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-157cd78a-ea82-441e-9e94-cb56d764c4be.8559fed1-0a97-4835-9e6d-0cb288609f40 Jul 22 03:29:36 devstack sudo[102413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:29:36 devstack sudo[102413]: pam_unix(sudo:session): session closed for user root Jul 22 03:29:36 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-999b20d5-b1ee-494f-bdd0-a2cd8b6af28f tempest-VolumesSnapshotListTestJSON-1605804499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-157cd78a-ea82-441e-9e94-cb56d764c4be.8559fed1-0a97-4835-9e6d-0cb288609f40" returned: 0 in 0.244s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:29:36 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-999b20d5-b1ee-494f-bdd0-a2cd8b6af28f tempest-VolumesSnapshotListTestJSON-1605804499 None] Lock "cinder-quobyte-8559fed1-0a97-4835-9e6d-0cb288609f40" released by "_delete_snapshot" :: held 1.412s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:29:36 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-999b20d5-b1ee-494f-bdd0-a2cd8b6af28f tempest-VolumesSnapshotListTestJSON-1605804499 None] Lock "cinder-quobyte-157cd78a-ea82-441e-9e94-cb56d764c4be" released by "delete_snapshot" :: held 1.435s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:29:36 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-999b20d5-b1ee-494f-bdd0-a2cd8b6af28f tempest-VolumesSnapshotListTestJSON-1605804499 None] Created reservations ['96c0f2f1-fa81-47d4-bf19-3be4f4271d27', '0e877d0b-b0b0-44f4-88b4-494a117e262c', 'a7e0adfa-115c-41e2-8fab-7812710ab830', '6b599737-7bca-4556-b769-95767b573eef'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:29:36 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-999b20d5-b1ee-494f-bdd0-a2cd8b6af28f tempest-VolumesSnapshotListTestJSON-1605804499 None] Delete snapshot completed successfully. Jul 22 03:29:36 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-999b20d5-b1ee-494f-bdd0-a2cd8b6af28f tempest-VolumesSnapshotListTestJSON-1605804499 None] Lock "cinder-8559fed1-0a97-4835-9e6d-0cb288609f40-delete_snapshot" released by "delete_snapshot" :: held 1.560s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:29:37 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-15bb1ce9-e142-4f5f-afed-5cc41b2aecdb tempest-VolumesSnapshotListTestJSON-1605804499 None] Acquiring lock "cinder-bc77d582-d997-4ef4-9bc3-8bbae064b7c9-delete_snapshot" by "delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:29:37 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-15bb1ce9-e142-4f5f-afed-5cc41b2aecdb tempest-VolumesSnapshotListTestJSON-1605804499 None] Lock "cinder-bc77d582-d997-4ef4-9bc3-8bbae064b7c9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:29:37 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-15bb1ce9-e142-4f5f-afed-5cc41b2aecdb tempest-VolumesSnapshotListTestJSON-1605804499 None] Acquiring lock "cinder-quobyte-157cd78a-ea82-441e-9e94-cb56d764c4be" by "delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:29:37 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-15bb1ce9-e142-4f5f-afed-5cc41b2aecdb tempest-VolumesSnapshotListTestJSON-1605804499 None] Lock "cinder-quobyte-157cd78a-ea82-441e-9e94-cb56d764c4be" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:29:37 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-15bb1ce9-e142-4f5f-afed-5cc41b2aecdb tempest-VolumesSnapshotListTestJSON-1605804499 None] Acquiring lock "cinder-quobyte-bc77d582-d997-4ef4-9bc3-8bbae064b7c9" by "_delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:29:37 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-15bb1ce9-e142-4f5f-afed-5cc41b2aecdb tempest-VolumesSnapshotListTestJSON-1605804499 None] Lock "cinder-quobyte-bc77d582-d997-4ef4-9bc3-8bbae064b7c9" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:29:37 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-15bb1ce9-e142-4f5f-afed-5cc41b2aecdb tempest-VolumesSnapshotListTestJSON-1605804499 None] Deleting offline snapshot bc77d582-d997-4ef4-9bc3-8bbae064b7c9 of volume 157cd78a-ea82-441e-9e94-cb56d764c4be {{(pid=87747) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 03:29:37 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-15bb1ce9-e142-4f5f-afed-5cc41b2aecdb tempest-VolumesSnapshotListTestJSON-1605804499 None] snapshot_file for this snap is: volume-157cd78a-ea82-441e-9e94-cb56d764c4be.bc77d582-d997-4ef4-9bc3-8bbae064b7c9 {{(pid=87747) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 03:29:37 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae499e32-e248-420e-b221-22c6e228724d]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:29:37 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-15bb1ce9-e142-4f5f-afed-5cc41b2aecdb tempest-VolumesSnapshotListTestJSON-1605804499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-157cd78a-ea82-441e-9e94-cb56d764c4be.bc77d582-d997-4ef4-9bc3-8bbae064b7c9 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:29:37 devstack sudo[102452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-157cd78a-ea82-441e-9e94-cb56d764c4be.bc77d582-d997-4ef4-9bc3-8bbae064b7c9 Jul 22 03:29:37 devstack sudo[102452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:29:37 devstack sudo[102452]: pam_unix(sudo:session): session closed for user root Jul 22 03:29:37 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-15bb1ce9-e142-4f5f-afed-5cc41b2aecdb tempest-VolumesSnapshotListTestJSON-1605804499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-157cd78a-ea82-441e-9e94-cb56d764c4be.bc77d582-d997-4ef4-9bc3-8bbae064b7c9" returned: 0 in 0.358s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:29:37 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-15bb1ce9-e142-4f5f-afed-5cc41b2aecdb tempest-VolumesSnapshotListTestJSON-1605804499 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-157cd78a-ea82-441e-9e94-cb56d764c4be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87747) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 03:29:37 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0447a97-15da-4e13-92c2-0df439f74639]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:29:37 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-15bb1ce9-e142-4f5f-afed-5cc41b2aecdb tempest-VolumesSnapshotListTestJSON-1605804499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-157cd78a-ea82-441e-9e94-cb56d764c4be.1dc8d7a5-3ff3-4951-9c65-2d45f225f8e3 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:29:37 devstack sudo[102457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-157cd78a-ea82-441e-9e94-cb56d764c4be.1dc8d7a5-3ff3-4951-9c65-2d45f225f8e3 Jul 22 03:29:37 devstack sudo[102457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:29:37 devstack sudo[102457]: pam_unix(sudo:session): session closed for user root Jul 22 03:29:37 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-15bb1ce9-e142-4f5f-afed-5cc41b2aecdb tempest-VolumesSnapshotListTestJSON-1605804499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-157cd78a-ea82-441e-9e94-cb56d764c4be.1dc8d7a5-3ff3-4951-9c65-2d45f225f8e3" returned: 0 in 0.357s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:29:37 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-15bb1ce9-e142-4f5f-afed-5cc41b2aecdb tempest-VolumesSnapshotListTestJSON-1605804499 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-157cd78a-ea82-441e-9e94-cb56d764c4be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87747) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 03:29:37 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-15bb1ce9-e142-4f5f-afed-5cc41b2aecdb tempest-VolumesSnapshotListTestJSON-1605804499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-157cd78a-ea82-441e-9e94-cb56d764c4be.bc77d582-d997-4ef4-9bc3-8bbae064b7c9 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:29:37 devstack sudo[102462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-157cd78a-ea82-441e-9e94-cb56d764c4be.bc77d582-d997-4ef4-9bc3-8bbae064b7c9 Jul 22 03:29:37 devstack sudo[102462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:29:38 devstack sudo[102462]: pam_unix(sudo:session): session closed for user root Jul 22 03:29:38 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-15bb1ce9-e142-4f5f-afed-5cc41b2aecdb tempest-VolumesSnapshotListTestJSON-1605804499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-157cd78a-ea82-441e-9e94-cb56d764c4be.bc77d582-d997-4ef4-9bc3-8bbae064b7c9" returned: 0 in 0.355s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:29:38 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-15bb1ce9-e142-4f5f-afed-5cc41b2aecdb tempest-VolumesSnapshotListTestJSON-1605804499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-157cd78a-ea82-441e-9e94-cb56d764c4be.bc77d582-d997-4ef4-9bc3-8bbae064b7c9 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:29:38 devstack sudo[102467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-157cd78a-ea82-441e-9e94-cb56d764c4be.bc77d582-d997-4ef4-9bc3-8bbae064b7c9 Jul 22 03:29:38 devstack sudo[102467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:29:38 devstack sudo[102467]: pam_unix(sudo:session): session closed for user root Jul 22 03:29:38 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-15bb1ce9-e142-4f5f-afed-5cc41b2aecdb tempest-VolumesSnapshotListTestJSON-1605804499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-157cd78a-ea82-441e-9e94-cb56d764c4be.bc77d582-d997-4ef4-9bc3-8bbae064b7c9" returned: 0 in 0.240s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:29:38 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-15bb1ce9-e142-4f5f-afed-5cc41b2aecdb tempest-VolumesSnapshotListTestJSON-1605804499 None] Lock "cinder-quobyte-bc77d582-d997-4ef4-9bc3-8bbae064b7c9" released by "_delete_snapshot" :: held 1.396s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:29:38 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-15bb1ce9-e142-4f5f-afed-5cc41b2aecdb tempest-VolumesSnapshotListTestJSON-1605804499 None] Lock "cinder-quobyte-157cd78a-ea82-441e-9e94-cb56d764c4be" released by "delete_snapshot" :: held 1.417s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:29:38 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-15bb1ce9-e142-4f5f-afed-5cc41b2aecdb tempest-VolumesSnapshotListTestJSON-1605804499 None] Created reservations ['53a6e439-ef12-4249-beb6-9bc0649e3fd6', '83c22688-85ec-40d4-9384-69202dc05eb9', '0f221738-07d8-472a-812f-0f25d4c78f3a', 'd293160b-8722-494c-a894-c45cabe11f5c'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:29:38 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-15bb1ce9-e142-4f5f-afed-5cc41b2aecdb tempest-VolumesSnapshotListTestJSON-1605804499 None] Delete snapshot completed successfully. Jul 22 03:29:38 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-15bb1ce9-e142-4f5f-afed-5cc41b2aecdb tempest-VolumesSnapshotListTestJSON-1605804499 None] Lock "cinder-bc77d582-d997-4ef4-9bc3-8bbae064b7c9-delete_snapshot" released by "delete_snapshot" :: held 1.538s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:29:39 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-66768d37-e2d3-436b-9338-80a249b7b0a0 tempest-VolumesSnapshotListTestJSON-1605804499 None] Acquiring lock "cinder-1dc8d7a5-3ff3-4951-9c65-2d45f225f8e3-delete_snapshot" by "delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:29:39 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-66768d37-e2d3-436b-9338-80a249b7b0a0 tempest-VolumesSnapshotListTestJSON-1605804499 None] Lock "cinder-1dc8d7a5-3ff3-4951-9c65-2d45f225f8e3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:29:39 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-66768d37-e2d3-436b-9338-80a249b7b0a0 tempest-VolumesSnapshotListTestJSON-1605804499 None] Acquiring lock "cinder-quobyte-157cd78a-ea82-441e-9e94-cb56d764c4be" by "delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:29:39 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-66768d37-e2d3-436b-9338-80a249b7b0a0 tempest-VolumesSnapshotListTestJSON-1605804499 None] Lock "cinder-quobyte-157cd78a-ea82-441e-9e94-cb56d764c4be" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:29:39 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-66768d37-e2d3-436b-9338-80a249b7b0a0 tempest-VolumesSnapshotListTestJSON-1605804499 None] Acquiring lock "cinder-quobyte-1dc8d7a5-3ff3-4951-9c65-2d45f225f8e3" by "_delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:29:39 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-66768d37-e2d3-436b-9338-80a249b7b0a0 tempest-VolumesSnapshotListTestJSON-1605804499 None] Lock "cinder-quobyte-1dc8d7a5-3ff3-4951-9c65-2d45f225f8e3" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:29:39 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-66768d37-e2d3-436b-9338-80a249b7b0a0 tempest-VolumesSnapshotListTestJSON-1605804499 None] Deleting offline snapshot 1dc8d7a5-3ff3-4951-9c65-2d45f225f8e3 of volume 157cd78a-ea82-441e-9e94-cb56d764c4be {{(pid=87747) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 03:29:39 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-66768d37-e2d3-436b-9338-80a249b7b0a0 tempest-VolumesSnapshotListTestJSON-1605804499 None] snapshot_file for this snap is: volume-157cd78a-ea82-441e-9e94-cb56d764c4be.1dc8d7a5-3ff3-4951-9c65-2d45f225f8e3 {{(pid=87747) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 03:29:39 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[40ff653c-ec2f-4d6f-8495-e3dac7ab3193]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:29:39 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-66768d37-e2d3-436b-9338-80a249b7b0a0 tempest-VolumesSnapshotListTestJSON-1605804499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-157cd78a-ea82-441e-9e94-cb56d764c4be.1dc8d7a5-3ff3-4951-9c65-2d45f225f8e3 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:29:39 devstack sudo[102470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-157cd78a-ea82-441e-9e94-cb56d764c4be.1dc8d7a5-3ff3-4951-9c65-2d45f225f8e3 Jul 22 03:29:39 devstack sudo[102470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:29:39 devstack sudo[102470]: pam_unix(sudo:session): session closed for user root Jul 22 03:29:39 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-66768d37-e2d3-436b-9338-80a249b7b0a0 tempest-VolumesSnapshotListTestJSON-1605804499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-157cd78a-ea82-441e-9e94-cb56d764c4be.1dc8d7a5-3ff3-4951-9c65-2d45f225f8e3" returned: 0 in 0.347s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:29:39 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-66768d37-e2d3-436b-9338-80a249b7b0a0 tempest-VolumesSnapshotListTestJSON-1605804499 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-157cd78a-ea82-441e-9e94-cb56d764c4be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87747) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 03:29:39 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[882bb3ab-7175-4d6f-b47c-5f709a7e91ad]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:29:39 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-66768d37-e2d3-436b-9338-80a249b7b0a0 tempest-VolumesSnapshotListTestJSON-1605804499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-157cd78a-ea82-441e-9e94-cb56d764c4be {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:29:39 devstack sudo[102475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-157cd78a-ea82-441e-9e94-cb56d764c4be Jul 22 03:29:39 devstack sudo[102475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:29:40 devstack sudo[102475]: pam_unix(sudo:session): session closed for user root Jul 22 03:29:40 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-66768d37-e2d3-436b-9338-80a249b7b0a0 tempest-VolumesSnapshotListTestJSON-1605804499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-157cd78a-ea82-441e-9e94-cb56d764c4be" returned: 0 in 0.342s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:29:40 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-66768d37-e2d3-436b-9338-80a249b7b0a0 tempest-VolumesSnapshotListTestJSON-1605804499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-157cd78a-ea82-441e-9e94-cb56d764c4be.1dc8d7a5-3ff3-4951-9c65-2d45f225f8e3 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:29:40 devstack sudo[102481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-157cd78a-ea82-441e-9e94-cb56d764c4be.1dc8d7a5-3ff3-4951-9c65-2d45f225f8e3 Jul 22 03:29:40 devstack sudo[102481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:29:40 devstack sudo[102481]: pam_unix(sudo:session): session closed for user root Jul 22 03:29:40 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-66768d37-e2d3-436b-9338-80a249b7b0a0 tempest-VolumesSnapshotListTestJSON-1605804499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-157cd78a-ea82-441e-9e94-cb56d764c4be.1dc8d7a5-3ff3-4951-9c65-2d45f225f8e3" returned: 0 in 0.322s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:29:40 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-66768d37-e2d3-436b-9338-80a249b7b0a0 tempest-VolumesSnapshotListTestJSON-1605804499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-157cd78a-ea82-441e-9e94-cb56d764c4be.1dc8d7a5-3ff3-4951-9c65-2d45f225f8e3 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:29:40 devstack sudo[102486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-157cd78a-ea82-441e-9e94-cb56d764c4be.1dc8d7a5-3ff3-4951-9c65-2d45f225f8e3 Jul 22 03:29:40 devstack sudo[102486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:29:40 devstack sudo[102486]: pam_unix(sudo:session): session closed for user root Jul 22 03:29:40 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-66768d37-e2d3-436b-9338-80a249b7b0a0 tempest-VolumesSnapshotListTestJSON-1605804499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-157cd78a-ea82-441e-9e94-cb56d764c4be.1dc8d7a5-3ff3-4951-9c65-2d45f225f8e3" returned: 0 in 0.243s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:29:40 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-66768d37-e2d3-436b-9338-80a249b7b0a0 tempest-VolumesSnapshotListTestJSON-1605804499 None] Lock "cinder-quobyte-1dc8d7a5-3ff3-4951-9c65-2d45f225f8e3" released by "_delete_snapshot" :: held 1.348s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:29:40 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-66768d37-e2d3-436b-9338-80a249b7b0a0 tempest-VolumesSnapshotListTestJSON-1605804499 None] Lock "cinder-quobyte-157cd78a-ea82-441e-9e94-cb56d764c4be" released by "delete_snapshot" :: held 1.368s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:29:40 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-66768d37-e2d3-436b-9338-80a249b7b0a0 tempest-VolumesSnapshotListTestJSON-1605804499 None] Created reservations ['54ab58f2-74f0-4884-87c4-ac6d14cb92f8', '2df03cbd-91fe-4c14-a666-34693e7883de', '1062e873-4f96-4630-bab2-6d59758aa3c4', 'bfde9ce5-b035-4a24-87a9-aae570798df7'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:29:40 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-66768d37-e2d3-436b-9338-80a249b7b0a0 tempest-VolumesSnapshotListTestJSON-1605804499 None] Delete snapshot completed successfully. Jul 22 03:29:40 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-66768d37-e2d3-436b-9338-80a249b7b0a0 tempest-VolumesSnapshotListTestJSON-1605804499 None] Lock "cinder-1dc8d7a5-3ff3-4951-9c65-2d45f225f8e3-delete_snapshot" released by "delete_snapshot" :: held 1.490s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:29:41 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-d2605571-cc92-4cf8-a432-43e3035426c9 tempest-VolumesSnapshotListTestJSON-1605804499 None] Acquiring lock "cinder-157cd78a-ea82-441e-9e94-cb56d764c4be-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:29:41 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-d2605571-cc92-4cf8-a432-43e3035426c9 tempest-VolumesSnapshotListTestJSON-1605804499 None] Lock "cinder-157cd78a-ea82-441e-9e94-cb56d764c4be-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:29:41 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-d2605571-cc92-4cf8-a432-43e3035426c9 tempest-VolumesSnapshotListTestJSON-1605804499 None] Acquiring lock "cinder-quobyte-157cd78a-ea82-441e-9e94-cb56d764c4be" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:29:41 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-d2605571-cc92-4cf8-a432-43e3035426c9 tempest-VolumesSnapshotListTestJSON-1605804499 None] Lock "cinder-quobyte-157cd78a-ea82-441e-9e94-cb56d764c4be" acquired by "delete_volume" :: waited 0.014s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:29:41 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff308a84-4280-40af-96bf-4876f44bf4c5]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:29:41 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d2605571-cc92-4cf8-a432-43e3035426c9 tempest-VolumesSnapshotListTestJSON-1605804499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-157cd78a-ea82-441e-9e94-cb56d764c4be {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:29:41 devstack sudo[102489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-157cd78a-ea82-441e-9e94-cb56d764c4be Jul 22 03:29:41 devstack sudo[102489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:29:41 devstack sudo[102489]: pam_unix(sudo:session): session closed for user root Jul 22 03:29:41 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d2605571-cc92-4cf8-a432-43e3035426c9 tempest-VolumesSnapshotListTestJSON-1605804499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-157cd78a-ea82-441e-9e94-cb56d764c4be" returned: 0 in 0.342s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:29:41 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d2605571-cc92-4cf8-a432-43e3035426c9 tempest-VolumesSnapshotListTestJSON-1605804499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-157cd78a-ea82-441e-9e94-cb56d764c4be {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:29:41 devstack sudo[102494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-157cd78a-ea82-441e-9e94-cb56d764c4be Jul 22 03:29:41 devstack sudo[102494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:29:42 devstack sudo[102494]: pam_unix(sudo:session): session closed for user root Jul 22 03:29:42 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d2605571-cc92-4cf8-a432-43e3035426c9 tempest-VolumesSnapshotListTestJSON-1605804499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-157cd78a-ea82-441e-9e94-cb56d764c4be" returned: 0 in 0.236s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:29:42 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-d2605571-cc92-4cf8-a432-43e3035426c9 tempest-VolumesSnapshotListTestJSON-1605804499 None] Lock "cinder-quobyte-157cd78a-ea82-441e-9e94-cb56d764c4be" released by "delete_volume" :: held 0.631s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:29:42 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-d2605571-cc92-4cf8-a432-43e3035426c9 tempest-VolumesSnapshotListTestJSON-1605804499 None] Created reservations ['9b97e7fe-5d15-4cce-9f73-32cb0ff32cac', 'feac8c4b-6d63-4b79-8a44-499ef3166ed9', 'fae75ba1-eb94-42a3-b47e-11f05739311e', '3147e9a1-d42d-4943-ad9b-17cfabf1e617'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:29:42 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-d2605571-cc92-4cf8-a432-43e3035426c9 tempest-VolumesSnapshotListTestJSON-1605804499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:29:42 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-d2605571-cc92-4cf8-a432-43e3035426c9 tempest-VolumesSnapshotListTestJSON-1605804499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:29:42 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-d2605571-cc92-4cf8-a432-43e3035426c9 tempest-VolumesSnapshotListTestJSON-1605804499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:29:42 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-d2605571-cc92-4cf8-a432-43e3035426c9 tempest-VolumesSnapshotListTestJSON-1605804499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:29:42 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-d2605571-cc92-4cf8-a432-43e3035426c9 tempest-VolumesSnapshotListTestJSON-1605804499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:29:42 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d2605571-cc92-4cf8-a432-43e3035426c9 tempest-VolumesSnapshotListTestJSON-1605804499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:29:42 devstack sudo[102497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:29:42 devstack sudo[102497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:29:42 devstack sudo[102497]: pam_unix(sudo:session): session closed for user root Jul 22 03:29:42 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d2605571-cc92-4cf8-a432-43e3035426c9 tempest-VolumesSnapshotListTestJSON-1605804499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.238s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:29:42 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-d2605571-cc92-4cf8-a432-43e3035426c9 tempest-VolumesSnapshotListTestJSON-1605804499 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:29:42 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-d2605571-cc92-4cf8-a432-43e3035426c9 tempest-VolumesSnapshotListTestJSON-1605804499 None] Deleted volume successfully. Jul 22 03:29:42 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-d2605571-cc92-4cf8-a432-43e3035426c9 tempest-VolumesSnapshotListTestJSON-1605804499 None] Lock "cinder-157cd78a-ea82-441e-9e94-cb56d764c4be-delete_volume" released by "delete_volume" :: held 1.060s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:29:52 devstack cinder-volume[87747]: DEBUG dbcounter [-] [87747] Writing DB stats cinder:SELECT=92,cinder:UPDATE=114,cinder:INSERT=35,cinder:DELETE=5 {{(pid=87747) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 03:29:52 devstack cinder-volume[87747]: DEBUG dbcounter [-] [87747] Writing DB stats cinder:SELECT=87,cinder:UPDATE=108,cinder:DELETE=14,cinder:INSERT=33 {{(pid=87747) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 03:30:13 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-82a8c6c9-10c9-4e06-ae7c-852ee30c7718 tempest-TestMinimumBasicScenario-1268431882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:30:13 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-82a8c6c9-10c9-4e06-ae7c-852ee30c7718 tempest-TestMinimumBasicScenario-1268431882 None] Flow 'volume_create_manager' (9c1ab97d-e016-420e-a8a4-b38d0406cf04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:30:13 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-82a8c6c9-10c9-4e06-ae7c-852ee30c7718 tempest-TestMinimumBasicScenario-1268431882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77c1de82-0642-4f5d-8bb6-6ca094ec291f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:30:13 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-82a8c6c9-10c9-4e06-ae7c-852ee30c7718 tempest-TestMinimumBasicScenario-1268431882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77c1de82-0642-4f5d-8bb6-6ca094ec291f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:30:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1958818206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b63a38c-2b87-48ab-90d2-3aecf6710f52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d1c9b06725649cdabee7897daff1555',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:30:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:30:14Z,use_quota=True,user_id='128a439103b548a1bc9562473d292357',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:30:13 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-82a8c6c9-10c9-4e06-ae7c-852ee30c7718 tempest-TestMinimumBasicScenario-1268431882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51fd3883-3380-4477-b69f-afcc22b7c627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:30:13 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-82a8c6c9-10c9-4e06-ae7c-852ee30c7718 tempest-TestMinimumBasicScenario-1268431882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51fd3883-3380-4477-b69f-afcc22b7c627) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:30:13 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-82a8c6c9-10c9-4e06-ae7c-852ee30c7718 tempest-TestMinimumBasicScenario-1268431882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d86940b-320f-46f0-9c94-217aab06e244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:30:13 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-82a8c6c9-10c9-4e06-ae7c-852ee30c7718 tempest-TestMinimumBasicScenario-1268431882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d86940b-320f-46f0-9c94-217aab06e244) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b63a38c-2b87-48ab-90d2-3aecf6710f52', 'volume_name': 'volume-9b63a38c-2b87-48ab-90d2-3aecf6710f52', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:30:13 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-82a8c6c9-10c9-4e06-ae7c-852ee30c7718 tempest-TestMinimumBasicScenario-1268431882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ad6829f-3e51-4a2c-aefd-4f5c14f0de9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:30:13 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-82a8c6c9-10c9-4e06-ae7c-852ee30c7718 tempest-TestMinimumBasicScenario-1268431882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ad6829f-3e51-4a2c-aefd-4f5c14f0de9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:30:13 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-82a8c6c9-10c9-4e06-ae7c-852ee30c7718 tempest-TestMinimumBasicScenario-1268431882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d4670da-084d-4b79-9f78-c46f779af771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:30:13 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-82a8c6c9-10c9-4e06-ae7c-852ee30c7718 tempest-TestMinimumBasicScenario-1268431882 None] Volume 9b63a38c-2b87-48ab-90d2-3aecf6710f52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b63a38c-2b87-48ab-90d2-3aecf6710f52', 'volume_size': 1} Jul 22 03:30:13 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-82a8c6c9-10c9-4e06-ae7c-852ee30c7718 tempest-TestMinimumBasicScenario-1268431882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:30:13 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-82a8c6c9-10c9-4e06-ae7c-852ee30c7718 tempest-TestMinimumBasicScenario-1268431882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:30:13 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-82a8c6c9-10c9-4e06-ae7c-852ee30c7718 tempest-TestMinimumBasicScenario-1268431882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:30:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1958818206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b63a38c-2b87-48ab-90d2-3aecf6710f52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d1c9b06725649cdabee7897daff1555',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:30:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:30:14Z,use_quota=True,user_id='128a439103b548a1bc9562473d292357',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:30:13 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-82a8c6c9-10c9-4e06-ae7c-852ee30c7718 tempest-TestMinimumBasicScenario-1268431882 None] Creating volume 9b63a38c-2b87-48ab-90d2-3aecf6710f52 {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:30:13 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-82a8c6c9-10c9-4e06-ae7c-852ee30c7718 tempest-TestMinimumBasicScenario-1268431882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:30:13 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-82a8c6c9-10c9-4e06-ae7c-852ee30c7718 tempest-TestMinimumBasicScenario-1268431882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:30:13 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-82a8c6c9-10c9-4e06-ae7c-852ee30c7718 tempest-TestMinimumBasicScenario-1268431882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:30:13 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-82a8c6c9-10c9-4e06-ae7c-852ee30c7718 tempest-TestMinimumBasicScenario-1268431882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:30:13 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-82a8c6c9-10c9-4e06-ae7c-852ee30c7718 tempest-TestMinimumBasicScenario-1268431882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:30:13 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-82a8c6c9-10c9-4e06-ae7c-852ee30c7718 tempest-TestMinimumBasicScenario-1268431882 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:30:13 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-82a8c6c9-10c9-4e06-ae7c-852ee30c7718 tempest-TestMinimumBasicScenario-1268431882 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:30:13 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-82a8c6c9-10c9-4e06-ae7c-852ee30c7718 tempest-TestMinimumBasicScenario-1268431882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9b63a38c-2b87-48ab-90d2-3aecf6710f52 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:30:13 devstack sudo[102625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9b63a38c-2b87-48ab-90d2-3aecf6710f52 1073741824 Jul 22 03:30:13 devstack sudo[102625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:30:14 devstack sudo[102625]: pam_unix(sudo:session): session closed for user root Jul 22 03:30:14 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-82a8c6c9-10c9-4e06-ae7c-852ee30c7718 tempest-TestMinimumBasicScenario-1268431882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9b63a38c-2b87-48ab-90d2-3aecf6710f52 1073741824" returned: 0 in 0.412s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:30:14 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-82a8c6c9-10c9-4e06-ae7c-852ee30c7718 tempest-TestMinimumBasicScenario-1268431882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9b63a38c-2b87-48ab-90d2-3aecf6710f52 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:30:14 devstack sudo[102630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9b63a38c-2b87-48ab-90d2-3aecf6710f52 Jul 22 03:30:14 devstack sudo[102630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:30:14 devstack sudo[102630]: pam_unix(sudo:session): session closed for user root Jul 22 03:30:14 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-82a8c6c9-10c9-4e06-ae7c-852ee30c7718 tempest-TestMinimumBasicScenario-1268431882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9b63a38c-2b87-48ab-90d2-3aecf6710f52" returned: 0 in 0.251s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:30:14 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-82a8c6c9-10c9-4e06-ae7c-852ee30c7718 tempest-TestMinimumBasicScenario-1268431882 None] <== create_volume: return (705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:30:14 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-82a8c6c9-10c9-4e06-ae7c-852ee30c7718 tempest-TestMinimumBasicScenario-1268431882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.708s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:30:14 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-82a8c6c9-10c9-4e06-ae7c-852ee30c7718 tempest-TestMinimumBasicScenario-1268431882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d4670da-084d-4b79-9f78-c46f779af771) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b63a38c-2b87-48ab-90d2-3aecf6710f52', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:30:14 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-82a8c6c9-10c9-4e06-ae7c-852ee30c7718 tempest-TestMinimumBasicScenario-1268431882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0de64029-9185-41e1-8d20-9ada7a3bad85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:30:14 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-82a8c6c9-10c9-4e06-ae7c-852ee30c7718 tempest-TestMinimumBasicScenario-1268431882 None] Volume volume-9b63a38c-2b87-48ab-90d2-3aecf6710f52 (9b63a38c-2b87-48ab-90d2-3aecf6710f52): created successfully Jul 22 03:30:14 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-82a8c6c9-10c9-4e06-ae7c-852ee30c7718 tempest-TestMinimumBasicScenario-1268431882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0de64029-9185-41e1-8d20-9ada7a3bad85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:30:14 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-82a8c6c9-10c9-4e06-ae7c-852ee30c7718 tempest-TestMinimumBasicScenario-1268431882 None] Flow 'volume_create_manager' (9c1ab97d-e016-420e-a8a4-b38d0406cf04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:30:14 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-82a8c6c9-10c9-4e06-ae7c-852ee30c7718 tempest-TestMinimumBasicScenario-1268431882 None] Created volume successfully. Jul 22 03:30:15 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [req-d2ede667-fa6b-47c9-aedf-92053a17ea7e req-19dc3e9b-5e32-4faa-adc4-3e346caeea10 tempest-TestMinimumBasicScenario-1268431882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:30:15 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [req-d2ede667-fa6b-47c9-aedf-92053a17ea7e req-19dc3e9b-5e32-4faa-adc4-3e346caeea10 tempest-TestMinimumBasicScenario-1268431882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:30:15 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [req-d2ede667-fa6b-47c9-aedf-92053a17ea7e req-19dc3e9b-5e32-4faa-adc4-3e346caeea10 tempest-TestMinimumBasicScenario-1268431882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:30:15 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [req-d2ede667-fa6b-47c9-aedf-92053a17ea7e req-19dc3e9b-5e32-4faa-adc4-3e346caeea10 tempest-TestMinimumBasicScenario-1268431882 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f', 'name': 'volume-9b63a38c-2b87-48ab-90d2-3aecf6710f52', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '62bdacc3-3467-4cb4-bbec-2c6c689b3121', 'enforce_multipath': True} {{(pid=87747) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 22 03:30:15 devstack cinder-volume[87747]: INFO cinder.volume.manager [req-d2ede667-fa6b-47c9-aedf-92053a17ea7e req-19dc3e9b-5e32-4faa-adc4-3e346caeea10 tempest-TestMinimumBasicScenario-1268431882 None] attachment_update completed successfully. Jul 22 03:30:22 devstack cinder-volume[87747]: DEBUG oslo_service.periodic_task [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87747) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 03:30:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:30:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:30:22 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:30:22 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:30:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:30:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:30:22 devstack sudo[103037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:30:22 devstack sudo[103037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:30:22 devstack sudo[103037]: pam_unix(sudo:session): session closed for user root Jul 22 03:30:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.384s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:30:22 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:30:22 devstack cinder-volume[87747]: DEBUG oslo_service.periodic_task [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Running periodic task VolumeManager._thread_info {{(pid=87747) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 03:30:22 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] thread count: 28 {{(pid=87747) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 22 03:30:22 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] thread info: [<_MainThread(MainThread, started 132775275860096)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87747) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 22 03:30:25 devstack cinder-volume[87747]: DEBUG dbcounter [-] [87747] Writing DB stats cinder:UPDATE=6,cinder:SELECT=9,cinder:INSERT=1 {{(pid=87747) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 03:30:25 devstack cinder-volume[87747]: DEBUG dbcounter [-] [87747] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=87747) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 03:31:01 devstack cinder-volume[87747]: INFO cinder.volume.manager [req-9230de61-b358-40e4-9f76-8e0d31b79fb7 req-09048b13-c5ab-4476-b39b-dd8ab7a0007d tempest-TestMinimumBasicScenario-1268431882 None] Terminate volume connection completed successfully. Jul 22 03:31:01 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [req-9230de61-b358-40e4-9f76-8e0d31b79fb7 req-09048b13-c5ab-4476-b39b-dd8ab7a0007d tempest-TestMinimumBasicScenario-1268431882 None] Deleting attachment 62bdacc3-3467-4cb4-bbec-2c6c689b3121. {{(pid=87747) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 22 03:31:02 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-1a4d5726-3bc2-498b-bbd2-a5ccd0f448ec tempest-TestMinimumBasicScenario-1268431882 None] Acquiring lock "cinder-9b63a38c-2b87-48ab-90d2-3aecf6710f52-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:31:02 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-1a4d5726-3bc2-498b-bbd2-a5ccd0f448ec tempest-TestMinimumBasicScenario-1268431882 None] Lock "cinder-9b63a38c-2b87-48ab-90d2-3aecf6710f52-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:31:02 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-1a4d5726-3bc2-498b-bbd2-a5ccd0f448ec tempest-TestMinimumBasicScenario-1268431882 None] Acquiring lock "cinder-quobyte-9b63a38c-2b87-48ab-90d2-3aecf6710f52" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:31:02 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-1a4d5726-3bc2-498b-bbd2-a5ccd0f448ec tempest-TestMinimumBasicScenario-1268431882 None] Lock "cinder-quobyte-9b63a38c-2b87-48ab-90d2-3aecf6710f52" acquired by "delete_volume" :: waited 0.016s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:31:02 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aefc87b-b99f-40ce-a8da-32155d68f75d]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:31:02 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-1a4d5726-3bc2-498b-bbd2-a5ccd0f448ec tempest-TestMinimumBasicScenario-1268431882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9b63a38c-2b87-48ab-90d2-3aecf6710f52 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:31:02 devstack sudo[103189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9b63a38c-2b87-48ab-90d2-3aecf6710f52 Jul 22 03:31:02 devstack sudo[103189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:31:03 devstack sudo[103189]: pam_unix(sudo:session): session closed for user root Jul 22 03:31:03 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-1a4d5726-3bc2-498b-bbd2-a5ccd0f448ec tempest-TestMinimumBasicScenario-1268431882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9b63a38c-2b87-48ab-90d2-3aecf6710f52" returned: 0 in 0.347s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:31:03 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-1a4d5726-3bc2-498b-bbd2-a5ccd0f448ec tempest-TestMinimumBasicScenario-1268431882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9b63a38c-2b87-48ab-90d2-3aecf6710f52 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:31:03 devstack sudo[103194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9b63a38c-2b87-48ab-90d2-3aecf6710f52 Jul 22 03:31:03 devstack sudo[103194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:31:03 devstack sudo[103194]: pam_unix(sudo:session): session closed for user root Jul 22 03:31:03 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-1a4d5726-3bc2-498b-bbd2-a5ccd0f448ec tempest-TestMinimumBasicScenario-1268431882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9b63a38c-2b87-48ab-90d2-3aecf6710f52" returned: 0 in 0.238s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:31:03 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-1a4d5726-3bc2-498b-bbd2-a5ccd0f448ec tempest-TestMinimumBasicScenario-1268431882 None] Lock "cinder-quobyte-9b63a38c-2b87-48ab-90d2-3aecf6710f52" released by "delete_volume" :: held 0.625s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:31:03 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-1a4d5726-3bc2-498b-bbd2-a5ccd0f448ec tempest-TestMinimumBasicScenario-1268431882 None] Created reservations ['8f66f858-ae3f-405c-a25a-232a4cf65235', '73de5cf0-be32-4982-a675-378470609203', '37c1d0c1-6c16-4983-94f4-65324bbb97ad', '004890ea-b31e-4d44-94ea-fe458e257b8a'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:31:03 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-1a4d5726-3bc2-498b-bbd2-a5ccd0f448ec tempest-TestMinimumBasicScenario-1268431882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:31:03 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-1a4d5726-3bc2-498b-bbd2-a5ccd0f448ec tempest-TestMinimumBasicScenario-1268431882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:31:03 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-1a4d5726-3bc2-498b-bbd2-a5ccd0f448ec tempest-TestMinimumBasicScenario-1268431882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:31:03 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-1a4d5726-3bc2-498b-bbd2-a5ccd0f448ec tempest-TestMinimumBasicScenario-1268431882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:31:03 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-1a4d5726-3bc2-498b-bbd2-a5ccd0f448ec tempest-TestMinimumBasicScenario-1268431882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:31:03 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-1a4d5726-3bc2-498b-bbd2-a5ccd0f448ec tempest-TestMinimumBasicScenario-1268431882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:31:03 devstack sudo[103198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:31:03 devstack sudo[103198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:31:03 devstack sudo[103198]: pam_unix(sudo:session): session closed for user root Jul 22 03:31:03 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-1a4d5726-3bc2-498b-bbd2-a5ccd0f448ec tempest-TestMinimumBasicScenario-1268431882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.236s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:31:03 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-1a4d5726-3bc2-498b-bbd2-a5ccd0f448ec tempest-TestMinimumBasicScenario-1268431882 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:31:03 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-1a4d5726-3bc2-498b-bbd2-a5ccd0f448ec tempest-TestMinimumBasicScenario-1268431882 None] Deleted volume successfully. Jul 22 03:31:03 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-1a4d5726-3bc2-498b-bbd2-a5ccd0f448ec tempest-TestMinimumBasicScenario-1268431882 None] Lock "cinder-9b63a38c-2b87-48ab-90d2-3aecf6710f52-delete_volume" released by "delete_volume" :: held 1.049s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:31:13 devstack cinder-volume[87747]: DEBUG dbcounter [-] [87747] Writing DB stats cinder:SELECT=6,cinder:INSERT=2,cinder:UPDATE=10 {{(pid=87747) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 03:31:13 devstack cinder-volume[87747]: DEBUG dbcounter [-] [87747] Writing DB stats cinder:SELECT=6,cinder:UPDATE=6,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87747) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 03:31:22 devstack cinder-volume[87747]: DEBUG oslo_service.periodic_task [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87747) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 03:31:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:31:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:31:22 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:31:22 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:31:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:31:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:31:22 devstack sudo[103228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:31:22 devstack sudo[103228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:31:22 devstack sudo[103228]: pam_unix(sudo:session): session closed for user root Jul 22 03:31:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.279s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:31:22 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:31:22 devstack cinder-volume[87747]: DEBUG oslo_service.periodic_task [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Running periodic task VolumeManager._thread_info {{(pid=87747) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 03:31:22 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] thread count: 28 {{(pid=87747) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 22 03:31:22 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] thread info: [<_MainThread(MainThread, started 132775275860096)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87747) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 22 03:31:28 devstack cinder-volume[87747]: DEBUG dbcounter [-] [87747] Writing DB stats cinder:SELECT=1 {{(pid=87747) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 03:31:28 devstack cinder-volume[87747]: DEBUG dbcounter [-] [87747] Writing DB stats cinder:UPDATE=1 {{(pid=87747) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 03:31:34 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-73e1a27b-e11c-4d4c-8ed0-c92c7c26b088 tempest-TestStampPattern-1787521362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:31:34 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-73e1a27b-e11c-4d4c-8ed0-c92c7c26b088 tempest-TestStampPattern-1787521362 None] Flow 'volume_create_manager' (15ccaaab-e789-48d8-9bf2-330114679343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:31:34 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-73e1a27b-e11c-4d4c-8ed0-c92c7c26b088 tempest-TestStampPattern-1787521362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0c68829-ede5-4ce9-864f-a32340cfeda9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:31:34 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-73e1a27b-e11c-4d4c-8ed0-c92c7c26b088 tempest-TestStampPattern-1787521362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0c68829-ede5-4ce9-864f-a32340cfeda9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:31:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-890933947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2273b5e3-7a4d-42dd-b607-d7c2d9c84df6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96b2580b55944d54a5e6134f02da0a84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:31:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:31:35Z,use_quota=True,user_id='792ed30c5874418282306bebc225508b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:31:34 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-73e1a27b-e11c-4d4c-8ed0-c92c7c26b088 tempest-TestStampPattern-1787521362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9f1887b-ac60-4f24-a5f5-f2790fbe2ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:31:34 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-73e1a27b-e11c-4d4c-8ed0-c92c7c26b088 tempest-TestStampPattern-1787521362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9f1887b-ac60-4f24-a5f5-f2790fbe2ea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:31:34 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-73e1a27b-e11c-4d4c-8ed0-c92c7c26b088 tempest-TestStampPattern-1787521362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (526aa01e-65a7-4dd1-b1ad-f93b2c2edce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:31:34 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-73e1a27b-e11c-4d4c-8ed0-c92c7c26b088 tempest-TestStampPattern-1787521362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (526aa01e-65a7-4dd1-b1ad-f93b2c2edce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2273b5e3-7a4d-42dd-b607-d7c2d9c84df6', 'volume_name': 'volume-2273b5e3-7a4d-42dd-b607-d7c2d9c84df6', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:31:34 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-73e1a27b-e11c-4d4c-8ed0-c92c7c26b088 tempest-TestStampPattern-1787521362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f171158-d424-4d7c-a70c-ebca0e9dc743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:31:34 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-73e1a27b-e11c-4d4c-8ed0-c92c7c26b088 tempest-TestStampPattern-1787521362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f171158-d424-4d7c-a70c-ebca0e9dc743) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:31:34 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-73e1a27b-e11c-4d4c-8ed0-c92c7c26b088 tempest-TestStampPattern-1787521362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (309abd83-b25a-444f-94dc-eb42b257770b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:31:34 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-73e1a27b-e11c-4d4c-8ed0-c92c7c26b088 tempest-TestStampPattern-1787521362 None] Volume 2273b5e3-7a4d-42dd-b607-d7c2d9c84df6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2273b5e3-7a4d-42dd-b607-d7c2d9c84df6', 'volume_size': 1} Jul 22 03:31:34 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-73e1a27b-e11c-4d4c-8ed0-c92c7c26b088 tempest-TestStampPattern-1787521362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:31:34 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-73e1a27b-e11c-4d4c-8ed0-c92c7c26b088 tempest-TestStampPattern-1787521362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:31:34 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-73e1a27b-e11c-4d4c-8ed0-c92c7c26b088 tempest-TestStampPattern-1787521362 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:31:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-890933947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2273b5e3-7a4d-42dd-b607-d7c2d9c84df6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96b2580b55944d54a5e6134f02da0a84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:31:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:31:35Z,use_quota=True,user_id='792ed30c5874418282306bebc225508b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:31:34 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-73e1a27b-e11c-4d4c-8ed0-c92c7c26b088 tempest-TestStampPattern-1787521362 None] Creating volume 2273b5e3-7a4d-42dd-b607-d7c2d9c84df6 {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:31:34 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-73e1a27b-e11c-4d4c-8ed0-c92c7c26b088 tempest-TestStampPattern-1787521362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:31:34 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-73e1a27b-e11c-4d4c-8ed0-c92c7c26b088 tempest-TestStampPattern-1787521362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:31:34 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-73e1a27b-e11c-4d4c-8ed0-c92c7c26b088 tempest-TestStampPattern-1787521362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:31:34 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-73e1a27b-e11c-4d4c-8ed0-c92c7c26b088 tempest-TestStampPattern-1787521362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:31:34 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-73e1a27b-e11c-4d4c-8ed0-c92c7c26b088 tempest-TestStampPattern-1787521362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:31:34 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-73e1a27b-e11c-4d4c-8ed0-c92c7c26b088 tempest-TestStampPattern-1787521362 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:31:34 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-73e1a27b-e11c-4d4c-8ed0-c92c7c26b088 tempest-TestStampPattern-1787521362 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:31:34 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-73e1a27b-e11c-4d4c-8ed0-c92c7c26b088 tempest-TestStampPattern-1787521362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2273b5e3-7a4d-42dd-b607-d7c2d9c84df6 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:31:34 devstack sudo[103235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2273b5e3-7a4d-42dd-b607-d7c2d9c84df6 1073741824 Jul 22 03:31:34 devstack sudo[103235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:31:35 devstack sudo[103235]: pam_unix(sudo:session): session closed for user root Jul 22 03:31:35 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-73e1a27b-e11c-4d4c-8ed0-c92c7c26b088 tempest-TestStampPattern-1787521362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2273b5e3-7a4d-42dd-b607-d7c2d9c84df6 1073741824" returned: 0 in 0.417s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:31:35 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-73e1a27b-e11c-4d4c-8ed0-c92c7c26b088 tempest-TestStampPattern-1787521362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2273b5e3-7a4d-42dd-b607-d7c2d9c84df6 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:31:35 devstack sudo[103241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2273b5e3-7a4d-42dd-b607-d7c2d9c84df6 Jul 22 03:31:35 devstack sudo[103241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:31:35 devstack sudo[103241]: pam_unix(sudo:session): session closed for user root Jul 22 03:31:35 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-73e1a27b-e11c-4d4c-8ed0-c92c7c26b088 tempest-TestStampPattern-1787521362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2273b5e3-7a4d-42dd-b607-d7c2d9c84df6" returned: 0 in 0.262s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:31:35 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-73e1a27b-e11c-4d4c-8ed0-c92c7c26b088 tempest-TestStampPattern-1787521362 None] <== create_volume: return (727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:31:35 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-73e1a27b-e11c-4d4c-8ed0-c92c7c26b088 tempest-TestStampPattern-1787521362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.729s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:31:35 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-73e1a27b-e11c-4d4c-8ed0-c92c7c26b088 tempest-TestStampPattern-1787521362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (309abd83-b25a-444f-94dc-eb42b257770b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2273b5e3-7a4d-42dd-b607-d7c2d9c84df6', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:31:35 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-73e1a27b-e11c-4d4c-8ed0-c92c7c26b088 tempest-TestStampPattern-1787521362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12c51806-5127-4a81-af65-c35c7c5a1e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:31:35 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-73e1a27b-e11c-4d4c-8ed0-c92c7c26b088 tempest-TestStampPattern-1787521362 None] Volume volume-2273b5e3-7a4d-42dd-b607-d7c2d9c84df6 (2273b5e3-7a4d-42dd-b607-d7c2d9c84df6): created successfully Jul 22 03:31:35 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-73e1a27b-e11c-4d4c-8ed0-c92c7c26b088 tempest-TestStampPattern-1787521362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12c51806-5127-4a81-af65-c35c7c5a1e68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:31:35 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-73e1a27b-e11c-4d4c-8ed0-c92c7c26b088 tempest-TestStampPattern-1787521362 None] Flow 'volume_create_manager' (15ccaaab-e789-48d8-9bf2-330114679343) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:31:35 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-73e1a27b-e11c-4d4c-8ed0-c92c7c26b088 tempest-TestStampPattern-1787521362 None] Created volume successfully. Jul 22 03:31:45 devstack cinder-volume[87747]: DEBUG dbcounter [-] [87747] Writing DB stats cinder:SELECT=4,cinder:UPDATE=5 {{(pid=87747) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 03:31:45 devstack cinder-volume[87747]: DEBUG dbcounter [-] [87747] Writing DB stats cinder:INSERT=1,cinder:UPDATE=1,cinder:DELETE=1 {{(pid=87747) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 03:32:04 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [req-3c1a49cc-f4c5-4741-8828-86afae00b3af req-f40aeeac-7842-4fe1-ac21-ddd25d423f6d tempest-TestStampPattern-1787521362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:32:04 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [req-3c1a49cc-f4c5-4741-8828-86afae00b3af req-f40aeeac-7842-4fe1-ac21-ddd25d423f6d tempest-TestStampPattern-1787521362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:32:04 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [req-3c1a49cc-f4c5-4741-8828-86afae00b3af req-f40aeeac-7842-4fe1-ac21-ddd25d423f6d tempest-TestStampPattern-1787521362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:32:04 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [req-3c1a49cc-f4c5-4741-8828-86afae00b3af req-f40aeeac-7842-4fe1-ac21-ddd25d423f6d tempest-TestStampPattern-1787521362 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f', 'name': 'volume-2273b5e3-7a4d-42dd-b607-d7c2d9c84df6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6da5025f-72cb-4844-8d8c-9939e69d3682', 'enforce_multipath': True} {{(pid=87747) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 22 03:32:04 devstack cinder-volume[87747]: INFO cinder.volume.manager [req-3c1a49cc-f4c5-4741-8828-86afae00b3af req-f40aeeac-7842-4fe1-ac21-ddd25d423f6d tempest-TestStampPattern-1787521362 None] attachment_update completed successfully. Jul 22 03:32:08 devstack cinder-volume[87747]: INFO cinder.volume.manager [req-50b22f42-ace0-4c4b-8eec-3b1902ac12f0 req-1e5ab112-d24e-4fe0-8d77-731f0383b56e tempest-TestStampPattern-1787521362 None] Terminate volume connection completed successfully. Jul 22 03:32:08 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [req-50b22f42-ace0-4c4b-8eec-3b1902ac12f0 req-1e5ab112-d24e-4fe0-8d77-731f0383b56e tempest-TestStampPattern-1787521362 None] Deleting attachment 6da5025f-72cb-4844-8d8c-9939e69d3682. {{(pid=87747) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 22 03:32:09 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-3486899c-ef18-49e9-8094-d2ede9ae8e57 tempest-TestStampPattern-1787521362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:32:09 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-3486899c-ef18-49e9-8094-d2ede9ae8e57 tempest-TestStampPattern-1787521362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:32:09 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-3486899c-ef18-49e9-8094-d2ede9ae8e57 tempest-TestStampPattern-1787521362 None] Creating offline snapshot 7e5599d9-1a1a-498d-9045-ed0d10b15692 of volume 2273b5e3-7a4d-42dd-b607-d7c2d9c84df6 {{(pid=87747) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 03:32:09 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aed3f1e-82d6-4276-b89b-bc326cfefd92]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:32:09 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-3486899c-ef18-49e9-8094-d2ede9ae8e57 tempest-TestStampPattern-1787521362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2273b5e3-7a4d-42dd-b607-d7c2d9c84df6 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:32:09 devstack sudo[103841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2273b5e3-7a4d-42dd-b607-d7c2d9c84df6 Jul 22 03:32:09 devstack sudo[103841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:32:09 devstack sudo[103841]: pam_unix(sudo:session): session closed for user root Jul 22 03:32:09 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-3486899c-ef18-49e9-8094-d2ede9ae8e57 tempest-TestStampPattern-1787521362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2273b5e3-7a4d-42dd-b607-d7c2d9c84df6" returned: 0 in 0.357s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:32:09 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-3486899c-ef18-49e9-8094-d2ede9ae8e57 tempest-TestStampPattern-1787521362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2273b5e3-7a4d-42dd-b607-d7c2d9c84df6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2273b5e3-7a4d-42dd-b607-d7c2d9c84df6.7e5599d9-1a1a-498d-9045-ed0d10b15692 1G {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:32:09 devstack sudo[103846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2273b5e3-7a4d-42dd-b607-d7c2d9c84df6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2273b5e3-7a4d-42dd-b607-d7c2d9c84df6.7e5599d9-1a1a-498d-9045-ed0d10b15692 1G Jul 22 03:32:09 devstack sudo[103846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:32:10 devstack sudo[103846]: pam_unix(sudo:session): session closed for user root Jul 22 03:32:10 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-3486899c-ef18-49e9-8094-d2ede9ae8e57 tempest-TestStampPattern-1787521362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2273b5e3-7a4d-42dd-b607-d7c2d9c84df6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2273b5e3-7a4d-42dd-b607-d7c2d9c84df6.7e5599d9-1a1a-498d-9045-ed0d10b15692 1G" returned: 0 in 0.389s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:32:10 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-3486899c-ef18-49e9-8094-d2ede9ae8e57 tempest-TestStampPattern-1787521362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2273b5e3-7a4d-42dd-b607-d7c2d9c84df6 -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2273b5e3-7a4d-42dd-b607-d7c2d9c84df6.7e5599d9-1a1a-498d-9045-ed0d10b15692 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:32:10 devstack sudo[103851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2273b5e3-7a4d-42dd-b607-d7c2d9c84df6 -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2273b5e3-7a4d-42dd-b607-d7c2d9c84df6.7e5599d9-1a1a-498d-9045-ed0d10b15692 Jul 22 03:32:10 devstack sudo[103851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:32:10 devstack sudo[103851]: pam_unix(sudo:session): session closed for user root Jul 22 03:32:10 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-3486899c-ef18-49e9-8094-d2ede9ae8e57 tempest-TestStampPattern-1787521362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2273b5e3-7a4d-42dd-b607-d7c2d9c84df6 -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2273b5e3-7a4d-42dd-b607-d7c2d9c84df6.7e5599d9-1a1a-498d-9045-ed0d10b15692" returned: 0 in 0.293s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:32:10 devstack cinder-volume[87747]: WARNING cinder.volume.drivers.remotefs [None req-3486899c-ef18-49e9-8094-d2ede9ae8e57 tempest-TestStampPattern-1787521362 None] /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2273b5e3-7a4d-42dd-b607-d7c2d9c84df6.7e5599d9-1a1a-498d-9045-ed0d10b15692 is being set with open permissions: ugo+rw Jul 22 03:32:10 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-3486899c-ef18-49e9-8094-d2ede9ae8e57 tempest-TestStampPattern-1787521362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2273b5e3-7a4d-42dd-b607-d7c2d9c84df6.7e5599d9-1a1a-498d-9045-ed0d10b15692 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:32:10 devstack sudo[103856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2273b5e3-7a4d-42dd-b607-d7c2d9c84df6.7e5599d9-1a1a-498d-9045-ed0d10b15692 Jul 22 03:32:10 devstack sudo[103856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:32:10 devstack sudo[103856]: pam_unix(sudo:session): session closed for user root Jul 22 03:32:10 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-3486899c-ef18-49e9-8094-d2ede9ae8e57 tempest-TestStampPattern-1787521362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2273b5e3-7a4d-42dd-b607-d7c2d9c84df6.7e5599d9-1a1a-498d-9045-ed0d10b15692" returned: 0 in 0.240s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:32:10 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-3486899c-ef18-49e9-8094-d2ede9ae8e57 tempest-TestStampPattern-1787521362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2273b5e3-7a4d-42dd-b607-d7c2d9c84df6.info {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:32:10 devstack sudo[103859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2273b5e3-7a4d-42dd-b607-d7c2d9c84df6.info Jul 22 03:32:10 devstack sudo[103859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:32:10 devstack sudo[103859]: pam_unix(sudo:session): session closed for user root Jul 22 03:32:10 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-3486899c-ef18-49e9-8094-d2ede9ae8e57 tempest-TestStampPattern-1787521362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2273b5e3-7a4d-42dd-b607-d7c2d9c84df6.info" returned: 0 in 0.241s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:32:10 devstack cinder-volume[87747]: WARNING cinder.volume.drivers.remotefs [None req-3486899c-ef18-49e9-8094-d2ede9ae8e57 tempest-TestStampPattern-1787521362 None] /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2273b5e3-7a4d-42dd-b607-d7c2d9c84df6.info is being set with open permissions: ugo+rw Jul 22 03:32:10 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-3486899c-ef18-49e9-8094-d2ede9ae8e57 tempest-TestStampPattern-1787521362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2273b5e3-7a4d-42dd-b607-d7c2d9c84df6.info {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:32:11 devstack sudo[103862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2273b5e3-7a4d-42dd-b607-d7c2d9c84df6.info Jul 22 03:32:11 devstack sudo[103862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:32:11 devstack sudo[103862]: pam_unix(sudo:session): session closed for user root Jul 22 03:32:11 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-3486899c-ef18-49e9-8094-d2ede9ae8e57 tempest-TestStampPattern-1787521362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2273b5e3-7a4d-42dd-b607-d7c2d9c84df6.info" returned: 0 in 0.246s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:32:11 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-3486899c-ef18-49e9-8094-d2ede9ae8e57 tempest-TestStampPattern-1787521362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.845s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:32:11 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-3486899c-ef18-49e9-8094-d2ede9ae8e57 tempest-TestStampPattern-1787521362 None] Create snapshot completed successfully Jul 22 03:32:18 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4f63012-3da1-4edd-9732-a1e5efdaa218 tempest-TestStampPattern-1787521362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:32:18 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f4f63012-3da1-4edd-9732-a1e5efdaa218 tempest-TestStampPattern-1787521362 None] Flow 'volume_create_manager' (2c926b5a-e36f-45be-9263-8cbc69e84133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:32:18 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f4f63012-3da1-4edd-9732-a1e5efdaa218 tempest-TestStampPattern-1787521362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8d42e0a-9cc1-466b-8b48-99dcf48aa055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:32:18 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f4f63012-3da1-4edd-9732-a1e5efdaa218 tempest-TestStampPattern-1787521362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8d42e0a-9cc1-466b-8b48-99dcf48aa055) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:32:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1843860694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7213c9e-dfb2-44d4-beb7-c9b940c893c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96b2580b55944d54a5e6134f02da0a84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:32:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7e5599d9-1a1a-498d-9045-ed0d10b15692,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:32:18Z,use_quota=True,user_id='792ed30c5874418282306bebc225508b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:32:18 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f4f63012-3da1-4edd-9732-a1e5efdaa218 tempest-TestStampPattern-1787521362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fccb9b7-2c8c-4f07-a1b3-9af45bb1cfa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:32:18 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f4f63012-3da1-4edd-9732-a1e5efdaa218 tempest-TestStampPattern-1787521362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fccb9b7-2c8c-4f07-a1b3-9af45bb1cfa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:32:18 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f4f63012-3da1-4edd-9732-a1e5efdaa218 tempest-TestStampPattern-1787521362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8516b10f-3ddb-41c8-b5f6-cde858ecf7ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:32:18 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f4f63012-3da1-4edd-9732-a1e5efdaa218 tempest-TestStampPattern-1787521362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8516b10f-3ddb-41c8-b5f6-cde858ecf7ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c7213c9e-dfb2-44d4-beb7-c9b940c893c4', 'volume_name': 'volume-c7213c9e-dfb2-44d4-beb7-c9b940c893c4', 'volume_size': 1, 'snapshot_id': '7e5599d9-1a1a-498d-9045-ed0d10b15692'}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:32:18 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f4f63012-3da1-4edd-9732-a1e5efdaa218 tempest-TestStampPattern-1787521362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ff4071a-8dc4-4745-be79-82a784dd63e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:32:18 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f4f63012-3da1-4edd-9732-a1e5efdaa218 tempest-TestStampPattern-1787521362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ff4071a-8dc4-4745-be79-82a784dd63e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:32:18 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f4f63012-3da1-4edd-9732-a1e5efdaa218 tempest-TestStampPattern-1787521362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d510b0d-fce4-4dbf-819d-93651dc8cae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:32:18 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-f4f63012-3da1-4edd-9732-a1e5efdaa218 tempest-TestStampPattern-1787521362 None] Volume c7213c9e-dfb2-44d4-beb7-c9b940c893c4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c7213c9e-dfb2-44d4-beb7-c9b940c893c4', 'volume_size': 1, 'snapshot_id': '7e5599d9-1a1a-498d-9045-ed0d10b15692'} Jul 22 03:32:18 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-f4f63012-3da1-4edd-9732-a1e5efdaa218 tempest-TestStampPattern-1787521362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:32:18 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-f4f63012-3da1-4edd-9732-a1e5efdaa218 tempest-TestStampPattern-1787521362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:32:18 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-f4f63012-3da1-4edd-9732-a1e5efdaa218 tempest-TestStampPattern-1787521362 None] Acquiring lock "cinder-quobyte-7e5599d9-1a1a-498d-9045-ed0d10b15692-c7213c9e-dfb2-44d4-beb7-c9b940c893c4" by "_create_volume_from_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:32:18 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-f4f63012-3da1-4edd-9732-a1e5efdaa218 tempest-TestStampPattern-1787521362 None] Lock "cinder-quobyte-7e5599d9-1a1a-498d-9045-ed0d10b15692-c7213c9e-dfb2-44d4-beb7-c9b940c893c4" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:32:18 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-f4f63012-3da1-4edd-9732-a1e5efdaa218 tempest-TestStampPattern-1787521362 None] Creating volume c7213c9e-dfb2-44d4-beb7-c9b940c893c4 from snapshot 7e5599d9-1a1a-498d-9045-ed0d10b15692 {{(pid=87747) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 22 03:32:18 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-f4f63012-3da1-4edd-9732-a1e5efdaa218 tempest-TestStampPattern-1787521362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:32:18 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-f4f63012-3da1-4edd-9732-a1e5efdaa218 tempest-TestStampPattern-1787521362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:32:18 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-f4f63012-3da1-4edd-9732-a1e5efdaa218 tempest-TestStampPattern-1787521362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:32:18 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-f4f63012-3da1-4edd-9732-a1e5efdaa218 tempest-TestStampPattern-1787521362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:32:18 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-f4f63012-3da1-4edd-9732-a1e5efdaa218 tempest-TestStampPattern-1787521362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:32:18 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-f4f63012-3da1-4edd-9732-a1e5efdaa218 tempest-TestStampPattern-1787521362 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:32:18 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-f4f63012-3da1-4edd-9732-a1e5efdaa218 tempest-TestStampPattern-1787521362 None] Acquiring lock "cinder-quobyte-c7213c9e-dfb2-44d4-beb7-c9b940c893c4" by "_copy_volume_from_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:32:18 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-f4f63012-3da1-4edd-9732-a1e5efdaa218 tempest-TestStampPattern-1787521362 None] Lock "cinder-quobyte-c7213c9e-dfb2-44d4-beb7-c9b940c893c4" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:32:18 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-f4f63012-3da1-4edd-9732-a1e5efdaa218 tempest-TestStampPattern-1787521362 None] snapshot: 7e5599d9-1a1a-498d-9045-ed0d10b15692, volume: c7213c9e-dfb2-44d4-beb7-c9b940c893c4, {{(pid=87747) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 22 03:32:18 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-f4f63012-3da1-4edd-9732-a1e5efdaa218 tempest-TestStampPattern-1787521362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:32:18 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-f4f63012-3da1-4edd-9732-a1e5efdaa218 tempest-TestStampPattern-1787521362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:32:18 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-f4f63012-3da1-4edd-9732-a1e5efdaa218 tempest-TestStampPattern-1787521362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:32:18 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-f4f63012-3da1-4edd-9732-a1e5efdaa218 tempest-TestStampPattern-1787521362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:32:18 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-f4f63012-3da1-4edd-9732-a1e5efdaa218 tempest-TestStampPattern-1787521362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:32:18 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba7abdbb-364a-4900-90ae-322cfe3fa663]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:32:18 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f4f63012-3da1-4edd-9732-a1e5efdaa218 tempest-TestStampPattern-1787521362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2273b5e3-7a4d-42dd-b607-d7c2d9c84df6.7e5599d9-1a1a-498d-9045-ed0d10b15692 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:32:18 devstack sudo[103896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2273b5e3-7a4d-42dd-b607-d7c2d9c84df6.7e5599d9-1a1a-498d-9045-ed0d10b15692 Jul 22 03:32:18 devstack sudo[103896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:32:18 devstack sudo[103896]: pam_unix(sudo:session): session closed for user root Jul 22 03:32:18 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f4f63012-3da1-4edd-9732-a1e5efdaa218 tempest-TestStampPattern-1787521362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2273b5e3-7a4d-42dd-b607-d7c2d9c84df6.7e5599d9-1a1a-498d-9045-ed0d10b15692" returned: 0 in 0.369s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:32:18 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-f4f63012-3da1-4edd-9732-a1e5efdaa218 tempest-TestStampPattern-1787521362 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2273b5e3-7a4d-42dd-b607-d7c2d9c84df6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87747) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 03:32:18 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-f4f63012-3da1-4edd-9732-a1e5efdaa218 tempest-TestStampPattern-1787521362 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2273b5e3-7a4d-42dd-b607-d7c2d9c84df6 {{(pid=87747) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 22 03:32:18 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-f4f63012-3da1-4edd-9732-a1e5efdaa218 tempest-TestStampPattern-1787521362 None] Creating direct copy from snapshot {{(pid=87747) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 22 03:32:18 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[c998f622-920d-4bb0-ba2a-c90626563de6]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:32:18 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f4f63012-3da1-4edd-9732-a1e5efdaa218 tempest-TestStampPattern-1787521362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2273b5e3-7a4d-42dd-b607-d7c2d9c84df6 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:32:18 devstack sudo[103901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2273b5e3-7a4d-42dd-b607-d7c2d9c84df6 Jul 22 03:32:18 devstack sudo[103901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:32:19 devstack sudo[103901]: pam_unix(sudo:session): session closed for user root Jul 22 03:32:19 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f4f63012-3da1-4edd-9732-a1e5efdaa218 tempest-TestStampPattern-1787521362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2273b5e3-7a4d-42dd-b607-d7c2d9c84df6" returned: 0 in 0.388s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:32:19 devstack cinder-volume[87747]: DEBUG cinder.utils [None req-f4f63012-3da1-4edd-9732-a1e5efdaa218 tempest-TestStampPattern-1787521362 None] Path /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c7213c9e-dfb2-44d4-beb7-c9b940c893c4 not found in is_blk_device check {{(pid=87747) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 22 03:32:19 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f4f63012-3da1-4edd-9732-a1e5efdaa218 tempest-TestStampPattern-1787521362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2273b5e3-7a4d-42dd-b607-d7c2d9c84df6 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c7213c9e-dfb2-44d4-beb7-c9b940c893c4 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:32:19 devstack sudo[103909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2273b5e3-7a4d-42dd-b607-d7c2d9c84df6 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c7213c9e-dfb2-44d4-beb7-c9b940c893c4 Jul 22 03:32:19 devstack sudo[103909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:32:22 devstack cinder-volume[87747]: DEBUG oslo_service.periodic_task [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87747) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 03:32:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:32:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:32:22 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:32:22 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:32:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:32:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:32:22 devstack sudo[103923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:32:22 devstack sudo[103923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:32:23 devstack sudo[103923]: pam_unix(sudo:session): session closed for user root Jul 22 03:32:23 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.788s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:32:23 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:32:23 devstack cinder-volume[87747]: DEBUG oslo_service.periodic_task [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Running periodic task VolumeManager._thread_info {{(pid=87747) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 03:32:23 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] thread count: 28 {{(pid=87747) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 22 03:32:23 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] thread info: [<_MainThread(MainThread, started 132775275860096)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87747) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 22 03:32:24 devstack sudo[103909]: pam_unix(sudo:session): session closed for user root Jul 22 03:32:24 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f4f63012-3da1-4edd-9732-a1e5efdaa218 tempest-TestStampPattern-1787521362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2273b5e3-7a4d-42dd-b607-d7c2d9c84df6 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c7213c9e-dfb2-44d4-beb7-c9b940c893c4" returned: 0 in 5.665s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:32:24 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[95de0827-ddf1-4f80-a554-e332e5fb33b8]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:32:24 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f4f63012-3da1-4edd-9732-a1e5efdaa218 tempest-TestStampPattern-1787521362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2273b5e3-7a4d-42dd-b607-d7c2d9c84df6 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:32:24 devstack sudo[103939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2273b5e3-7a4d-42dd-b607-d7c2d9c84df6 Jul 22 03:32:24 devstack sudo[103939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:32:25 devstack sudo[103939]: pam_unix(sudo:session): session closed for user root Jul 22 03:32:25 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f4f63012-3da1-4edd-9732-a1e5efdaa218 tempest-TestStampPattern-1787521362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2273b5e3-7a4d-42dd-b607-d7c2d9c84df6" returned: 0 in 0.614s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:32:25 devstack cinder-volume[87747]: DEBUG cinder.image.image_utils [None req-f4f63012-3da1-4edd-9732-a1e5efdaa218 tempest-TestStampPattern-1787521362 None] Image conversion details: src /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2273b5e3-7a4d-42dd-b607-d7c2d9c84df6, size 1024.00 MB, duration 5.67 sec, destination /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c7213c9e-dfb2-44d4-beb7-c9b940c893c4 {{(pid=87747) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 22 03:32:25 devstack cinder-volume[87747]: INFO cinder.image.image_utils [None req-f4f63012-3da1-4edd-9732-a1e5efdaa218 tempest-TestStampPattern-1787521362 None] Converted 1024.00 MB image at 180.72 MB/s Jul 22 03:32:25 devstack cinder-volume[87747]: WARNING cinder.volume.drivers.remotefs [None req-f4f63012-3da1-4edd-9732-a1e5efdaa218 tempest-TestStampPattern-1787521362 None] /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c7213c9e-dfb2-44d4-beb7-c9b940c893c4 is being set with open permissions: ugo+rw Jul 22 03:32:25 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f4f63012-3da1-4edd-9732-a1e5efdaa218 tempest-TestStampPattern-1787521362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c7213c9e-dfb2-44d4-beb7-c9b940c893c4 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:32:25 devstack sudo[103958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c7213c9e-dfb2-44d4-beb7-c9b940c893c4 Jul 22 03:32:25 devstack sudo[103958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:32:25 devstack sudo[103958]: pam_unix(sudo:session): session closed for user root Jul 22 03:32:25 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f4f63012-3da1-4edd-9732-a1e5efdaa218 tempest-TestStampPattern-1787521362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c7213c9e-dfb2-44d4-beb7-c9b940c893c4" returned: 0 in 0.295s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:32:25 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-f4f63012-3da1-4edd-9732-a1e5efdaa218 tempest-TestStampPattern-1787521362 None] Lock "cinder-quobyte-c7213c9e-dfb2-44d4-beb7-c9b940c893c4" released by "_copy_volume_from_snapshot" :: held 7.441s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:32:25 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-f4f63012-3da1-4edd-9732-a1e5efdaa218 tempest-TestStampPattern-1787521362 None] Lock "cinder-quobyte-7e5599d9-1a1a-498d-9045-ed0d10b15692-c7213c9e-dfb2-44d4-beb7-c9b940c893c4" released by "_create_volume_from_snapshot" :: held 7.477s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:32:25 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-f4f63012-3da1-4edd-9732-a1e5efdaa218 tempest-TestStampPattern-1787521362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.494s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:32:25 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f4f63012-3da1-4edd-9732-a1e5efdaa218 tempest-TestStampPattern-1787521362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d510b0d-fce4-4dbf-819d-93651dc8cae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7213c9e-dfb2-44d4-beb7-c9b940c893c4', 'volume_size': 1, 'snapshot_id': '7e5599d9-1a1a-498d-9045-ed0d10b15692'}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:32:25 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f4f63012-3da1-4edd-9732-a1e5efdaa218 tempest-TestStampPattern-1787521362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae016391-62a3-4e43-aaa5-906b1cdb51a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:32:25 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-f4f63012-3da1-4edd-9732-a1e5efdaa218 tempest-TestStampPattern-1787521362 None] Volume volume-c7213c9e-dfb2-44d4-beb7-c9b940c893c4 (c7213c9e-dfb2-44d4-beb7-c9b940c893c4): created successfully Jul 22 03:32:25 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f4f63012-3da1-4edd-9732-a1e5efdaa218 tempest-TestStampPattern-1787521362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae016391-62a3-4e43-aaa5-906b1cdb51a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:32:25 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f4f63012-3da1-4edd-9732-a1e5efdaa218 tempest-TestStampPattern-1787521362 None] Flow 'volume_create_manager' (2c926b5a-e36f-45be-9263-8cbc69e84133) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:32:25 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-f4f63012-3da1-4edd-9732-a1e5efdaa218 tempest-TestStampPattern-1787521362 None] Created volume successfully. Jul 22 03:32:35 devstack cinder-volume[87747]: DEBUG dbcounter [-] [87747] Writing DB stats cinder:SELECT=13,cinder:UPDATE=4,cinder:INSERT=1 {{(pid=87747) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 03:32:35 devstack cinder-volume[87747]: DEBUG dbcounter [-] [87747] Writing DB stats cinder:SELECT=14,cinder:UPDATE=6,cinder:DELETE=2 {{(pid=87747) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 03:32:53 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [req-a9261c58-ddf2-4d38-93fd-5a92480d8657 req-d62d4e8c-3771-4fc3-bc0f-c32ffa11f0d0 tempest-TestStampPattern-1787521362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:32:53 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [req-a9261c58-ddf2-4d38-93fd-5a92480d8657 req-d62d4e8c-3771-4fc3-bc0f-c32ffa11f0d0 tempest-TestStampPattern-1787521362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:32:53 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cad7878-2932-4a7b-92f2-4d590e967e3c]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:32:53 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [req-a9261c58-ddf2-4d38-93fd-5a92480d8657 req-d62d4e8c-3771-4fc3-bc0f-c32ffa11f0d0 tempest-TestStampPattern-1787521362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c7213c9e-dfb2-44d4-beb7-c9b940c893c4 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:32:54 devstack sudo[104090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c7213c9e-dfb2-44d4-beb7-c9b940c893c4 Jul 22 03:32:54 devstack sudo[104090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:32:54 devstack sudo[104090]: pam_unix(sudo:session): session closed for user root Jul 22 03:32:54 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [req-a9261c58-ddf2-4d38-93fd-5a92480d8657 req-d62d4e8c-3771-4fc3-bc0f-c32ffa11f0d0 tempest-TestStampPattern-1787521362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c7213c9e-dfb2-44d4-beb7-c9b940c893c4" returned: 0 in 0.360s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:32:54 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [req-a9261c58-ddf2-4d38-93fd-5a92480d8657 req-d62d4e8c-3771-4fc3-bc0f-c32ffa11f0d0 tempest-TestStampPattern-1787521362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.390s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:32:54 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [req-a9261c58-ddf2-4d38-93fd-5a92480d8657 req-d62d4e8c-3771-4fc3-bc0f-c32ffa11f0d0 tempest-TestStampPattern-1787521362 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f', 'name': 'volume-c7213c9e-dfb2-44d4-beb7-c9b940c893c4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '61aeeac6-44a3-42cb-9e79-15b4a676a77f', 'enforce_multipath': True} {{(pid=87747) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 22 03:32:54 devstack cinder-volume[87747]: INFO cinder.volume.manager [req-a9261c58-ddf2-4d38-93fd-5a92480d8657 req-d62d4e8c-3771-4fc3-bc0f-c32ffa11f0d0 tempest-TestStampPattern-1787521362 None] attachment_update completed successfully. Jul 22 03:32:57 devstack cinder-volume[87747]: INFO cinder.volume.manager [req-391f8759-cc9a-4770-985f-aabd695a3393 req-262c9e8b-0fde-4356-94f9-ae6605ef70b2 tempest-TestStampPattern-1787521362 None] Terminate volume connection completed successfully. Jul 22 03:32:57 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [req-391f8759-cc9a-4770-985f-aabd695a3393 req-262c9e8b-0fde-4356-94f9-ae6605ef70b2 tempest-TestStampPattern-1787521362 None] Deleting attachment 61aeeac6-44a3-42cb-9e79-15b4a676a77f. {{(pid=87747) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 22 03:33:01 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-241186ad-3316-4814-8669-9477c091868d tempest-TestStampPattern-1787521362 None] Acquiring lock "cinder-c7213c9e-dfb2-44d4-beb7-c9b940c893c4-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:33:01 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-241186ad-3316-4814-8669-9477c091868d tempest-TestStampPattern-1787521362 None] Lock "cinder-c7213c9e-dfb2-44d4-beb7-c9b940c893c4-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:33:01 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-241186ad-3316-4814-8669-9477c091868d tempest-TestStampPattern-1787521362 None] Acquiring lock "cinder-quobyte-c7213c9e-dfb2-44d4-beb7-c9b940c893c4" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:33:01 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-241186ad-3316-4814-8669-9477c091868d tempest-TestStampPattern-1787521362 None] Lock "cinder-quobyte-c7213c9e-dfb2-44d4-beb7-c9b940c893c4" acquired by "delete_volume" :: waited 0.014s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:33:01 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e9ce771-8649-4183-ab99-8728718301fa]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:33:01 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-241186ad-3316-4814-8669-9477c091868d tempest-TestStampPattern-1787521362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c7213c9e-dfb2-44d4-beb7-c9b940c893c4 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:33:01 devstack sudo[104552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c7213c9e-dfb2-44d4-beb7-c9b940c893c4 Jul 22 03:33:01 devstack sudo[104552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:33:01 devstack sudo[104552]: pam_unix(sudo:session): session closed for user root Jul 22 03:33:01 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-241186ad-3316-4814-8669-9477c091868d tempest-TestStampPattern-1787521362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c7213c9e-dfb2-44d4-beb7-c9b940c893c4" returned: 0 in 0.346s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:33:01 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-241186ad-3316-4814-8669-9477c091868d tempest-TestStampPattern-1787521362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c7213c9e-dfb2-44d4-beb7-c9b940c893c4 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:33:01 devstack sudo[104557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c7213c9e-dfb2-44d4-beb7-c9b940c893c4 Jul 22 03:33:01 devstack sudo[104557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:33:01 devstack sudo[104557]: pam_unix(sudo:session): session closed for user root Jul 22 03:33:01 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-241186ad-3316-4814-8669-9477c091868d tempest-TestStampPattern-1787521362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c7213c9e-dfb2-44d4-beb7-c9b940c893c4" returned: 0 in 0.241s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:33:01 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-241186ad-3316-4814-8669-9477c091868d tempest-TestStampPattern-1787521362 None] Lock "cinder-quobyte-c7213c9e-dfb2-44d4-beb7-c9b940c893c4" released by "delete_volume" :: held 0.627s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:33:01 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-241186ad-3316-4814-8669-9477c091868d tempest-TestStampPattern-1787521362 None] Created reservations ['d623b432-cf3e-4574-b478-c66d58acc405', '65a51c06-408d-4ea6-911a-65ca89bc7592', 'c912f625-54a5-4ca3-9795-fe55ccd91936', 'd06c2d61-244e-4126-9b40-f45da22ff9c7'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:33:01 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-241186ad-3316-4814-8669-9477c091868d tempest-TestStampPattern-1787521362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:33:01 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-241186ad-3316-4814-8669-9477c091868d tempest-TestStampPattern-1787521362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:33:01 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-241186ad-3316-4814-8669-9477c091868d tempest-TestStampPattern-1787521362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:33:01 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-241186ad-3316-4814-8669-9477c091868d tempest-TestStampPattern-1787521362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:33:01 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-241186ad-3316-4814-8669-9477c091868d tempest-TestStampPattern-1787521362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:33:01 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-241186ad-3316-4814-8669-9477c091868d tempest-TestStampPattern-1787521362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:33:02 devstack sudo[104560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:33:02 devstack sudo[104560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:33:02 devstack sudo[104560]: pam_unix(sudo:session): session closed for user root Jul 22 03:33:02 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-241186ad-3316-4814-8669-9477c091868d tempest-TestStampPattern-1787521362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.240s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:33:02 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-241186ad-3316-4814-8669-9477c091868d tempest-TestStampPattern-1787521362 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:33:02 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-241186ad-3316-4814-8669-9477c091868d tempest-TestStampPattern-1787521362 None] Deleted volume successfully. Jul 22 03:33:02 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-241186ad-3316-4814-8669-9477c091868d tempest-TestStampPattern-1787521362 None] Lock "cinder-c7213c9e-dfb2-44d4-beb7-c9b940c893c4-delete_volume" released by "delete_volume" :: held 1.047s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:33:02 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-3cdedb36-4d11-4fd1-84f7-7760b8f55d89 tempest-TestStampPattern-1787521362 None] Acquiring lock "cinder-7e5599d9-1a1a-498d-9045-ed0d10b15692-delete_snapshot" by "delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:33:02 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-3cdedb36-4d11-4fd1-84f7-7760b8f55d89 tempest-TestStampPattern-1787521362 None] Lock "cinder-7e5599d9-1a1a-498d-9045-ed0d10b15692-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:33:02 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-3cdedb36-4d11-4fd1-84f7-7760b8f55d89 tempest-TestStampPattern-1787521362 None] Acquiring lock "cinder-quobyte-2273b5e3-7a4d-42dd-b607-d7c2d9c84df6" by "delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:33:02 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-3cdedb36-4d11-4fd1-84f7-7760b8f55d89 tempest-TestStampPattern-1787521362 None] Lock "cinder-quobyte-2273b5e3-7a4d-42dd-b607-d7c2d9c84df6" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:33:02 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-3cdedb36-4d11-4fd1-84f7-7760b8f55d89 tempest-TestStampPattern-1787521362 None] Acquiring lock "cinder-quobyte-7e5599d9-1a1a-498d-9045-ed0d10b15692" by "_delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:33:02 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-3cdedb36-4d11-4fd1-84f7-7760b8f55d89 tempest-TestStampPattern-1787521362 None] Lock "cinder-quobyte-7e5599d9-1a1a-498d-9045-ed0d10b15692" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:33:02 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-3cdedb36-4d11-4fd1-84f7-7760b8f55d89 tempest-TestStampPattern-1787521362 None] Deleting offline snapshot 7e5599d9-1a1a-498d-9045-ed0d10b15692 of volume 2273b5e3-7a4d-42dd-b607-d7c2d9c84df6 {{(pid=87747) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 03:33:02 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-3cdedb36-4d11-4fd1-84f7-7760b8f55d89 tempest-TestStampPattern-1787521362 None] snapshot_file for this snap is: volume-2273b5e3-7a4d-42dd-b607-d7c2d9c84df6.7e5599d9-1a1a-498d-9045-ed0d10b15692 {{(pid=87747) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 03:33:02 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd7de76b-44ef-4fc3-a355-95d81aee0c4e]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:33:02 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-3cdedb36-4d11-4fd1-84f7-7760b8f55d89 tempest-TestStampPattern-1787521362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2273b5e3-7a4d-42dd-b607-d7c2d9c84df6.7e5599d9-1a1a-498d-9045-ed0d10b15692 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:33:02 devstack sudo[104563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2273b5e3-7a4d-42dd-b607-d7c2d9c84df6.7e5599d9-1a1a-498d-9045-ed0d10b15692 Jul 22 03:33:02 devstack sudo[104563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:33:02 devstack sudo[104563]: pam_unix(sudo:session): session closed for user root Jul 22 03:33:03 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-3cdedb36-4d11-4fd1-84f7-7760b8f55d89 tempest-TestStampPattern-1787521362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2273b5e3-7a4d-42dd-b607-d7c2d9c84df6.7e5599d9-1a1a-498d-9045-ed0d10b15692" returned: 0 in 0.351s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:33:03 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-3cdedb36-4d11-4fd1-84f7-7760b8f55d89 tempest-TestStampPattern-1787521362 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2273b5e3-7a4d-42dd-b607-d7c2d9c84df6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87747) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 03:33:03 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5b310f3-d177-4441-9dd9-1a22310fddc7]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:33:03 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-3cdedb36-4d11-4fd1-84f7-7760b8f55d89 tempest-TestStampPattern-1787521362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2273b5e3-7a4d-42dd-b607-d7c2d9c84df6 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:33:03 devstack sudo[104568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2273b5e3-7a4d-42dd-b607-d7c2d9c84df6 Jul 22 03:33:03 devstack sudo[104568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:33:03 devstack sudo[104568]: pam_unix(sudo:session): session closed for user root Jul 22 03:33:03 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-3cdedb36-4d11-4fd1-84f7-7760b8f55d89 tempest-TestStampPattern-1787521362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2273b5e3-7a4d-42dd-b607-d7c2d9c84df6" returned: 0 in 0.342s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:33:03 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-3cdedb36-4d11-4fd1-84f7-7760b8f55d89 tempest-TestStampPattern-1787521362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2273b5e3-7a4d-42dd-b607-d7c2d9c84df6.7e5599d9-1a1a-498d-9045-ed0d10b15692 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:33:03 devstack sudo[104574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2273b5e3-7a4d-42dd-b607-d7c2d9c84df6.7e5599d9-1a1a-498d-9045-ed0d10b15692 Jul 22 03:33:03 devstack sudo[104574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:33:03 devstack sudo[104574]: pam_unix(sudo:session): session closed for user root Jul 22 03:33:03 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-3cdedb36-4d11-4fd1-84f7-7760b8f55d89 tempest-TestStampPattern-1787521362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2273b5e3-7a4d-42dd-b607-d7c2d9c84df6.7e5599d9-1a1a-498d-9045-ed0d10b15692" returned: 0 in 0.323s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:33:03 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-3cdedb36-4d11-4fd1-84f7-7760b8f55d89 tempest-TestStampPattern-1787521362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2273b5e3-7a4d-42dd-b607-d7c2d9c84df6.7e5599d9-1a1a-498d-9045-ed0d10b15692 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:33:03 devstack sudo[104579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2273b5e3-7a4d-42dd-b607-d7c2d9c84df6.7e5599d9-1a1a-498d-9045-ed0d10b15692 Jul 22 03:33:03 devstack sudo[104579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:33:03 devstack sudo[104579]: pam_unix(sudo:session): session closed for user root Jul 22 03:33:03 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-3cdedb36-4d11-4fd1-84f7-7760b8f55d89 tempest-TestStampPattern-1787521362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2273b5e3-7a4d-42dd-b607-d7c2d9c84df6.7e5599d9-1a1a-498d-9045-ed0d10b15692" returned: 0 in 0.244s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:33:03 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-3cdedb36-4d11-4fd1-84f7-7760b8f55d89 tempest-TestStampPattern-1787521362 None] Lock "cinder-quobyte-7e5599d9-1a1a-498d-9045-ed0d10b15692" released by "_delete_snapshot" :: held 1.354s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:33:03 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-3cdedb36-4d11-4fd1-84f7-7760b8f55d89 tempest-TestStampPattern-1787521362 None] Lock "cinder-quobyte-2273b5e3-7a4d-42dd-b607-d7c2d9c84df6" released by "delete_snapshot" :: held 1.376s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:33:04 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-3cdedb36-4d11-4fd1-84f7-7760b8f55d89 tempest-TestStampPattern-1787521362 None] Created reservations ['f36e989b-a9ef-4b6f-a5de-a54a05022466', '325da2a7-e042-4d77-a67f-9b89d22950b2', '643941bd-aad2-4d43-a6ed-710fb86ad081', 'a8ac4f59-c556-4f33-9df8-59e33b4a8927'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:33:04 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-3cdedb36-4d11-4fd1-84f7-7760b8f55d89 tempest-TestStampPattern-1787521362 None] Delete snapshot completed successfully. Jul 22 03:33:04 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-3cdedb36-4d11-4fd1-84f7-7760b8f55d89 tempest-TestStampPattern-1787521362 None] Lock "cinder-7e5599d9-1a1a-498d-9045-ed0d10b15692-delete_snapshot" released by "delete_snapshot" :: held 1.503s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:33:08 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-cddf5360-362b-40f9-a8d2-011031925db7 tempest-TestStampPattern-1787521362 None] Acquiring lock "cinder-2273b5e3-7a4d-42dd-b607-d7c2d9c84df6-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:33:08 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-cddf5360-362b-40f9-a8d2-011031925db7 tempest-TestStampPattern-1787521362 None] Lock "cinder-2273b5e3-7a4d-42dd-b607-d7c2d9c84df6-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:33:08 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-cddf5360-362b-40f9-a8d2-011031925db7 tempest-TestStampPattern-1787521362 None] Acquiring lock "cinder-quobyte-2273b5e3-7a4d-42dd-b607-d7c2d9c84df6" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:33:08 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-cddf5360-362b-40f9-a8d2-011031925db7 tempest-TestStampPattern-1787521362 None] Lock "cinder-quobyte-2273b5e3-7a4d-42dd-b607-d7c2d9c84df6" acquired by "delete_volume" :: waited 0.014s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:33:08 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e528914-5007-426d-9516-77fe533c52bc]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:33:08 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-cddf5360-362b-40f9-a8d2-011031925db7 tempest-TestStampPattern-1787521362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2273b5e3-7a4d-42dd-b607-d7c2d9c84df6 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:33:08 devstack sudo[104608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2273b5e3-7a4d-42dd-b607-d7c2d9c84df6 Jul 22 03:33:08 devstack sudo[104608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:33:08 devstack sudo[104608]: pam_unix(sudo:session): session closed for user root Jul 22 03:33:08 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-cddf5360-362b-40f9-a8d2-011031925db7 tempest-TestStampPattern-1787521362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2273b5e3-7a4d-42dd-b607-d7c2d9c84df6" returned: 0 in 0.353s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:33:08 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-cddf5360-362b-40f9-a8d2-011031925db7 tempest-TestStampPattern-1787521362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2273b5e3-7a4d-42dd-b607-d7c2d9c84df6 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:33:08 devstack sudo[104613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2273b5e3-7a4d-42dd-b607-d7c2d9c84df6 Jul 22 03:33:08 devstack sudo[104613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:33:08 devstack sudo[104613]: pam_unix(sudo:session): session closed for user root Jul 22 03:33:08 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-cddf5360-362b-40f9-a8d2-011031925db7 tempest-TestStampPattern-1787521362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2273b5e3-7a4d-42dd-b607-d7c2d9c84df6" returned: 0 in 0.243s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:33:08 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-cddf5360-362b-40f9-a8d2-011031925db7 tempest-TestStampPattern-1787521362 None] Lock "cinder-quobyte-2273b5e3-7a4d-42dd-b607-d7c2d9c84df6" released by "delete_volume" :: held 0.649s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:33:08 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-cddf5360-362b-40f9-a8d2-011031925db7 tempest-TestStampPattern-1787521362 None] Created reservations ['cc7cfb77-59d4-4135-bd75-935d873b2a77', '65eba595-a068-440f-9496-41de9d4f204c', 'bbabd355-f465-4d6d-b11b-1c78f99b4b94', 'a0016d3d-93ad-4d93-8a81-6bb733ca391a'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:33:08 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-cddf5360-362b-40f9-a8d2-011031925db7 tempest-TestStampPattern-1787521362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:33:08 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-cddf5360-362b-40f9-a8d2-011031925db7 tempest-TestStampPattern-1787521362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:33:08 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-cddf5360-362b-40f9-a8d2-011031925db7 tempest-TestStampPattern-1787521362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:33:08 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-cddf5360-362b-40f9-a8d2-011031925db7 tempest-TestStampPattern-1787521362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:33:08 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-cddf5360-362b-40f9-a8d2-011031925db7 tempest-TestStampPattern-1787521362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:33:08 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-cddf5360-362b-40f9-a8d2-011031925db7 tempest-TestStampPattern-1787521362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:33:08 devstack sudo[104616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:33:08 devstack sudo[104616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:33:09 devstack sudo[104616]: pam_unix(sudo:session): session closed for user root Jul 22 03:33:09 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-cddf5360-362b-40f9-a8d2-011031925db7 tempest-TestStampPattern-1787521362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.234s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:33:09 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-cddf5360-362b-40f9-a8d2-011031925db7 tempest-TestStampPattern-1787521362 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:33:09 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-cddf5360-362b-40f9-a8d2-011031925db7 tempest-TestStampPattern-1787521362 None] Deleted volume successfully. Jul 22 03:33:09 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-cddf5360-362b-40f9-a8d2-011031925db7 tempest-TestStampPattern-1787521362 None] Lock "cinder-2273b5e3-7a4d-42dd-b607-d7c2d9c84df6-delete_volume" released by "delete_volume" :: held 1.059s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:33:19 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-9853a6f1-7c35-4424-902a-62d9eac935a1 tempest-ProjectReaderTests-217186517 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:33:19 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-9853a6f1-7c35-4424-902a-62d9eac935a1 tempest-ProjectReaderTests-217186517 None] Flow 'volume_create_manager' (b529b3a0-c5f8-42d2-844e-c7c903a95c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:33:19 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-9853a6f1-7c35-4424-902a-62d9eac935a1 tempest-ProjectReaderTests-217186517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0b1441b-0b20-45f8-ab70-6d8d64e0b4ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:19 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-9853a6f1-7c35-4424-902a-62d9eac935a1 tempest-ProjectReaderTests-217186517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0b1441b-0b20-45f8-ab70-6d8d64e0b4ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:33:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1504429679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55d722ff-e430-4e9a-92b5-d7fb8c6fd4c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41cfc8d29246489bbf1483cbbe43b76e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:33:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:33:19Z,use_quota=True,user_id='6ed4b50bbdb74dc8a39e8febae1b5aac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:19 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-9853a6f1-7c35-4424-902a-62d9eac935a1 tempest-ProjectReaderTests-217186517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a723fbae-5ff6-4a7d-87b9-f8eac8b2466a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:19 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-9853a6f1-7c35-4424-902a-62d9eac935a1 tempest-ProjectReaderTests-217186517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a723fbae-5ff6-4a7d-87b9-f8eac8b2466a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:19 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-9853a6f1-7c35-4424-902a-62d9eac935a1 tempest-ProjectReaderTests-217186517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d3550dd-59f8-4749-b8bc-174d4b723fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:19 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-9853a6f1-7c35-4424-902a-62d9eac935a1 tempest-ProjectReaderTests-217186517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d3550dd-59f8-4749-b8bc-174d4b723fb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55d722ff-e430-4e9a-92b5-d7fb8c6fd4c9', 'volume_name': 'volume-55d722ff-e430-4e9a-92b5-d7fb8c6fd4c9', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:19 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-9853a6f1-7c35-4424-902a-62d9eac935a1 tempest-ProjectReaderTests-217186517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c73b3d7-cd48-46c0-b433-35046f2927f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:19 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-9853a6f1-7c35-4424-902a-62d9eac935a1 tempest-ProjectReaderTests-217186517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c73b3d7-cd48-46c0-b433-35046f2927f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:19 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-9853a6f1-7c35-4424-902a-62d9eac935a1 tempest-ProjectReaderTests-217186517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f91d4d5-5a87-4a92-b692-ca1bb9f6c54b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:19 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-9853a6f1-7c35-4424-902a-62d9eac935a1 tempest-ProjectReaderTests-217186517 None] Volume 55d722ff-e430-4e9a-92b5-d7fb8c6fd4c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55d722ff-e430-4e9a-92b5-d7fb8c6fd4c9', 'volume_size': 1} Jul 22 03:33:19 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-9853a6f1-7c35-4424-902a-62d9eac935a1 tempest-ProjectReaderTests-217186517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:33:19 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-9853a6f1-7c35-4424-902a-62d9eac935a1 tempest-ProjectReaderTests-217186517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:33:19 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-9853a6f1-7c35-4424-902a-62d9eac935a1 tempest-ProjectReaderTests-217186517 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:33:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1504429679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55d722ff-e430-4e9a-92b5-d7fb8c6fd4c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41cfc8d29246489bbf1483cbbe43b76e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:33:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:33:19Z,use_quota=True,user_id='6ed4b50bbdb74dc8a39e8febae1b5aac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:33:19 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-9853a6f1-7c35-4424-902a-62d9eac935a1 tempest-ProjectReaderTests-217186517 None] Creating volume 55d722ff-e430-4e9a-92b5-d7fb8c6fd4c9 {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:33:19 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-9853a6f1-7c35-4424-902a-62d9eac935a1 tempest-ProjectReaderTests-217186517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:33:19 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-9853a6f1-7c35-4424-902a-62d9eac935a1 tempest-ProjectReaderTests-217186517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:33:19 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-9853a6f1-7c35-4424-902a-62d9eac935a1 tempest-ProjectReaderTests-217186517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:33:19 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-9853a6f1-7c35-4424-902a-62d9eac935a1 tempest-ProjectReaderTests-217186517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:33:19 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-9853a6f1-7c35-4424-902a-62d9eac935a1 tempest-ProjectReaderTests-217186517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:33:19 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-9853a6f1-7c35-4424-902a-62d9eac935a1 tempest-ProjectReaderTests-217186517 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:33:19 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-9853a6f1-7c35-4424-902a-62d9eac935a1 tempest-ProjectReaderTests-217186517 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:33:19 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-9853a6f1-7c35-4424-902a-62d9eac935a1 tempest-ProjectReaderTests-217186517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-55d722ff-e430-4e9a-92b5-d7fb8c6fd4c9 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:33:19 devstack sudo[104624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-55d722ff-e430-4e9a-92b5-d7fb8c6fd4c9 1073741824 Jul 22 03:33:19 devstack sudo[104624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:33:20 devstack sudo[104624]: pam_unix(sudo:session): session closed for user root Jul 22 03:33:20 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-9853a6f1-7c35-4424-902a-62d9eac935a1 tempest-ProjectReaderTests-217186517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-55d722ff-e430-4e9a-92b5-d7fb8c6fd4c9 1073741824" returned: 0 in 0.401s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:33:20 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-9853a6f1-7c35-4424-902a-62d9eac935a1 tempest-ProjectReaderTests-217186517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-55d722ff-e430-4e9a-92b5-d7fb8c6fd4c9 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:33:20 devstack sudo[104630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-55d722ff-e430-4e9a-92b5-d7fb8c6fd4c9 Jul 22 03:33:20 devstack sudo[104630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:33:20 devstack sudo[104630]: pam_unix(sudo:session): session closed for user root Jul 22 03:33:20 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-9853a6f1-7c35-4424-902a-62d9eac935a1 tempest-ProjectReaderTests-217186517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-55d722ff-e430-4e9a-92b5-d7fb8c6fd4c9" returned: 0 in 0.238s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:33:20 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-9853a6f1-7c35-4424-902a-62d9eac935a1 tempest-ProjectReaderTests-217186517 None] <== create_volume: return (684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:33:20 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-9853a6f1-7c35-4424-902a-62d9eac935a1 tempest-ProjectReaderTests-217186517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.686s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:33:20 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-9853a6f1-7c35-4424-902a-62d9eac935a1 tempest-ProjectReaderTests-217186517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f91d4d5-5a87-4a92-b692-ca1bb9f6c54b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55d722ff-e430-4e9a-92b5-d7fb8c6fd4c9', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:20 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-9853a6f1-7c35-4424-902a-62d9eac935a1 tempest-ProjectReaderTests-217186517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5ea10af-11de-44d1-ae12-5f264b31f432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:20 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-9853a6f1-7c35-4424-902a-62d9eac935a1 tempest-ProjectReaderTests-217186517 None] Volume volume-55d722ff-e430-4e9a-92b5-d7fb8c6fd4c9 (55d722ff-e430-4e9a-92b5-d7fb8c6fd4c9): created successfully Jul 22 03:33:20 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-9853a6f1-7c35-4424-902a-62d9eac935a1 tempest-ProjectReaderTests-217186517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5ea10af-11de-44d1-ae12-5f264b31f432) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:20 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-9853a6f1-7c35-4424-902a-62d9eac935a1 tempest-ProjectReaderTests-217186517 None] Flow 'volume_create_manager' (b529b3a0-c5f8-42d2-844e-c7c903a95c07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:33:20 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-9853a6f1-7c35-4424-902a-62d9eac935a1 tempest-ProjectReaderTests-217186517 None] Created volume successfully. Jul 22 03:33:20 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-ee4c287d-8c95-48c6-97ea-f62fcbb11752 tempest-ProjectReaderTests-217186517 None] Acquiring lock "cinder-55d722ff-e430-4e9a-92b5-d7fb8c6fd4c9-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:33:20 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-ee4c287d-8c95-48c6-97ea-f62fcbb11752 tempest-ProjectReaderTests-217186517 None] Lock "cinder-55d722ff-e430-4e9a-92b5-d7fb8c6fd4c9-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:33:20 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-ee4c287d-8c95-48c6-97ea-f62fcbb11752 tempest-ProjectReaderTests-217186517 None] Acquiring lock "cinder-quobyte-55d722ff-e430-4e9a-92b5-d7fb8c6fd4c9" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:33:20 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-ee4c287d-8c95-48c6-97ea-f62fcbb11752 tempest-ProjectReaderTests-217186517 None] Lock "cinder-quobyte-55d722ff-e430-4e9a-92b5-d7fb8c6fd4c9" acquired by "delete_volume" :: waited 0.015s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:33:20 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d0b4879-1610-41e0-b794-895997fe3741]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:33:20 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ee4c287d-8c95-48c6-97ea-f62fcbb11752 tempest-ProjectReaderTests-217186517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-55d722ff-e430-4e9a-92b5-d7fb8c6fd4c9 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:33:20 devstack sudo[104633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-55d722ff-e430-4e9a-92b5-d7fb8c6fd4c9 Jul 22 03:33:20 devstack sudo[104633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:33:21 devstack sudo[104633]: pam_unix(sudo:session): session closed for user root Jul 22 03:33:21 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ee4c287d-8c95-48c6-97ea-f62fcbb11752 tempest-ProjectReaderTests-217186517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-55d722ff-e430-4e9a-92b5-d7fb8c6fd4c9" returned: 0 in 0.352s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:33:21 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ee4c287d-8c95-48c6-97ea-f62fcbb11752 tempest-ProjectReaderTests-217186517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-55d722ff-e430-4e9a-92b5-d7fb8c6fd4c9 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:33:21 devstack sudo[104638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-55d722ff-e430-4e9a-92b5-d7fb8c6fd4c9 Jul 22 03:33:21 devstack sudo[104638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:33:21 devstack sudo[104638]: pam_unix(sudo:session): session closed for user root Jul 22 03:33:21 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ee4c287d-8c95-48c6-97ea-f62fcbb11752 tempest-ProjectReaderTests-217186517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-55d722ff-e430-4e9a-92b5-d7fb8c6fd4c9" returned: 0 in 0.238s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:33:21 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-ee4c287d-8c95-48c6-97ea-f62fcbb11752 tempest-ProjectReaderTests-217186517 None] Lock "cinder-quobyte-55d722ff-e430-4e9a-92b5-d7fb8c6fd4c9" released by "delete_volume" :: held 0.633s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:33:21 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-ee4c287d-8c95-48c6-97ea-f62fcbb11752 tempest-ProjectReaderTests-217186517 None] Created reservations ['88aa39bd-1c2c-4022-81d7-c366e3b49f75', 'b286b51b-6b2c-41f3-b864-810914ca21d8', '77d39901-ce49-4e7b-bfbc-18b781cf3ae5', '3f72c338-57c4-42e7-a0d7-0a501b321a90'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:33:21 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-ee4c287d-8c95-48c6-97ea-f62fcbb11752 tempest-ProjectReaderTests-217186517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:33:21 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-ee4c287d-8c95-48c6-97ea-f62fcbb11752 tempest-ProjectReaderTests-217186517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:33:21 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-ee4c287d-8c95-48c6-97ea-f62fcbb11752 tempest-ProjectReaderTests-217186517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:33:21 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-ee4c287d-8c95-48c6-97ea-f62fcbb11752 tempest-ProjectReaderTests-217186517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:33:21 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-ee4c287d-8c95-48c6-97ea-f62fcbb11752 tempest-ProjectReaderTests-217186517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:33:21 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ee4c287d-8c95-48c6-97ea-f62fcbb11752 tempest-ProjectReaderTests-217186517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:33:21 devstack sudo[104641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:33:21 devstack sudo[104641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:33:21 devstack sudo[104641]: pam_unix(sudo:session): session closed for user root Jul 22 03:33:21 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ee4c287d-8c95-48c6-97ea-f62fcbb11752 tempest-ProjectReaderTests-217186517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.242s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:33:21 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-ee4c287d-8c95-48c6-97ea-f62fcbb11752 tempest-ProjectReaderTests-217186517 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:33:21 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-ee4c287d-8c95-48c6-97ea-f62fcbb11752 tempest-ProjectReaderTests-217186517 None] Deleted volume successfully. Jul 22 03:33:21 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-ee4c287d-8c95-48c6-97ea-f62fcbb11752 tempest-ProjectReaderTests-217186517 None] Lock "cinder-55d722ff-e430-4e9a-92b5-d7fb8c6fd4c9-delete_volume" released by "delete_volume" :: held 1.055s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:33:22 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc544472-9bd2-49bd-b92b-26555ef05de7 tempest-ProjectReaderTests-217186517 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:33:22 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-dc544472-9bd2-49bd-b92b-26555ef05de7 tempest-ProjectReaderTests-217186517 None] Flow 'volume_create_manager' (1249a730-0fc1-4b0d-bede-8e16dbe33b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:33:22 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-dc544472-9bd2-49bd-b92b-26555ef05de7 tempest-ProjectReaderTests-217186517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dc24a7f-6980-4d90-af03-a6d2f060acfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:22 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-dc544472-9bd2-49bd-b92b-26555ef05de7 tempest-ProjectReaderTests-217186517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dc24a7f-6980-4d90-af03-a6d2f060acfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:33:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2113059121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5e9ecc1-cf02-4908-b4e1-9c6942b39f2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41cfc8d29246489bbf1483cbbe43b76e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:33:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:33:22Z,use_quota=True,user_id='6ed4b50bbdb74dc8a39e8febae1b5aac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:22 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-dc544472-9bd2-49bd-b92b-26555ef05de7 tempest-ProjectReaderTests-217186517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40e2fae9-8949-41de-86b7-705fe72dd4a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:22 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-dc544472-9bd2-49bd-b92b-26555ef05de7 tempest-ProjectReaderTests-217186517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40e2fae9-8949-41de-86b7-705fe72dd4a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:22 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-dc544472-9bd2-49bd-b92b-26555ef05de7 tempest-ProjectReaderTests-217186517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (975f8f66-bc47-49d1-aa6f-84f9a47662e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:22 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-dc544472-9bd2-49bd-b92b-26555ef05de7 tempest-ProjectReaderTests-217186517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (975f8f66-bc47-49d1-aa6f-84f9a47662e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5e9ecc1-cf02-4908-b4e1-9c6942b39f2b', 'volume_name': 'volume-d5e9ecc1-cf02-4908-b4e1-9c6942b39f2b', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:22 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-dc544472-9bd2-49bd-b92b-26555ef05de7 tempest-ProjectReaderTests-217186517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a565c90f-669c-410d-9f0d-6d7529caa063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:22 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-dc544472-9bd2-49bd-b92b-26555ef05de7 tempest-ProjectReaderTests-217186517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a565c90f-669c-410d-9f0d-6d7529caa063) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:22 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-dc544472-9bd2-49bd-b92b-26555ef05de7 tempest-ProjectReaderTests-217186517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9fd1b3f-f584-4cb4-960b-55e621b3a56d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:22 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-dc544472-9bd2-49bd-b92b-26555ef05de7 tempest-ProjectReaderTests-217186517 None] Volume d5e9ecc1-cf02-4908-b4e1-9c6942b39f2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5e9ecc1-cf02-4908-b4e1-9c6942b39f2b', 'volume_size': 1} Jul 22 03:33:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-dc544472-9bd2-49bd-b92b-26555ef05de7 tempest-ProjectReaderTests-217186517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:33:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-dc544472-9bd2-49bd-b92b-26555ef05de7 tempest-ProjectReaderTests-217186517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:33:22 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-dc544472-9bd2-49bd-b92b-26555ef05de7 tempest-ProjectReaderTests-217186517 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:33:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2113059121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5e9ecc1-cf02-4908-b4e1-9c6942b39f2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41cfc8d29246489bbf1483cbbe43b76e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:33:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:33:22Z,use_quota=True,user_id='6ed4b50bbdb74dc8a39e8febae1b5aac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:33:22 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-dc544472-9bd2-49bd-b92b-26555ef05de7 tempest-ProjectReaderTests-217186517 None] Creating volume d5e9ecc1-cf02-4908-b4e1-9c6942b39f2b {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:33:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-dc544472-9bd2-49bd-b92b-26555ef05de7 tempest-ProjectReaderTests-217186517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:33:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-dc544472-9bd2-49bd-b92b-26555ef05de7 tempest-ProjectReaderTests-217186517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:33:22 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-dc544472-9bd2-49bd-b92b-26555ef05de7 tempest-ProjectReaderTests-217186517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:33:22 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-dc544472-9bd2-49bd-b92b-26555ef05de7 tempest-ProjectReaderTests-217186517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:33:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-dc544472-9bd2-49bd-b92b-26555ef05de7 tempest-ProjectReaderTests-217186517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:33:22 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-dc544472-9bd2-49bd-b92b-26555ef05de7 tempest-ProjectReaderTests-217186517 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:33:22 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-dc544472-9bd2-49bd-b92b-26555ef05de7 tempest-ProjectReaderTests-217186517 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:33:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-dc544472-9bd2-49bd-b92b-26555ef05de7 tempest-ProjectReaderTests-217186517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d5e9ecc1-cf02-4908-b4e1-9c6942b39f2b 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:33:22 devstack sudo[104644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d5e9ecc1-cf02-4908-b4e1-9c6942b39f2b 1073741824 Jul 22 03:33:22 devstack sudo[104644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:33:22 devstack cinder-volume[87747]: DEBUG oslo_service.periodic_task [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87747) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 03:33:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:33:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:33:22 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:33:22 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:33:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:33:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:33:22 devstack sudo[104646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:33:22 devstack sudo[104646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:33:22 devstack sudo[104646]: pam_unix(sudo:session): session closed for user root Jul 22 03:33:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.263s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:33:22 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:33:22 devstack cinder-volume[87747]: DEBUG oslo_service.periodic_task [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Running periodic task VolumeManager._thread_info {{(pid=87747) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 03:33:22 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] thread count: 28 {{(pid=87747) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 22 03:33:22 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] thread info: [<_MainThread(MainThread, started 132775275860096)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87747) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 22 03:33:22 devstack sudo[104644]: pam_unix(sudo:session): session closed for user root Jul 22 03:33:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-dc544472-9bd2-49bd-b92b-26555ef05de7 tempest-ProjectReaderTests-217186517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d5e9ecc1-cf02-4908-b4e1-9c6942b39f2b 1073741824" returned: 0 in 0.393s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:33:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-dc544472-9bd2-49bd-b92b-26555ef05de7 tempest-ProjectReaderTests-217186517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d5e9ecc1-cf02-4908-b4e1-9c6942b39f2b {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:33:22 devstack sudo[104653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d5e9ecc1-cf02-4908-b4e1-9c6942b39f2b Jul 22 03:33:22 devstack sudo[104653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:33:23 devstack sudo[104653]: pam_unix(sudo:session): session closed for user root Jul 22 03:33:23 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-dc544472-9bd2-49bd-b92b-26555ef05de7 tempest-ProjectReaderTests-217186517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d5e9ecc1-cf02-4908-b4e1-9c6942b39f2b" returned: 0 in 0.237s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:33:23 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-dc544472-9bd2-49bd-b92b-26555ef05de7 tempest-ProjectReaderTests-217186517 None] <== create_volume: return (669ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:33:23 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-dc544472-9bd2-49bd-b92b-26555ef05de7 tempest-ProjectReaderTests-217186517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.670s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:33:23 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-dc544472-9bd2-49bd-b92b-26555ef05de7 tempest-ProjectReaderTests-217186517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9fd1b3f-f584-4cb4-960b-55e621b3a56d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5e9ecc1-cf02-4908-b4e1-9c6942b39f2b', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:23 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-dc544472-9bd2-49bd-b92b-26555ef05de7 tempest-ProjectReaderTests-217186517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5efe5ba-5ef9-41e2-81fa-e0fc45b9d6fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:23 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-dc544472-9bd2-49bd-b92b-26555ef05de7 tempest-ProjectReaderTests-217186517 None] Volume volume-d5e9ecc1-cf02-4908-b4e1-9c6942b39f2b (d5e9ecc1-cf02-4908-b4e1-9c6942b39f2b): created successfully Jul 22 03:33:23 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-dc544472-9bd2-49bd-b92b-26555ef05de7 tempest-ProjectReaderTests-217186517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5efe5ba-5ef9-41e2-81fa-e0fc45b9d6fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:23 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-dc544472-9bd2-49bd-b92b-26555ef05de7 tempest-ProjectReaderTests-217186517 None] Flow 'volume_create_manager' (1249a730-0fc1-4b0d-bede-8e16dbe33b90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:33:23 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-dc544472-9bd2-49bd-b92b-26555ef05de7 tempest-ProjectReaderTests-217186517 None] Created volume successfully. Jul 22 03:33:23 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-c21478d4-52a0-4518-8f0e-acd289e85a71 tempest-ProjectReaderTests-217186517 None] Acquiring lock "cinder-d5e9ecc1-cf02-4908-b4e1-9c6942b39f2b-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:33:23 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-c21478d4-52a0-4518-8f0e-acd289e85a71 tempest-ProjectReaderTests-217186517 None] Lock "cinder-d5e9ecc1-cf02-4908-b4e1-9c6942b39f2b-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:33:23 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-c21478d4-52a0-4518-8f0e-acd289e85a71 tempest-ProjectReaderTests-217186517 None] Acquiring lock "cinder-quobyte-d5e9ecc1-cf02-4908-b4e1-9c6942b39f2b" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:33:23 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-c21478d4-52a0-4518-8f0e-acd289e85a71 tempest-ProjectReaderTests-217186517 None] Lock "cinder-quobyte-d5e9ecc1-cf02-4908-b4e1-9c6942b39f2b" acquired by "delete_volume" :: waited 0.014s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:33:23 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[85587320-58ca-47f5-be13-746687f7f388]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:33:23 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-c21478d4-52a0-4518-8f0e-acd289e85a71 tempest-ProjectReaderTests-217186517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d5e9ecc1-cf02-4908-b4e1-9c6942b39f2b {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:33:23 devstack sudo[104657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d5e9ecc1-cf02-4908-b4e1-9c6942b39f2b Jul 22 03:33:23 devstack sudo[104657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:33:23 devstack sudo[104657]: pam_unix(sudo:session): session closed for user root Jul 22 03:33:23 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-c21478d4-52a0-4518-8f0e-acd289e85a71 tempest-ProjectReaderTests-217186517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d5e9ecc1-cf02-4908-b4e1-9c6942b39f2b" returned: 0 in 0.346s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:33:23 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-c21478d4-52a0-4518-8f0e-acd289e85a71 tempest-ProjectReaderTests-217186517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d5e9ecc1-cf02-4908-b4e1-9c6942b39f2b {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:33:23 devstack sudo[104662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d5e9ecc1-cf02-4908-b4e1-9c6942b39f2b Jul 22 03:33:23 devstack sudo[104662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:33:24 devstack sudo[104662]: pam_unix(sudo:session): session closed for user root Jul 22 03:33:24 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-c21478d4-52a0-4518-8f0e-acd289e85a71 tempest-ProjectReaderTests-217186517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d5e9ecc1-cf02-4908-b4e1-9c6942b39f2b" returned: 0 in 0.236s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:33:24 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-c21478d4-52a0-4518-8f0e-acd289e85a71 tempest-ProjectReaderTests-217186517 None] Lock "cinder-quobyte-d5e9ecc1-cf02-4908-b4e1-9c6942b39f2b" released by "delete_volume" :: held 0.618s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:33:24 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-c21478d4-52a0-4518-8f0e-acd289e85a71 tempest-ProjectReaderTests-217186517 None] Created reservations ['5afb961f-5b5c-4ede-a34e-29d0148326ac', 'd7daa3ad-a903-4eff-b1e3-f96a376603cc', '710a985b-da94-499c-8247-a02c9863def1', '9c7a6705-6a82-4cb5-9dc5-bb50cd336ecc'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:33:24 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-c21478d4-52a0-4518-8f0e-acd289e85a71 tempest-ProjectReaderTests-217186517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:33:24 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-c21478d4-52a0-4518-8f0e-acd289e85a71 tempest-ProjectReaderTests-217186517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:33:24 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-c21478d4-52a0-4518-8f0e-acd289e85a71 tempest-ProjectReaderTests-217186517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:33:24 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-c21478d4-52a0-4518-8f0e-acd289e85a71 tempest-ProjectReaderTests-217186517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:33:24 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-c21478d4-52a0-4518-8f0e-acd289e85a71 tempest-ProjectReaderTests-217186517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:33:24 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-c21478d4-52a0-4518-8f0e-acd289e85a71 tempest-ProjectReaderTests-217186517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:33:24 devstack sudo[104665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:33:24 devstack sudo[104665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:33:24 devstack sudo[104665]: pam_unix(sudo:session): session closed for user root Jul 22 03:33:24 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-c21478d4-52a0-4518-8f0e-acd289e85a71 tempest-ProjectReaderTests-217186517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.236s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:33:24 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-c21478d4-52a0-4518-8f0e-acd289e85a71 tempest-ProjectReaderTests-217186517 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:33:24 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-c21478d4-52a0-4518-8f0e-acd289e85a71 tempest-ProjectReaderTests-217186517 None] Deleted volume successfully. Jul 22 03:33:24 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-c21478d4-52a0-4518-8f0e-acd289e85a71 tempest-ProjectReaderTests-217186517 None] Lock "cinder-d5e9ecc1-cf02-4908-b4e1-9c6942b39f2b-delete_volume" released by "delete_volume" :: held 1.035s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:33:24 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-d03ec327-2961-44b6-8509-812cd9e23450 tempest-ProjectReaderTests-217186517 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:33:24 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-d03ec327-2961-44b6-8509-812cd9e23450 tempest-ProjectReaderTests-217186517 None] Flow 'volume_create_manager' (bbb2600f-c1fe-4ca2-9d66-036fb00653d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:33:24 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-d03ec327-2961-44b6-8509-812cd9e23450 tempest-ProjectReaderTests-217186517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24bc99f9-2bc3-4076-b9e2-81b679bb916c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:24 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-d03ec327-2961-44b6-8509-812cd9e23450 tempest-ProjectReaderTests-217186517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24bc99f9-2bc3-4076-b9e2-81b679bb916c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:33:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1168676771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bace3bf-db7f-42d2-81d3-8667e818f241,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41cfc8d29246489bbf1483cbbe43b76e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:33:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:33:25Z,use_quota=True,user_id='6ed4b50bbdb74dc8a39e8febae1b5aac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:24 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-d03ec327-2961-44b6-8509-812cd9e23450 tempest-ProjectReaderTests-217186517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01c2c48f-9911-4649-9753-3269bdc2c865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:24 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-d03ec327-2961-44b6-8509-812cd9e23450 tempest-ProjectReaderTests-217186517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01c2c48f-9911-4649-9753-3269bdc2c865) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:24 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-d03ec327-2961-44b6-8509-812cd9e23450 tempest-ProjectReaderTests-217186517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbc0bb87-f5fc-4d05-8db1-51f48099b59d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:24 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-d03ec327-2961-44b6-8509-812cd9e23450 tempest-ProjectReaderTests-217186517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbc0bb87-f5fc-4d05-8db1-51f48099b59d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4bace3bf-db7f-42d2-81d3-8667e818f241', 'volume_name': 'volume-4bace3bf-db7f-42d2-81d3-8667e818f241', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:24 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-d03ec327-2961-44b6-8509-812cd9e23450 tempest-ProjectReaderTests-217186517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03318301-28b5-4846-be2c-b0a530089ddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:24 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-d03ec327-2961-44b6-8509-812cd9e23450 tempest-ProjectReaderTests-217186517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03318301-28b5-4846-be2c-b0a530089ddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:24 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-d03ec327-2961-44b6-8509-812cd9e23450 tempest-ProjectReaderTests-217186517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95ede1e9-c04e-4996-894f-fdd1cfaf3d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:24 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-d03ec327-2961-44b6-8509-812cd9e23450 tempest-ProjectReaderTests-217186517 None] Volume 4bace3bf-db7f-42d2-81d3-8667e818f241: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4bace3bf-db7f-42d2-81d3-8667e818f241', 'volume_size': 1} Jul 22 03:33:24 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-d03ec327-2961-44b6-8509-812cd9e23450 tempest-ProjectReaderTests-217186517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:33:24 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-d03ec327-2961-44b6-8509-812cd9e23450 tempest-ProjectReaderTests-217186517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:33:24 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-d03ec327-2961-44b6-8509-812cd9e23450 tempest-ProjectReaderTests-217186517 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:33:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1168676771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bace3bf-db7f-42d2-81d3-8667e818f241,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41cfc8d29246489bbf1483cbbe43b76e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:33:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:33:25Z,use_quota=True,user_id='6ed4b50bbdb74dc8a39e8febae1b5aac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:33:25 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-d03ec327-2961-44b6-8509-812cd9e23450 tempest-ProjectReaderTests-217186517 None] Creating volume 4bace3bf-db7f-42d2-81d3-8667e818f241 {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:33:25 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-d03ec327-2961-44b6-8509-812cd9e23450 tempest-ProjectReaderTests-217186517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:33:25 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-d03ec327-2961-44b6-8509-812cd9e23450 tempest-ProjectReaderTests-217186517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:33:25 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-d03ec327-2961-44b6-8509-812cd9e23450 tempest-ProjectReaderTests-217186517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:33:25 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-d03ec327-2961-44b6-8509-812cd9e23450 tempest-ProjectReaderTests-217186517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:33:25 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-d03ec327-2961-44b6-8509-812cd9e23450 tempest-ProjectReaderTests-217186517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:33:25 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-d03ec327-2961-44b6-8509-812cd9e23450 tempest-ProjectReaderTests-217186517 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:33:25 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-d03ec327-2961-44b6-8509-812cd9e23450 tempest-ProjectReaderTests-217186517 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:33:25 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d03ec327-2961-44b6-8509-812cd9e23450 tempest-ProjectReaderTests-217186517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4bace3bf-db7f-42d2-81d3-8667e818f241 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:33:25 devstack sudo[104668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4bace3bf-db7f-42d2-81d3-8667e818f241 1073741824 Jul 22 03:33:25 devstack sudo[104668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:33:25 devstack sudo[104668]: pam_unix(sudo:session): session closed for user root Jul 22 03:33:25 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d03ec327-2961-44b6-8509-812cd9e23450 tempest-ProjectReaderTests-217186517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4bace3bf-db7f-42d2-81d3-8667e818f241 1073741824" returned: 0 in 0.393s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:33:25 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d03ec327-2961-44b6-8509-812cd9e23450 tempest-ProjectReaderTests-217186517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4bace3bf-db7f-42d2-81d3-8667e818f241 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:33:25 devstack sudo[104673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4bace3bf-db7f-42d2-81d3-8667e818f241 Jul 22 03:33:25 devstack sudo[104673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:33:25 devstack sudo[104673]: pam_unix(sudo:session): session closed for user root Jul 22 03:33:25 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d03ec327-2961-44b6-8509-812cd9e23450 tempest-ProjectReaderTests-217186517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4bace3bf-db7f-42d2-81d3-8667e818f241" returned: 0 in 0.246s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:33:25 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-d03ec327-2961-44b6-8509-812cd9e23450 tempest-ProjectReaderTests-217186517 None] <== create_volume: return (678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:33:25 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-d03ec327-2961-44b6-8509-812cd9e23450 tempest-ProjectReaderTests-217186517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.682s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:33:25 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-d03ec327-2961-44b6-8509-812cd9e23450 tempest-ProjectReaderTests-217186517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95ede1e9-c04e-4996-894f-fdd1cfaf3d45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4bace3bf-db7f-42d2-81d3-8667e818f241', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:25 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-d03ec327-2961-44b6-8509-812cd9e23450 tempest-ProjectReaderTests-217186517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (197964d4-7453-41ca-a1d3-0362fea0078b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:25 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-d03ec327-2961-44b6-8509-812cd9e23450 tempest-ProjectReaderTests-217186517 None] Volume volume-4bace3bf-db7f-42d2-81d3-8667e818f241 (4bace3bf-db7f-42d2-81d3-8667e818f241): created successfully Jul 22 03:33:25 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-d03ec327-2961-44b6-8509-812cd9e23450 tempest-ProjectReaderTests-217186517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (197964d4-7453-41ca-a1d3-0362fea0078b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:25 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-d03ec327-2961-44b6-8509-812cd9e23450 tempest-ProjectReaderTests-217186517 None] Flow 'volume_create_manager' (bbb2600f-c1fe-4ca2-9d66-036fb00653d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:33:25 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-d03ec327-2961-44b6-8509-812cd9e23450 tempest-ProjectReaderTests-217186517 None] Created volume successfully. Jul 22 03:33:25 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-8105077f-8e70-44de-ae6f-9cc2fb7e8536 tempest-ProjectReaderTests-217186517 None] Acquiring lock "cinder-4bace3bf-db7f-42d2-81d3-8667e818f241-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:33:25 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-8105077f-8e70-44de-ae6f-9cc2fb7e8536 tempest-ProjectReaderTests-217186517 None] Lock "cinder-4bace3bf-db7f-42d2-81d3-8667e818f241-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:33:26 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-8105077f-8e70-44de-ae6f-9cc2fb7e8536 tempest-ProjectReaderTests-217186517 None] Acquiring lock "cinder-quobyte-4bace3bf-db7f-42d2-81d3-8667e818f241" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:33:26 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-8105077f-8e70-44de-ae6f-9cc2fb7e8536 tempest-ProjectReaderTests-217186517 None] Lock "cinder-quobyte-4bace3bf-db7f-42d2-81d3-8667e818f241" acquired by "delete_volume" :: waited 0.015s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:33:26 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[485e868c-1d87-4f06-91d8-8d84ab0b25bc]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:33:26 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-8105077f-8e70-44de-ae6f-9cc2fb7e8536 tempest-ProjectReaderTests-217186517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4bace3bf-db7f-42d2-81d3-8667e818f241 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:33:26 devstack sudo[104676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4bace3bf-db7f-42d2-81d3-8667e818f241 Jul 22 03:33:26 devstack sudo[104676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:33:26 devstack sudo[104676]: pam_unix(sudo:session): session closed for user root Jul 22 03:33:26 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-8105077f-8e70-44de-ae6f-9cc2fb7e8536 tempest-ProjectReaderTests-217186517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4bace3bf-db7f-42d2-81d3-8667e818f241" returned: 0 in 0.352s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:33:26 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-8105077f-8e70-44de-ae6f-9cc2fb7e8536 tempest-ProjectReaderTests-217186517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4bace3bf-db7f-42d2-81d3-8667e818f241 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:33:26 devstack sudo[104681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4bace3bf-db7f-42d2-81d3-8667e818f241 Jul 22 03:33:26 devstack sudo[104681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:33:26 devstack sudo[104681]: pam_unix(sudo:session): session closed for user root Jul 22 03:33:26 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-8105077f-8e70-44de-ae6f-9cc2fb7e8536 tempest-ProjectReaderTests-217186517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4bace3bf-db7f-42d2-81d3-8667e818f241" returned: 0 in 0.239s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:33:26 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-8105077f-8e70-44de-ae6f-9cc2fb7e8536 tempest-ProjectReaderTests-217186517 None] Lock "cinder-quobyte-4bace3bf-db7f-42d2-81d3-8667e818f241" released by "delete_volume" :: held 0.629s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:33:26 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-8105077f-8e70-44de-ae6f-9cc2fb7e8536 tempest-ProjectReaderTests-217186517 None] Created reservations ['125f87be-1de9-479b-8a01-7c3d81f86724', 'd1bbc51c-d71d-496b-9602-a2d2095b4ad0', '50a83f39-0523-419a-a70b-5b3d929b674e', '7eb28552-4936-4a14-8b55-e484f860452f'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:33:26 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-8105077f-8e70-44de-ae6f-9cc2fb7e8536 tempest-ProjectReaderTests-217186517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:33:26 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-8105077f-8e70-44de-ae6f-9cc2fb7e8536 tempest-ProjectReaderTests-217186517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:33:26 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-8105077f-8e70-44de-ae6f-9cc2fb7e8536 tempest-ProjectReaderTests-217186517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:33:26 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-8105077f-8e70-44de-ae6f-9cc2fb7e8536 tempest-ProjectReaderTests-217186517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:33:26 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-8105077f-8e70-44de-ae6f-9cc2fb7e8536 tempest-ProjectReaderTests-217186517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:33:26 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-8105077f-8e70-44de-ae6f-9cc2fb7e8536 tempest-ProjectReaderTests-217186517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:33:26 devstack sudo[104684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:33:26 devstack sudo[104684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:33:27 devstack sudo[104684]: pam_unix(sudo:session): session closed for user root Jul 22 03:33:27 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-8105077f-8e70-44de-ae6f-9cc2fb7e8536 tempest-ProjectReaderTests-217186517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.241s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:33:27 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-8105077f-8e70-44de-ae6f-9cc2fb7e8536 tempest-ProjectReaderTests-217186517 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:33:27 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-8105077f-8e70-44de-ae6f-9cc2fb7e8536 tempest-ProjectReaderTests-217186517 None] Deleted volume successfully. Jul 22 03:33:27 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-8105077f-8e70-44de-ae6f-9cc2fb7e8536 tempest-ProjectReaderTests-217186517 None] Lock "cinder-4bace3bf-db7f-42d2-81d3-8667e818f241-delete_volume" released by "delete_volume" :: held 1.062s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:33:27 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-92e662dd-7c38-4dcf-b0db-69c5d49df4b4 tempest-ProjectReaderTests-217186517 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:33:27 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-92e662dd-7c38-4dcf-b0db-69c5d49df4b4 tempest-ProjectReaderTests-217186517 None] Flow 'volume_create_manager' (b5c96967-fdaa-4941-a194-ffaaf55d6cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:33:27 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-92e662dd-7c38-4dcf-b0db-69c5d49df4b4 tempest-ProjectReaderTests-217186517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84997f00-f6c1-4709-818e-8e08bb6b7731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:27 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-92e662dd-7c38-4dcf-b0db-69c5d49df4b4 tempest-ProjectReaderTests-217186517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84997f00-f6c1-4709-818e-8e08bb6b7731) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:33:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1614460892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c428a9c1-0fd5-4741-af2e-47a95db66731,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41cfc8d29246489bbf1483cbbe43b76e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:33:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:33:28Z,use_quota=True,user_id='6ed4b50bbdb74dc8a39e8febae1b5aac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:27 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-92e662dd-7c38-4dcf-b0db-69c5d49df4b4 tempest-ProjectReaderTests-217186517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (509af62a-4947-4e17-b830-db94bb80db40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:27 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-92e662dd-7c38-4dcf-b0db-69c5d49df4b4 tempest-ProjectReaderTests-217186517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (509af62a-4947-4e17-b830-db94bb80db40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:27 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-92e662dd-7c38-4dcf-b0db-69c5d49df4b4 tempest-ProjectReaderTests-217186517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2aa3d9c7-8da8-4cc4-9cbb-980ceb883db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:27 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-92e662dd-7c38-4dcf-b0db-69c5d49df4b4 tempest-ProjectReaderTests-217186517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2aa3d9c7-8da8-4cc4-9cbb-980ceb883db7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c428a9c1-0fd5-4741-af2e-47a95db66731', 'volume_name': 'volume-c428a9c1-0fd5-4741-af2e-47a95db66731', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:27 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-92e662dd-7c38-4dcf-b0db-69c5d49df4b4 tempest-ProjectReaderTests-217186517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c4104f7-f38f-4991-b69a-dc0f17cbb786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:27 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-92e662dd-7c38-4dcf-b0db-69c5d49df4b4 tempest-ProjectReaderTests-217186517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c4104f7-f38f-4991-b69a-dc0f17cbb786) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:27 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-92e662dd-7c38-4dcf-b0db-69c5d49df4b4 tempest-ProjectReaderTests-217186517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41295195-3255-4552-bbcf-307d3197fb0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:27 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-92e662dd-7c38-4dcf-b0db-69c5d49df4b4 tempest-ProjectReaderTests-217186517 None] Volume c428a9c1-0fd5-4741-af2e-47a95db66731: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c428a9c1-0fd5-4741-af2e-47a95db66731', 'volume_size': 1} Jul 22 03:33:27 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-92e662dd-7c38-4dcf-b0db-69c5d49df4b4 tempest-ProjectReaderTests-217186517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:33:27 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-92e662dd-7c38-4dcf-b0db-69c5d49df4b4 tempest-ProjectReaderTests-217186517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:33:27 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-92e662dd-7c38-4dcf-b0db-69c5d49df4b4 tempest-ProjectReaderTests-217186517 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:33:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1614460892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c428a9c1-0fd5-4741-af2e-47a95db66731,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41cfc8d29246489bbf1483cbbe43b76e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:33:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:33:28Z,use_quota=True,user_id='6ed4b50bbdb74dc8a39e8febae1b5aac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:33:27 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-92e662dd-7c38-4dcf-b0db-69c5d49df4b4 tempest-ProjectReaderTests-217186517 None] Creating volume c428a9c1-0fd5-4741-af2e-47a95db66731 {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:33:27 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-92e662dd-7c38-4dcf-b0db-69c5d49df4b4 tempest-ProjectReaderTests-217186517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:33:27 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-92e662dd-7c38-4dcf-b0db-69c5d49df4b4 tempest-ProjectReaderTests-217186517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:33:27 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-92e662dd-7c38-4dcf-b0db-69c5d49df4b4 tempest-ProjectReaderTests-217186517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:33:27 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-92e662dd-7c38-4dcf-b0db-69c5d49df4b4 tempest-ProjectReaderTests-217186517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:33:27 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-92e662dd-7c38-4dcf-b0db-69c5d49df4b4 tempest-ProjectReaderTests-217186517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:33:27 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-92e662dd-7c38-4dcf-b0db-69c5d49df4b4 tempest-ProjectReaderTests-217186517 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:33:27 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-92e662dd-7c38-4dcf-b0db-69c5d49df4b4 tempest-ProjectReaderTests-217186517 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:33:27 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-92e662dd-7c38-4dcf-b0db-69c5d49df4b4 tempest-ProjectReaderTests-217186517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c428a9c1-0fd5-4741-af2e-47a95db66731 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:33:27 devstack sudo[104689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c428a9c1-0fd5-4741-af2e-47a95db66731 1073741824 Jul 22 03:33:27 devstack sudo[104689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:33:28 devstack sudo[104689]: pam_unix(sudo:session): session closed for user root Jul 22 03:33:28 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-92e662dd-7c38-4dcf-b0db-69c5d49df4b4 tempest-ProjectReaderTests-217186517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c428a9c1-0fd5-4741-af2e-47a95db66731 1073741824" returned: 0 in 0.398s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:33:28 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-92e662dd-7c38-4dcf-b0db-69c5d49df4b4 tempest-ProjectReaderTests-217186517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c428a9c1-0fd5-4741-af2e-47a95db66731 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:33:28 devstack sudo[104695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c428a9c1-0fd5-4741-af2e-47a95db66731 Jul 22 03:33:28 devstack sudo[104695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:33:28 devstack sudo[104695]: pam_unix(sudo:session): session closed for user root Jul 22 03:33:28 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-92e662dd-7c38-4dcf-b0db-69c5d49df4b4 tempest-ProjectReaderTests-217186517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c428a9c1-0fd5-4741-af2e-47a95db66731" returned: 0 in 0.229s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:33:28 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-92e662dd-7c38-4dcf-b0db-69c5d49df4b4 tempest-ProjectReaderTests-217186517 None] <== create_volume: return (664ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:33:28 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-92e662dd-7c38-4dcf-b0db-69c5d49df4b4 tempest-ProjectReaderTests-217186517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.667s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:33:28 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-92e662dd-7c38-4dcf-b0db-69c5d49df4b4 tempest-ProjectReaderTests-217186517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41295195-3255-4552-bbcf-307d3197fb0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c428a9c1-0fd5-4741-af2e-47a95db66731', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:28 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-92e662dd-7c38-4dcf-b0db-69c5d49df4b4 tempest-ProjectReaderTests-217186517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72a099d6-9d71-4a22-9da1-e376291e8c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:28 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-92e662dd-7c38-4dcf-b0db-69c5d49df4b4 tempest-ProjectReaderTests-217186517 None] Volume volume-c428a9c1-0fd5-4741-af2e-47a95db66731 (c428a9c1-0fd5-4741-af2e-47a95db66731): created successfully Jul 22 03:33:28 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-92e662dd-7c38-4dcf-b0db-69c5d49df4b4 tempest-ProjectReaderTests-217186517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72a099d6-9d71-4a22-9da1-e376291e8c7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:28 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-92e662dd-7c38-4dcf-b0db-69c5d49df4b4 tempest-ProjectReaderTests-217186517 None] Flow 'volume_create_manager' (b5c96967-fdaa-4941-a194-ffaaf55d6cf7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:33:28 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-92e662dd-7c38-4dcf-b0db-69c5d49df4b4 tempest-ProjectReaderTests-217186517 None] Created volume successfully. Jul 22 03:33:28 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-dc8f512e-c9d5-485e-a187-e60dde8f41fd tempest-ProjectReaderTests-217186517 None] Acquiring lock "cinder-c428a9c1-0fd5-4741-af2e-47a95db66731-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:33:28 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-dc8f512e-c9d5-485e-a187-e60dde8f41fd tempest-ProjectReaderTests-217186517 None] Lock "cinder-c428a9c1-0fd5-4741-af2e-47a95db66731-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:33:28 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-dc8f512e-c9d5-485e-a187-e60dde8f41fd tempest-ProjectReaderTests-217186517 None] Acquiring lock "cinder-quobyte-c428a9c1-0fd5-4741-af2e-47a95db66731" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:33:28 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-dc8f512e-c9d5-485e-a187-e60dde8f41fd tempest-ProjectReaderTests-217186517 None] Lock "cinder-quobyte-c428a9c1-0fd5-4741-af2e-47a95db66731" acquired by "delete_volume" :: waited 0.017s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:33:28 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[333b012d-2f69-4bad-ac46-c32ab1f44f26]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:33:28 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-dc8f512e-c9d5-485e-a187-e60dde8f41fd tempest-ProjectReaderTests-217186517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c428a9c1-0fd5-4741-af2e-47a95db66731 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:33:28 devstack sudo[104698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c428a9c1-0fd5-4741-af2e-47a95db66731 Jul 22 03:33:28 devstack sudo[104698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:33:29 devstack sudo[104698]: pam_unix(sudo:session): session closed for user root Jul 22 03:33:29 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-dc8f512e-c9d5-485e-a187-e60dde8f41fd tempest-ProjectReaderTests-217186517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c428a9c1-0fd5-4741-af2e-47a95db66731" returned: 0 in 0.349s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:33:29 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-dc8f512e-c9d5-485e-a187-e60dde8f41fd tempest-ProjectReaderTests-217186517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c428a9c1-0fd5-4741-af2e-47a95db66731 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:33:29 devstack sudo[104703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c428a9c1-0fd5-4741-af2e-47a95db66731 Jul 22 03:33:29 devstack sudo[104703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:33:29 devstack sudo[104703]: pam_unix(sudo:session): session closed for user root Jul 22 03:33:29 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-dc8f512e-c9d5-485e-a187-e60dde8f41fd tempest-ProjectReaderTests-217186517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c428a9c1-0fd5-4741-af2e-47a95db66731" returned: 0 in 0.233s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:33:29 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-dc8f512e-c9d5-485e-a187-e60dde8f41fd tempest-ProjectReaderTests-217186517 None] Lock "cinder-quobyte-c428a9c1-0fd5-4741-af2e-47a95db66731" released by "delete_volume" :: held 0.618s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:33:29 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-dc8f512e-c9d5-485e-a187-e60dde8f41fd tempest-ProjectReaderTests-217186517 None] Created reservations ['98467ebb-c8e9-4da7-a69e-1111691ba29f', '4d0f5da3-6494-4e24-ac50-9d1871588c14', '6240b69b-055e-4594-846b-3935d58fc08f', 'ce6d0766-6a16-4091-b0a2-3afbd262af5d'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:33:29 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-dc8f512e-c9d5-485e-a187-e60dde8f41fd tempest-ProjectReaderTests-217186517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:33:29 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-dc8f512e-c9d5-485e-a187-e60dde8f41fd tempest-ProjectReaderTests-217186517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:33:29 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-dc8f512e-c9d5-485e-a187-e60dde8f41fd tempest-ProjectReaderTests-217186517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:33:29 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-dc8f512e-c9d5-485e-a187-e60dde8f41fd tempest-ProjectReaderTests-217186517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:33:29 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-dc8f512e-c9d5-485e-a187-e60dde8f41fd tempest-ProjectReaderTests-217186517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:33:29 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-dc8f512e-c9d5-485e-a187-e60dde8f41fd tempest-ProjectReaderTests-217186517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:33:29 devstack sudo[104706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:33:29 devstack sudo[104706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:33:29 devstack sudo[104706]: pam_unix(sudo:session): session closed for user root Jul 22 03:33:29 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-dc8f512e-c9d5-485e-a187-e60dde8f41fd tempest-ProjectReaderTests-217186517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.237s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:33:29 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-dc8f512e-c9d5-485e-a187-e60dde8f41fd tempest-ProjectReaderTests-217186517 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:33:29 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-dc8f512e-c9d5-485e-a187-e60dde8f41fd tempest-ProjectReaderTests-217186517 None] Deleted volume successfully. Jul 22 03:33:29 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-dc8f512e-c9d5-485e-a187-e60dde8f41fd tempest-ProjectReaderTests-217186517 None] Lock "cinder-c428a9c1-0fd5-4741-af2e-47a95db66731-delete_volume" released by "delete_volume" :: held 1.034s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:33:39 devstack cinder-volume[87747]: DEBUG dbcounter [-] [87747] Writing DB stats cinder:SELECT=46,cinder:UPDATE=72,cinder:INSERT=17,cinder:DELETE=4 {{(pid=87747) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 03:33:39 devstack cinder-volume[87747]: DEBUG dbcounter [-] [87747] Writing DB stats cinder:SELECT=57,cinder:UPDATE=63,cinder:INSERT=15,cinder:DELETE=6 {{(pid=87747) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 03:33:41 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-77064712-b2c2-482c-a766-24ac5eabfd20 tempest-CreateVolumesFromImageTest-284360659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:33:41 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-77064712-b2c2-482c-a766-24ac5eabfd20 tempest-CreateVolumesFromImageTest-284360659 None] Flow 'volume_create_manager' (9717098c-46a7-4b42-94d2-f73686bddaad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:33:41 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-77064712-b2c2-482c-a766-24ac5eabfd20 tempest-CreateVolumesFromImageTest-284360659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (926396a6-3030-46e1-8aeb-de4832a457d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:41 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-77064712-b2c2-482c-a766-24ac5eabfd20 tempest-CreateVolumesFromImageTest-284360659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (926396a6-3030-46e1-8aeb-de4832a457d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:33:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-427093171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cef7e3c9-5317-49b5-b984-6af817c41213,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1291a90e3830447199bbf52100066e7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:33:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:33:41Z,use_quota=True,user_id='7cb0032b759943cab42bc0e2aa5dd378',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:41 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-77064712-b2c2-482c-a766-24ac5eabfd20 tempest-CreateVolumesFromImageTest-284360659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c0baedb-ed1e-4576-b464-de02a8e74851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:41 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-77064712-b2c2-482c-a766-24ac5eabfd20 tempest-CreateVolumesFromImageTest-284360659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c0baedb-ed1e-4576-b464-de02a8e74851) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:41 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-77064712-b2c2-482c-a766-24ac5eabfd20 tempest-CreateVolumesFromImageTest-284360659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a78ac38b-8190-44d9-ab0b-2995b94dcefd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:41 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-77064712-b2c2-482c-a766-24ac5eabfd20 tempest-CreateVolumesFromImageTest-284360659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a78ac38b-8190-44d9-ab0b-2995b94dcefd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cef7e3c9-5317-49b5-b984-6af817c41213', 'volume_name': 'volume-cef7e3c9-5317-49b5-b984-6af817c41213', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:41 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-77064712-b2c2-482c-a766-24ac5eabfd20 tempest-CreateVolumesFromImageTest-284360659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cdd2f7b-fdeb-47c2-8e61-9905215d73ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:41 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-77064712-b2c2-482c-a766-24ac5eabfd20 tempest-CreateVolumesFromImageTest-284360659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cdd2f7b-fdeb-47c2-8e61-9905215d73ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:41 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-77064712-b2c2-482c-a766-24ac5eabfd20 tempest-CreateVolumesFromImageTest-284360659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (882e870d-2849-42f8-8f5a-686d7214a17a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:41 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-77064712-b2c2-482c-a766-24ac5eabfd20 tempest-CreateVolumesFromImageTest-284360659 None] Volume cef7e3c9-5317-49b5-b984-6af817c41213: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cef7e3c9-5317-49b5-b984-6af817c41213', 'volume_size': 1} Jul 22 03:33:41 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-77064712-b2c2-482c-a766-24ac5eabfd20 tempest-CreateVolumesFromImageTest-284360659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:33:41 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-77064712-b2c2-482c-a766-24ac5eabfd20 tempest-CreateVolumesFromImageTest-284360659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:33:41 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-77064712-b2c2-482c-a766-24ac5eabfd20 tempest-CreateVolumesFromImageTest-284360659 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:33:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-427093171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cef7e3c9-5317-49b5-b984-6af817c41213,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1291a90e3830447199bbf52100066e7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:33:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:33:41Z,use_quota=True,user_id='7cb0032b759943cab42bc0e2aa5dd378',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:33:41 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-77064712-b2c2-482c-a766-24ac5eabfd20 tempest-CreateVolumesFromImageTest-284360659 None] Creating volume cef7e3c9-5317-49b5-b984-6af817c41213 {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:33:41 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-77064712-b2c2-482c-a766-24ac5eabfd20 tempest-CreateVolumesFromImageTest-284360659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:33:41 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-77064712-b2c2-482c-a766-24ac5eabfd20 tempest-CreateVolumesFromImageTest-284360659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:33:41 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-77064712-b2c2-482c-a766-24ac5eabfd20 tempest-CreateVolumesFromImageTest-284360659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:33:41 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-77064712-b2c2-482c-a766-24ac5eabfd20 tempest-CreateVolumesFromImageTest-284360659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:33:41 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-77064712-b2c2-482c-a766-24ac5eabfd20 tempest-CreateVolumesFromImageTest-284360659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:33:41 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-77064712-b2c2-482c-a766-24ac5eabfd20 tempest-CreateVolumesFromImageTest-284360659 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:33:41 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-77064712-b2c2-482c-a766-24ac5eabfd20 tempest-CreateVolumesFromImageTest-284360659 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:33:41 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-77064712-b2c2-482c-a766-24ac5eabfd20 tempest-CreateVolumesFromImageTest-284360659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-cef7e3c9-5317-49b5-b984-6af817c41213 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:33:41 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-03e1d1ee-6202-4776-919f-1e6fc14ed9d6 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:33:41 devstack sudo[104784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-cef7e3c9-5317-49b5-b984-6af817c41213 1073741824 Jul 22 03:33:41 devstack sudo[104784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:33:41 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-03e1d1ee-6202-4776-919f-1e6fc14ed9d6 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Flow 'volume_create_manager' (2fb0beab-08ff-4d86-bbfd-8a77472938b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:33:41 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-03e1d1ee-6202-4776-919f-1e6fc14ed9d6 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10f30b79-b5dd-4c99-8d6b-15ee24e0be03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:41 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-03e1d1ee-6202-4776-919f-1e6fc14ed9d6 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10f30b79-b5dd-4c99-8d6b-15ee24e0be03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:33:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-260076583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6d71831-ad84-45b3-a813-c2017dedf2c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='859b16a72cbe43ef9fe7635d919c6982',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:33:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:33:42Z,use_quota=True,user_id='bb2594bec8ab4b78917d3a8228203573',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:41 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-03e1d1ee-6202-4776-919f-1e6fc14ed9d6 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (753f1e9f-efc6-46c7-b78e-ac62095c27db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:41 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-03e1d1ee-6202-4776-919f-1e6fc14ed9d6 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (753f1e9f-efc6-46c7-b78e-ac62095c27db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:41 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-03e1d1ee-6202-4776-919f-1e6fc14ed9d6 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d38adaa4-5178-4920-9c1d-ec2f43d7d002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:41 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-03e1d1ee-6202-4776-919f-1e6fc14ed9d6 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d38adaa4-5178-4920-9c1d-ec2f43d7d002) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6d71831-ad84-45b3-a813-c2017dedf2c7', 'volume_name': 'volume-a6d71831-ad84-45b3-a813-c2017dedf2c7', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:41 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-03e1d1ee-6202-4776-919f-1e6fc14ed9d6 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1758647b-d2b1-4a23-9619-404436a99746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:41 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-03e1d1ee-6202-4776-919f-1e6fc14ed9d6 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1758647b-d2b1-4a23-9619-404436a99746) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:41 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-03e1d1ee-6202-4776-919f-1e6fc14ed9d6 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab43a730-5ee7-4381-a8a3-6df94d17af0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:41 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-03e1d1ee-6202-4776-919f-1e6fc14ed9d6 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Volume a6d71831-ad84-45b3-a813-c2017dedf2c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6d71831-ad84-45b3-a813-c2017dedf2c7', 'volume_size': 1} Jul 22 03:33:41 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-03e1d1ee-6202-4776-919f-1e6fc14ed9d6 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:33:41 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-f14650ff-33d5-42f5-9d3b-fc21d6e06c92 tempest-CreateVolumesFromImageTest-284360659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:33:42 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f14650ff-33d5-42f5-9d3b-fc21d6e06c92 tempest-CreateVolumesFromImageTest-284360659 None] Flow 'volume_create_manager' (6131095d-f3c2-4739-af9c-3375cbe9254b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:33:42 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f14650ff-33d5-42f5-9d3b-fc21d6e06c92 tempest-CreateVolumesFromImageTest-284360659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d006a00-a8fc-4702-b0f1-91a32b027a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:42 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f14650ff-33d5-42f5-9d3b-fc21d6e06c92 tempest-CreateVolumesFromImageTest-284360659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d006a00-a8fc-4702-b0f1-91a32b027a5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:33:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-8747744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b79490b-c9e5-4218-b8df-cabfb040cf7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1291a90e3830447199bbf52100066e7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:33:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:33:42Z,use_quota=True,user_id='7cb0032b759943cab42bc0e2aa5dd378',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:42 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f14650ff-33d5-42f5-9d3b-fc21d6e06c92 tempest-CreateVolumesFromImageTest-284360659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31cae95b-7ea4-4197-911c-d7dc2483927d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:42 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f14650ff-33d5-42f5-9d3b-fc21d6e06c92 tempest-CreateVolumesFromImageTest-284360659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31cae95b-7ea4-4197-911c-d7dc2483927d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:42 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f14650ff-33d5-42f5-9d3b-fc21d6e06c92 tempest-CreateVolumesFromImageTest-284360659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab5c67af-17dd-4e58-bd69-3cf7ba1474bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:42 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f14650ff-33d5-42f5-9d3b-fc21d6e06c92 tempest-CreateVolumesFromImageTest-284360659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab5c67af-17dd-4e58-bd69-3cf7ba1474bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b79490b-c9e5-4218-b8df-cabfb040cf7d', 'volume_name': 'volume-7b79490b-c9e5-4218-b8df-cabfb040cf7d', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:42 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f14650ff-33d5-42f5-9d3b-fc21d6e06c92 tempest-CreateVolumesFromImageTest-284360659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9cc27ea-2174-4712-9745-e3a335bb8c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:42 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f14650ff-33d5-42f5-9d3b-fc21d6e06c92 tempest-CreateVolumesFromImageTest-284360659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9cc27ea-2174-4712-9745-e3a335bb8c5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:42 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f14650ff-33d5-42f5-9d3b-fc21d6e06c92 tempest-CreateVolumesFromImageTest-284360659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7c77a49-f08d-4f00-9704-33f616738b81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:42 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-f14650ff-33d5-42f5-9d3b-fc21d6e06c92 tempest-CreateVolumesFromImageTest-284360659 None] Volume 7b79490b-c9e5-4218-b8df-cabfb040cf7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b79490b-c9e5-4218-b8df-cabfb040cf7d', 'volume_size': 1} Jul 22 03:33:42 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-f14650ff-33d5-42f5-9d3b-fc21d6e06c92 tempest-CreateVolumesFromImageTest-284360659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:33:42 devstack sudo[104784]: pam_unix(sudo:session): session closed for user root Jul 22 03:33:42 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-01fe89ab-e1e7-4765-aece-143c9110cc43 tempest-CreateVolumesFromSnapshotTest-653456616 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:33:42 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-01fe89ab-e1e7-4765-aece-143c9110cc43 tempest-CreateVolumesFromSnapshotTest-653456616 None] Flow 'volume_create_manager' (f7950111-472f-4944-9e41-b5c58b60be47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:33:42 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-01fe89ab-e1e7-4765-aece-143c9110cc43 tempest-CreateVolumesFromSnapshotTest-653456616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (668dfb5d-e376-465e-b7fb-12fada5e7aaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:42 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-77064712-b2c2-482c-a766-24ac5eabfd20 tempest-CreateVolumesFromImageTest-284360659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-cef7e3c9-5317-49b5-b984-6af817c41213 1073741824" returned: 0 in 0.602s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:33:42 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-01fe89ab-e1e7-4765-aece-143c9110cc43 tempest-CreateVolumesFromSnapshotTest-653456616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (668dfb5d-e376-465e-b7fb-12fada5e7aaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:33:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2008427010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=942e7752-6415-40b2-aaae-fcb41088682f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6833c4588e2148bebce14bdee1aa2f26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:33:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:33:42Z,use_quota=True,user_id='e17b7acea4db4ed389586494aaaa7915',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:42 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-01fe89ab-e1e7-4765-aece-143c9110cc43 tempest-CreateVolumesFromSnapshotTest-653456616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (619bd125-41f9-4f3f-86f2-164ab3258080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:42 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-01fe89ab-e1e7-4765-aece-143c9110cc43 tempest-CreateVolumesFromSnapshotTest-653456616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (619bd125-41f9-4f3f-86f2-164ab3258080) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:42 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-01fe89ab-e1e7-4765-aece-143c9110cc43 tempest-CreateVolumesFromSnapshotTest-653456616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (334cbf49-d2ce-4a0c-8736-68125f672b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:42 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-01fe89ab-e1e7-4765-aece-143c9110cc43 tempest-CreateVolumesFromSnapshotTest-653456616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (334cbf49-d2ce-4a0c-8736-68125f672b4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '942e7752-6415-40b2-aaae-fcb41088682f', 'volume_name': 'volume-942e7752-6415-40b2-aaae-fcb41088682f', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:42 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-01fe89ab-e1e7-4765-aece-143c9110cc43 tempest-CreateVolumesFromSnapshotTest-653456616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f24942ee-f626-45e0-b521-b1ca8cb97635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:42 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-01fe89ab-e1e7-4765-aece-143c9110cc43 tempest-CreateVolumesFromSnapshotTest-653456616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f24942ee-f626-45e0-b521-b1ca8cb97635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:42 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-01fe89ab-e1e7-4765-aece-143c9110cc43 tempest-CreateVolumesFromSnapshotTest-653456616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e39c29c7-e3bf-4aab-aada-bdff8282c076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:42 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-01fe89ab-e1e7-4765-aece-143c9110cc43 tempest-CreateVolumesFromSnapshotTest-653456616 None] Volume 942e7752-6415-40b2-aaae-fcb41088682f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-942e7752-6415-40b2-aaae-fcb41088682f', 'volume_size': 1} Jul 22 03:33:42 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-01fe89ab-e1e7-4765-aece-143c9110cc43 tempest-CreateVolumesFromSnapshotTest-653456616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:33:42 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-77064712-b2c2-482c-a766-24ac5eabfd20 tempest-CreateVolumesFromImageTest-284360659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-cef7e3c9-5317-49b5-b984-6af817c41213 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:33:42 devstack sudo[104790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-cef7e3c9-5317-49b5-b984-6af817c41213 Jul 22 03:33:42 devstack sudo[104790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:33:42 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e68cfdf-3085-4637-8d9c-4f8931ef2402 tempest-CreateVolumesFromImageTest-284360659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:33:42 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-9e68cfdf-3085-4637-8d9c-4f8931ef2402 tempest-CreateVolumesFromImageTest-284360659 None] Flow 'volume_create_manager' (4063daf3-6200-4e70-be6a-53be9b86eec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:33:42 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-9e68cfdf-3085-4637-8d9c-4f8931ef2402 tempest-CreateVolumesFromImageTest-284360659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5af7973b-c9f6-4678-813c-ccfeb5152ffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:42 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-9e68cfdf-3085-4637-8d9c-4f8931ef2402 tempest-CreateVolumesFromImageTest-284360659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5af7973b-c9f6-4678-813c-ccfeb5152ffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:33:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2145587497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55287bd0-d888-474e-bff1-0183ce0ada02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1291a90e3830447199bbf52100066e7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:33:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:33:43Z,use_quota=True,user_id='7cb0032b759943cab42bc0e2aa5dd378',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:42 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-9e68cfdf-3085-4637-8d9c-4f8931ef2402 tempest-CreateVolumesFromImageTest-284360659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5cbdf6e-87d2-4d26-a6c8-5b23f622cbd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:42 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-9e68cfdf-3085-4637-8d9c-4f8931ef2402 tempest-CreateVolumesFromImageTest-284360659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5cbdf6e-87d2-4d26-a6c8-5b23f622cbd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:42 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-9e68cfdf-3085-4637-8d9c-4f8931ef2402 tempest-CreateVolumesFromImageTest-284360659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a66d4d37-5ab4-4853-ab31-746280a982d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:42 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-9e68cfdf-3085-4637-8d9c-4f8931ef2402 tempest-CreateVolumesFromImageTest-284360659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a66d4d37-5ab4-4853-ab31-746280a982d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55287bd0-d888-474e-bff1-0183ce0ada02', 'volume_name': 'volume-55287bd0-d888-474e-bff1-0183ce0ada02', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:42 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-9e68cfdf-3085-4637-8d9c-4f8931ef2402 tempest-CreateVolumesFromImageTest-284360659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0462b393-9501-42c7-a483-6b77ef9f06b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:42 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-9e68cfdf-3085-4637-8d9c-4f8931ef2402 tempest-CreateVolumesFromImageTest-284360659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0462b393-9501-42c7-a483-6b77ef9f06b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:42 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-9e68cfdf-3085-4637-8d9c-4f8931ef2402 tempest-CreateVolumesFromImageTest-284360659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (940f74ea-f435-4980-8cdc-154563461fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:42 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-9e68cfdf-3085-4637-8d9c-4f8931ef2402 tempest-CreateVolumesFromImageTest-284360659 None] Volume 55287bd0-d888-474e-bff1-0183ce0ada02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55287bd0-d888-474e-bff1-0183ce0ada02', 'volume_size': 1} Jul 22 03:33:42 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-9e68cfdf-3085-4637-8d9c-4f8931ef2402 tempest-CreateVolumesFromImageTest-284360659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:33:42 devstack sudo[104790]: pam_unix(sudo:session): session closed for user root Jul 22 03:33:42 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-77064712-b2c2-482c-a766-24ac5eabfd20 tempest-CreateVolumesFromImageTest-284360659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-cef7e3c9-5317-49b5-b984-6af817c41213" returned: 0 in 0.314s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:33:42 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-77064712-b2c2-482c-a766-24ac5eabfd20 tempest-CreateVolumesFromImageTest-284360659 None] <== create_volume: return (1025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:33:42 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-77064712-b2c2-482c-a766-24ac5eabfd20 tempest-CreateVolumesFromImageTest-284360659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.028s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:33:42 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-03e1d1ee-6202-4776-919f-1e6fc14ed9d6 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.828s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:33:42 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-03e1d1ee-6202-4776-919f-1e6fc14ed9d6 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:33:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-260076583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6d71831-ad84-45b3-a813-c2017dedf2c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='859b16a72cbe43ef9fe7635d919c6982',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:33:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:33:42Z,use_quota=True,user_id='bb2594bec8ab4b78917d3a8228203573',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:33:42 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-03e1d1ee-6202-4776-919f-1e6fc14ed9d6 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Creating volume a6d71831-ad84-45b3-a813-c2017dedf2c7 {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:33:42 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-03e1d1ee-6202-4776-919f-1e6fc14ed9d6 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:33:42 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-03e1d1ee-6202-4776-919f-1e6fc14ed9d6 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:33:42 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-03e1d1ee-6202-4776-919f-1e6fc14ed9d6 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:33:42 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-03e1d1ee-6202-4776-919f-1e6fc14ed9d6 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:33:42 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-03e1d1ee-6202-4776-919f-1e6fc14ed9d6 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:33:42 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-03e1d1ee-6202-4776-919f-1e6fc14ed9d6 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:33:42 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-03e1d1ee-6202-4776-919f-1e6fc14ed9d6 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:33:42 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-03e1d1ee-6202-4776-919f-1e6fc14ed9d6 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a6d71831-ad84-45b3-a813-c2017dedf2c7 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:33:42 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-77064712-b2c2-482c-a766-24ac5eabfd20 tempest-CreateVolumesFromImageTest-284360659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (882e870d-2849-42f8-8f5a-686d7214a17a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cef7e3c9-5317-49b5-b984-6af817c41213', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:42 devstack sudo[104793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a6d71831-ad84-45b3-a813-c2017dedf2c7 1073741824 Jul 22 03:33:42 devstack sudo[104793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:33:42 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-77064712-b2c2-482c-a766-24ac5eabfd20 tempest-CreateVolumesFromImageTest-284360659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab447d3a-ef73-4e24-83f0-0b4214b9d454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:42 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-77064712-b2c2-482c-a766-24ac5eabfd20 tempest-CreateVolumesFromImageTest-284360659 None] Volume volume-cef7e3c9-5317-49b5-b984-6af817c41213 (cef7e3c9-5317-49b5-b984-6af817c41213): created successfully Jul 22 03:33:42 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-77064712-b2c2-482c-a766-24ac5eabfd20 tempest-CreateVolumesFromImageTest-284360659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab447d3a-ef73-4e24-83f0-0b4214b9d454) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:42 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-77064712-b2c2-482c-a766-24ac5eabfd20 tempest-CreateVolumesFromImageTest-284360659 None] Flow 'volume_create_manager' (9717098c-46a7-4b42-94d2-f73686bddaad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:33:42 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-77064712-b2c2-482c-a766-24ac5eabfd20 tempest-CreateVolumesFromImageTest-284360659 None] Created volume successfully. Jul 22 03:33:43 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c82587f-d16f-4c68-818e-e3abde1e3eca tempest-CreateVolumesFromImageTest-284360659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:33:43 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-8c82587f-d16f-4c68-818e-e3abde1e3eca tempest-CreateVolumesFromImageTest-284360659 None] Flow 'volume_create_manager' (7d43f921-f0f6-416e-b8a4-7144d81ce465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:33:43 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-8c82587f-d16f-4c68-818e-e3abde1e3eca tempest-CreateVolumesFromImageTest-284360659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dae04269-589a-499d-b1f4-a4ef3e43844b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:43 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-8c82587f-d16f-4c68-818e-e3abde1e3eca tempest-CreateVolumesFromImageTest-284360659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dae04269-589a-499d-b1f4-a4ef3e43844b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:33:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2027067256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98e26f32-6fcb-49b1-a7a1-223d8931ca91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1291a90e3830447199bbf52100066e7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:33:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:33:43Z,use_quota=True,user_id='7cb0032b759943cab42bc0e2aa5dd378',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:43 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-8c82587f-d16f-4c68-818e-e3abde1e3eca tempest-CreateVolumesFromImageTest-284360659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27046202-aa97-4898-87ac-79cdacd440fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:43 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-8c82587f-d16f-4c68-818e-e3abde1e3eca tempest-CreateVolumesFromImageTest-284360659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27046202-aa97-4898-87ac-79cdacd440fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:43 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-8c82587f-d16f-4c68-818e-e3abde1e3eca tempest-CreateVolumesFromImageTest-284360659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99e7c857-b1f4-43ad-ac6f-e2425522cfd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:43 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-8c82587f-d16f-4c68-818e-e3abde1e3eca tempest-CreateVolumesFromImageTest-284360659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99e7c857-b1f4-43ad-ac6f-e2425522cfd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98e26f32-6fcb-49b1-a7a1-223d8931ca91', 'volume_name': 'volume-98e26f32-6fcb-49b1-a7a1-223d8931ca91', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:43 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-8c82587f-d16f-4c68-818e-e3abde1e3eca tempest-CreateVolumesFromImageTest-284360659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a5a2031-e5b0-4b7e-8b70-430c859364de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:43 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-8c82587f-d16f-4c68-818e-e3abde1e3eca tempest-CreateVolumesFromImageTest-284360659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a5a2031-e5b0-4b7e-8b70-430c859364de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:43 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-8c82587f-d16f-4c68-818e-e3abde1e3eca tempest-CreateVolumesFromImageTest-284360659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8943cafd-0387-4533-a204-901bd188a961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:43 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-8c82587f-d16f-4c68-818e-e3abde1e3eca tempest-CreateVolumesFromImageTest-284360659 None] Volume 98e26f32-6fcb-49b1-a7a1-223d8931ca91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98e26f32-6fcb-49b1-a7a1-223d8931ca91', 'volume_size': 1} Jul 22 03:33:43 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-8c82587f-d16f-4c68-818e-e3abde1e3eca tempest-CreateVolumesFromImageTest-284360659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:33:43 devstack sudo[104793]: pam_unix(sudo:session): session closed for user root Jul 22 03:33:43 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-03e1d1ee-6202-4776-919f-1e6fc14ed9d6 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a6d71831-ad84-45b3-a813-c2017dedf2c7 1073741824" returned: 0 in 0.604s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:33:43 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-03e1d1ee-6202-4776-919f-1e6fc14ed9d6 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a6d71831-ad84-45b3-a813-c2017dedf2c7 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:33:43 devstack sudo[104800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a6d71831-ad84-45b3-a813-c2017dedf2c7 Jul 22 03:33:43 devstack sudo[104800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:33:43 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b5a5fe3-b821-4ac6-b671-db1222d43042 tempest-CreateVolumesFromImageTest-284360659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:33:43 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-8b5a5fe3-b821-4ac6-b671-db1222d43042 tempest-CreateVolumesFromImageTest-284360659 None] Flow 'volume_create_manager' (4e104d59-cfe0-47aa-9ef7-b88045da821a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:33:43 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-8b5a5fe3-b821-4ac6-b671-db1222d43042 tempest-CreateVolumesFromImageTest-284360659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12a3ca3b-478c-4e9c-ad41-d3bcb20051f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:43 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-8b5a5fe3-b821-4ac6-b671-db1222d43042 tempest-CreateVolumesFromImageTest-284360659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12a3ca3b-478c-4e9c-ad41-d3bcb20051f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:33:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1680333515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20354406-0586-44e3-a680-0d1517ca8a60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1291a90e3830447199bbf52100066e7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:33:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:33:43Z,use_quota=True,user_id='7cb0032b759943cab42bc0e2aa5dd378',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:43 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-8b5a5fe3-b821-4ac6-b671-db1222d43042 tempest-CreateVolumesFromImageTest-284360659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a3a3a30-b59a-41b1-9986-6aea4c0693e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:43 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-8b5a5fe3-b821-4ac6-b671-db1222d43042 tempest-CreateVolumesFromImageTest-284360659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a3a3a30-b59a-41b1-9986-6aea4c0693e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:43 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-8b5a5fe3-b821-4ac6-b671-db1222d43042 tempest-CreateVolumesFromImageTest-284360659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70c2b446-340a-41e9-bcc8-8b892573daeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:43 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-8b5a5fe3-b821-4ac6-b671-db1222d43042 tempest-CreateVolumesFromImageTest-284360659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70c2b446-340a-41e9-bcc8-8b892573daeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20354406-0586-44e3-a680-0d1517ca8a60', 'volume_name': 'volume-20354406-0586-44e3-a680-0d1517ca8a60', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:43 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-8b5a5fe3-b821-4ac6-b671-db1222d43042 tempest-CreateVolumesFromImageTest-284360659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa26de06-8a2c-4d64-be31-f88b1ae83d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:43 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-8b5a5fe3-b821-4ac6-b671-db1222d43042 tempest-CreateVolumesFromImageTest-284360659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa26de06-8a2c-4d64-be31-f88b1ae83d1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:43 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-8b5a5fe3-b821-4ac6-b671-db1222d43042 tempest-CreateVolumesFromImageTest-284360659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22784564-f6f9-4854-9a35-6dd37e288691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:43 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-8b5a5fe3-b821-4ac6-b671-db1222d43042 tempest-CreateVolumesFromImageTest-284360659 None] Volume 20354406-0586-44e3-a680-0d1517ca8a60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20354406-0586-44e3-a680-0d1517ca8a60', 'volume_size': 1} Jul 22 03:33:43 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-8b5a5fe3-b821-4ac6-b671-db1222d43042 tempest-CreateVolumesFromImageTest-284360659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:33:43 devstack sudo[104800]: pam_unix(sudo:session): session closed for user root Jul 22 03:33:43 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-03e1d1ee-6202-4776-919f-1e6fc14ed9d6 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a6d71831-ad84-45b3-a813-c2017dedf2c7" returned: 0 in 0.273s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:33:43 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-03e1d1ee-6202-4776-919f-1e6fc14ed9d6 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:33:43 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-03e1d1ee-6202-4776-919f-1e6fc14ed9d6 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:33:43 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-f14650ff-33d5-42f5-9d3b-fc21d6e06c92 tempest-CreateVolumesFromImageTest-284360659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.640s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:33:43 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-f14650ff-33d5-42f5-9d3b-fc21d6e06c92 tempest-CreateVolumesFromImageTest-284360659 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:33:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-8747744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b79490b-c9e5-4218-b8df-cabfb040cf7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1291a90e3830447199bbf52100066e7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:33:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:33:42Z,use_quota=True,user_id='7cb0032b759943cab42bc0e2aa5dd378',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:33:43 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-f14650ff-33d5-42f5-9d3b-fc21d6e06c92 tempest-CreateVolumesFromImageTest-284360659 None] Creating volume 7b79490b-c9e5-4218-b8df-cabfb040cf7d {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:33:43 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-f14650ff-33d5-42f5-9d3b-fc21d6e06c92 tempest-CreateVolumesFromImageTest-284360659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:33:43 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-f14650ff-33d5-42f5-9d3b-fc21d6e06c92 tempest-CreateVolumesFromImageTest-284360659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:33:43 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-f14650ff-33d5-42f5-9d3b-fc21d6e06c92 tempest-CreateVolumesFromImageTest-284360659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:33:43 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-f14650ff-33d5-42f5-9d3b-fc21d6e06c92 tempest-CreateVolumesFromImageTest-284360659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:33:43 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-f14650ff-33d5-42f5-9d3b-fc21d6e06c92 tempest-CreateVolumesFromImageTest-284360659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:33:43 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-f14650ff-33d5-42f5-9d3b-fc21d6e06c92 tempest-CreateVolumesFromImageTest-284360659 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:33:43 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-f14650ff-33d5-42f5-9d3b-fc21d6e06c92 tempest-CreateVolumesFromImageTest-284360659 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:33:43 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f14650ff-33d5-42f5-9d3b-fc21d6e06c92 tempest-CreateVolumesFromImageTest-284360659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-7b79490b-c9e5-4218-b8df-cabfb040cf7d 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:33:43 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-03e1d1ee-6202-4776-919f-1e6fc14ed9d6 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab43a730-5ee7-4381-a8a3-6df94d17af0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6d71831-ad84-45b3-a813-c2017dedf2c7', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:43 devstack sudo[104803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-7b79490b-c9e5-4218-b8df-cabfb040cf7d 1073741824 Jul 22 03:33:43 devstack sudo[104803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:33:43 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-03e1d1ee-6202-4776-919f-1e6fc14ed9d6 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efc6da65-dcbb-4da9-99de-540b83f5e1ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:43 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-03e1d1ee-6202-4776-919f-1e6fc14ed9d6 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Volume volume-a6d71831-ad84-45b3-a813-c2017dedf2c7 (a6d71831-ad84-45b3-a813-c2017dedf2c7): created successfully Jul 22 03:33:43 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-03e1d1ee-6202-4776-919f-1e6fc14ed9d6 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efc6da65-dcbb-4da9-99de-540b83f5e1ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:43 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-03e1d1ee-6202-4776-919f-1e6fc14ed9d6 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Flow 'volume_create_manager' (2fb0beab-08ff-4d86-bbfd-8a77472938b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:33:43 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-03e1d1ee-6202-4776-919f-1e6fc14ed9d6 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Created volume successfully. Jul 22 03:33:44 devstack sudo[104803]: pam_unix(sudo:session): session closed for user root Jul 22 03:33:44 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f14650ff-33d5-42f5-9d3b-fc21d6e06c92 tempest-CreateVolumesFromImageTest-284360659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-7b79490b-c9e5-4218-b8df-cabfb040cf7d 1073741824" returned: 0 in 0.456s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:33:44 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f14650ff-33d5-42f5-9d3b-fc21d6e06c92 tempest-CreateVolumesFromImageTest-284360659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-7b79490b-c9e5-4218-b8df-cabfb040cf7d {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:33:44 devstack sudo[104809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-7b79490b-c9e5-4218-b8df-cabfb040cf7d Jul 22 03:33:44 devstack sudo[104809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:33:44 devstack sudo[104809]: pam_unix(sudo:session): session closed for user root Jul 22 03:33:44 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f14650ff-33d5-42f5-9d3b-fc21d6e06c92 tempest-CreateVolumesFromImageTest-284360659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-7b79490b-c9e5-4218-b8df-cabfb040cf7d" returned: 0 in 0.287s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:33:44 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-f14650ff-33d5-42f5-9d3b-fc21d6e06c92 tempest-CreateVolumesFromImageTest-284360659 None] <== create_volume: return (787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:33:44 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-f14650ff-33d5-42f5-9d3b-fc21d6e06c92 tempest-CreateVolumesFromImageTest-284360659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.790s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:33:44 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-01fe89ab-e1e7-4765-aece-143c9110cc43 tempest-CreateVolumesFromSnapshotTest-653456616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.093s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:33:44 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-01fe89ab-e1e7-4765-aece-143c9110cc43 tempest-CreateVolumesFromSnapshotTest-653456616 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:33:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2008427010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=942e7752-6415-40b2-aaae-fcb41088682f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6833c4588e2148bebce14bdee1aa2f26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:33:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:33:42Z,use_quota=True,user_id='e17b7acea4db4ed389586494aaaa7915',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:33:44 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-01fe89ab-e1e7-4765-aece-143c9110cc43 tempest-CreateVolumesFromSnapshotTest-653456616 None] Creating volume 942e7752-6415-40b2-aaae-fcb41088682f {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:33:44 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-01fe89ab-e1e7-4765-aece-143c9110cc43 tempest-CreateVolumesFromSnapshotTest-653456616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:33:44 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-01fe89ab-e1e7-4765-aece-143c9110cc43 tempest-CreateVolumesFromSnapshotTest-653456616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:33:44 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-01fe89ab-e1e7-4765-aece-143c9110cc43 tempest-CreateVolumesFromSnapshotTest-653456616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:33:44 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-01fe89ab-e1e7-4765-aece-143c9110cc43 tempest-CreateVolumesFromSnapshotTest-653456616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:33:44 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-01fe89ab-e1e7-4765-aece-143c9110cc43 tempest-CreateVolumesFromSnapshotTest-653456616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:33:44 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-01fe89ab-e1e7-4765-aece-143c9110cc43 tempest-CreateVolumesFromSnapshotTest-653456616 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:33:44 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-01fe89ab-e1e7-4765-aece-143c9110cc43 tempest-CreateVolumesFromSnapshotTest-653456616 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:33:44 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-01fe89ab-e1e7-4765-aece-143c9110cc43 tempest-CreateVolumesFromSnapshotTest-653456616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-942e7752-6415-40b2-aaae-fcb41088682f 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:33:44 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f14650ff-33d5-42f5-9d3b-fc21d6e06c92 tempest-CreateVolumesFromImageTest-284360659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7c77a49-f08d-4f00-9704-33f616738b81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b79490b-c9e5-4218-b8df-cabfb040cf7d', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:44 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f14650ff-33d5-42f5-9d3b-fc21d6e06c92 tempest-CreateVolumesFromImageTest-284360659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdd4607d-dc8c-4b81-97db-6b7f62766bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:44 devstack sudo[104812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-942e7752-6415-40b2-aaae-fcb41088682f 1073741824 Jul 22 03:33:44 devstack sudo[104812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:33:44 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-f14650ff-33d5-42f5-9d3b-fc21d6e06c92 tempest-CreateVolumesFromImageTest-284360659 None] Volume volume-7b79490b-c9e5-4218-b8df-cabfb040cf7d (7b79490b-c9e5-4218-b8df-cabfb040cf7d): created successfully Jul 22 03:33:44 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f14650ff-33d5-42f5-9d3b-fc21d6e06c92 tempest-CreateVolumesFromImageTest-284360659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdd4607d-dc8c-4b81-97db-6b7f62766bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:44 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f14650ff-33d5-42f5-9d3b-fc21d6e06c92 tempest-CreateVolumesFromImageTest-284360659 None] Flow 'volume_create_manager' (6131095d-f3c2-4739-af9c-3375cbe9254b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:33:44 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-f14650ff-33d5-42f5-9d3b-fc21d6e06c92 tempest-CreateVolumesFromImageTest-284360659 None] Created volume successfully. Jul 22 03:33:44 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2ba1772-ac22-4351-a1d9-160241a885f1 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:33:44 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-a2ba1772-ac22-4351-a1d9-160241a885f1 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Flow 'volume_create_manager' (12e0b72a-43b4-49b4-8678-c2c233e3aeef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:33:44 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-a2ba1772-ac22-4351-a1d9-160241a885f1 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54eb553a-0499-4884-8f3b-b59d88491568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:44 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-a2ba1772-ac22-4351-a1d9-160241a885f1 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54eb553a-0499-4884-8f3b-b59d88491568) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:33:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-775893767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d76001a-dc81-4d48-bd7c-d878406c1632,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='859b16a72cbe43ef9fe7635d919c6982',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:33:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:33:45Z,use_quota=True,user_id='bb2594bec8ab4b78917d3a8228203573',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:44 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-a2ba1772-ac22-4351-a1d9-160241a885f1 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c6196ac-3d76-4452-8a94-87d0a51349be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:44 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-a2ba1772-ac22-4351-a1d9-160241a885f1 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c6196ac-3d76-4452-8a94-87d0a51349be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:44 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-a2ba1772-ac22-4351-a1d9-160241a885f1 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (181268a1-ac53-49e5-b812-3603ae9ef3d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:44 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-a2ba1772-ac22-4351-a1d9-160241a885f1 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (181268a1-ac53-49e5-b812-3603ae9ef3d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d76001a-dc81-4d48-bd7c-d878406c1632', 'volume_name': 'volume-0d76001a-dc81-4d48-bd7c-d878406c1632', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:44 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-a2ba1772-ac22-4351-a1d9-160241a885f1 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93eb0190-c9ec-46e2-9d3d-55e4b3a96b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:44 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-a2ba1772-ac22-4351-a1d9-160241a885f1 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93eb0190-c9ec-46e2-9d3d-55e4b3a96b27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:44 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-a2ba1772-ac22-4351-a1d9-160241a885f1 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0468869d-a5f2-4083-917e-a21d3dcf5c7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:44 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-a2ba1772-ac22-4351-a1d9-160241a885f1 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Volume 0d76001a-dc81-4d48-bd7c-d878406c1632: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d76001a-dc81-4d48-bd7c-d878406c1632', 'volume_size': 1} Jul 22 03:33:44 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-a2ba1772-ac22-4351-a1d9-160241a885f1 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:33:45 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-a34f7de9-9b70-4d68-8e3a-1c540dd031f5 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:33:45 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-a34f7de9-9b70-4d68-8e3a-1c540dd031f5 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Flow 'volume_create_manager' (139a0606-9ff1-4adc-a9af-5b48d36c59c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:33:45 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-a34f7de9-9b70-4d68-8e3a-1c540dd031f5 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9a4b264-b121-4618-8b2d-03d1a14b1ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:45 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-a34f7de9-9b70-4d68-8e3a-1c540dd031f5 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9a4b264-b121-4618-8b2d-03d1a14b1ef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:33:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1473134038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c190d4a5-36b1-499c-8dac-47d7fee50d58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='859b16a72cbe43ef9fe7635d919c6982',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:33:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:33:45Z,use_quota=True,user_id='bb2594bec8ab4b78917d3a8228203573',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:45 devstack sudo[104812]: pam_unix(sudo:session): session closed for user root Jul 22 03:33:45 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-a34f7de9-9b70-4d68-8e3a-1c540dd031f5 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65195467-7b6d-4e70-b6c1-2c2916c04ccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:45 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-a34f7de9-9b70-4d68-8e3a-1c540dd031f5 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65195467-7b6d-4e70-b6c1-2c2916c04ccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:45 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-a34f7de9-9b70-4d68-8e3a-1c540dd031f5 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (541d2d14-80c5-45ab-bc0d-9087459103df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:45 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-a34f7de9-9b70-4d68-8e3a-1c540dd031f5 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (541d2d14-80c5-45ab-bc0d-9087459103df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c190d4a5-36b1-499c-8dac-47d7fee50d58', 'volume_name': 'volume-c190d4a5-36b1-499c-8dac-47d7fee50d58', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:45 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-a34f7de9-9b70-4d68-8e3a-1c540dd031f5 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (091e1142-0a42-410d-8f9c-bc8ffcd60d7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:45 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-a34f7de9-9b70-4d68-8e3a-1c540dd031f5 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (091e1142-0a42-410d-8f9c-bc8ffcd60d7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:45 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-a34f7de9-9b70-4d68-8e3a-1c540dd031f5 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0eacc93a-6783-44df-b1c5-7d6d77c80709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:45 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-a34f7de9-9b70-4d68-8e3a-1c540dd031f5 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Volume c190d4a5-36b1-499c-8dac-47d7fee50d58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c190d4a5-36b1-499c-8dac-47d7fee50d58', 'volume_size': 1} Jul 22 03:33:45 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-a34f7de9-9b70-4d68-8e3a-1c540dd031f5 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:33:45 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-01fe89ab-e1e7-4765-aece-143c9110cc43 tempest-CreateVolumesFromSnapshotTest-653456616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-942e7752-6415-40b2-aaae-fcb41088682f 1073741824" returned: 0 in 0.647s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:33:45 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-01fe89ab-e1e7-4765-aece-143c9110cc43 tempest-CreateVolumesFromSnapshotTest-653456616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-942e7752-6415-40b2-aaae-fcb41088682f {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:33:45 devstack sudo[104817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-942e7752-6415-40b2-aaae-fcb41088682f Jul 22 03:33:45 devstack sudo[104817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:33:45 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d3e3dc9-9fd5-4847-83b5-f77a8cd78ff4 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:33:45 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-6d3e3dc9-9fd5-4847-83b5-f77a8cd78ff4 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Flow 'volume_create_manager' (dc69b163-6c23-4a1d-8da5-2d104d6fbeae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:33:45 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-6d3e3dc9-9fd5-4847-83b5-f77a8cd78ff4 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7677b176-2ef1-42d9-9623-f1c058a81110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:45 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-6d3e3dc9-9fd5-4847-83b5-f77a8cd78ff4 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7677b176-2ef1-42d9-9623-f1c058a81110) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:33:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1756759857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7865afb3-06ef-41e9-8526-82b52e9bd765,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='859b16a72cbe43ef9fe7635d919c6982',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:33:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:33:45Z,use_quota=True,user_id='bb2594bec8ab4b78917d3a8228203573',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:45 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-6d3e3dc9-9fd5-4847-83b5-f77a8cd78ff4 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffa0ce90-b35c-4e21-8c5b-fb814fc41fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:45 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-6d3e3dc9-9fd5-4847-83b5-f77a8cd78ff4 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffa0ce90-b35c-4e21-8c5b-fb814fc41fd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:45 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-6d3e3dc9-9fd5-4847-83b5-f77a8cd78ff4 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd071d5d-a00f-4a05-bad4-14ba1754dbe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:45 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-6d3e3dc9-9fd5-4847-83b5-f77a8cd78ff4 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd071d5d-a00f-4a05-bad4-14ba1754dbe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7865afb3-06ef-41e9-8526-82b52e9bd765', 'volume_name': 'volume-7865afb3-06ef-41e9-8526-82b52e9bd765', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:45 devstack sudo[104817]: pam_unix(sudo:session): session closed for user root Jul 22 03:33:45 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-6d3e3dc9-9fd5-4847-83b5-f77a8cd78ff4 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c54bd63c-c907-474b-ad75-aa395881a8a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:45 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-6d3e3dc9-9fd5-4847-83b5-f77a8cd78ff4 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c54bd63c-c907-474b-ad75-aa395881a8a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:45 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-6d3e3dc9-9fd5-4847-83b5-f77a8cd78ff4 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2b762e9-f526-48c7-aaba-efb6504d0fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:45 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-6d3e3dc9-9fd5-4847-83b5-f77a8cd78ff4 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Volume 7865afb3-06ef-41e9-8526-82b52e9bd765: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7865afb3-06ef-41e9-8526-82b52e9bd765', 'volume_size': 1} Jul 22 03:33:45 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-6d3e3dc9-9fd5-4847-83b5-f77a8cd78ff4 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:33:45 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-01fe89ab-e1e7-4765-aece-143c9110cc43 tempest-CreateVolumesFromSnapshotTest-653456616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-942e7752-6415-40b2-aaae-fcb41088682f" returned: 0 in 0.408s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:33:45 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-01fe89ab-e1e7-4765-aece-143c9110cc43 tempest-CreateVolumesFromSnapshotTest-653456616 None] <== create_volume: return (1111ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:33:45 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-01fe89ab-e1e7-4765-aece-143c9110cc43 tempest-CreateVolumesFromSnapshotTest-653456616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.113s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:33:45 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-9e68cfdf-3085-4637-8d9c-4f8931ef2402 tempest-CreateVolumesFromImageTest-284360659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.872s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:33:45 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-9e68cfdf-3085-4637-8d9c-4f8931ef2402 tempest-CreateVolumesFromImageTest-284360659 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:33:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2145587497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55287bd0-d888-474e-bff1-0183ce0ada02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1291a90e3830447199bbf52100066e7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:33:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:33:43Z,use_quota=True,user_id='7cb0032b759943cab42bc0e2aa5dd378',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:33:45 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-9e68cfdf-3085-4637-8d9c-4f8931ef2402 tempest-CreateVolumesFromImageTest-284360659 None] Creating volume 55287bd0-d888-474e-bff1-0183ce0ada02 {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:33:45 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-9e68cfdf-3085-4637-8d9c-4f8931ef2402 tempest-CreateVolumesFromImageTest-284360659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:33:45 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-9e68cfdf-3085-4637-8d9c-4f8931ef2402 tempest-CreateVolumesFromImageTest-284360659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:33:45 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-9e68cfdf-3085-4637-8d9c-4f8931ef2402 tempest-CreateVolumesFromImageTest-284360659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:33:45 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-9e68cfdf-3085-4637-8d9c-4f8931ef2402 tempest-CreateVolumesFromImageTest-284360659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:33:45 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-9e68cfdf-3085-4637-8d9c-4f8931ef2402 tempest-CreateVolumesFromImageTest-284360659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:33:45 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-9e68cfdf-3085-4637-8d9c-4f8931ef2402 tempest-CreateVolumesFromImageTest-284360659 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:33:45 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-9e68cfdf-3085-4637-8d9c-4f8931ef2402 tempest-CreateVolumesFromImageTest-284360659 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:33:45 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-9e68cfdf-3085-4637-8d9c-4f8931ef2402 tempest-CreateVolumesFromImageTest-284360659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-55287bd0-d888-474e-bff1-0183ce0ada02 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:33:45 devstack sudo[104826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-55287bd0-d888-474e-bff1-0183ce0ada02 1073741824 Jul 22 03:33:45 devstack sudo[104826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:33:45 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-01fe89ab-e1e7-4765-aece-143c9110cc43 tempest-CreateVolumesFromSnapshotTest-653456616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e39c29c7-e3bf-4aab-aada-bdff8282c076) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-942e7752-6415-40b2-aaae-fcb41088682f', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:45 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-01fe89ab-e1e7-4765-aece-143c9110cc43 tempest-CreateVolumesFromSnapshotTest-653456616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faafffde-1c08-423b-9ea1-63095a116e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:45 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-01fe89ab-e1e7-4765-aece-143c9110cc43 tempest-CreateVolumesFromSnapshotTest-653456616 None] Volume volume-942e7752-6415-40b2-aaae-fcb41088682f (942e7752-6415-40b2-aaae-fcb41088682f): created successfully Jul 22 03:33:45 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-01fe89ab-e1e7-4765-aece-143c9110cc43 tempest-CreateVolumesFromSnapshotTest-653456616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faafffde-1c08-423b-9ea1-63095a116e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:45 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-01fe89ab-e1e7-4765-aece-143c9110cc43 tempest-CreateVolumesFromSnapshotTest-653456616 None] Flow 'volume_create_manager' (f7950111-472f-4944-9e41-b5c58b60be47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:33:45 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-01fe89ab-e1e7-4765-aece-143c9110cc43 tempest-CreateVolumesFromSnapshotTest-653456616 None] Created volume successfully. Jul 22 03:33:46 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-301ad809-f1a2-41db-8859-ca70ebeea963 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:33:46 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-301ad809-f1a2-41db-8859-ca70ebeea963 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Flow 'volume_create_manager' (f120f703-a0ec-453c-a7cc-9dc5ce4b599c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:33:46 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-301ad809-f1a2-41db-8859-ca70ebeea963 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3efc53a-f41c-4859-821a-244ddb6aa62c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:46 devstack sudo[104826]: pam_unix(sudo:session): session closed for user root Jul 22 03:33:46 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-9e68cfdf-3085-4637-8d9c-4f8931ef2402 tempest-CreateVolumesFromImageTest-284360659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-55287bd0-d888-474e-bff1-0183ce0ada02 1073741824" returned: 0 in 0.595s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:33:46 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-301ad809-f1a2-41db-8859-ca70ebeea963 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3efc53a-f41c-4859-821a-244ddb6aa62c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:33:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-837523899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9963fd8c-47f5-4cf9-a64d-526cc23297c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='859b16a72cbe43ef9fe7635d919c6982',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:33:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:33:46Z,use_quota=True,user_id='bb2594bec8ab4b78917d3a8228203573',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:46 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-301ad809-f1a2-41db-8859-ca70ebeea963 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (542ddbfd-0a88-43f3-b8cb-f3b10b2750ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:46 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-301ad809-f1a2-41db-8859-ca70ebeea963 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (542ddbfd-0a88-43f3-b8cb-f3b10b2750ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:46 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-301ad809-f1a2-41db-8859-ca70ebeea963 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ee7ed26-4c3d-46de-9ca5-adf44f1c8b5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:46 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-301ad809-f1a2-41db-8859-ca70ebeea963 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ee7ed26-4c3d-46de-9ca5-adf44f1c8b5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9963fd8c-47f5-4cf9-a64d-526cc23297c1', 'volume_name': 'volume-9963fd8c-47f5-4cf9-a64d-526cc23297c1', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:46 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-301ad809-f1a2-41db-8859-ca70ebeea963 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8b84547-b811-4078-a259-4465d3b4889a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:46 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-301ad809-f1a2-41db-8859-ca70ebeea963 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8b84547-b811-4078-a259-4465d3b4889a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:46 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-301ad809-f1a2-41db-8859-ca70ebeea963 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f7d1f42-028d-4113-8e52-b92976c0cd8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:46 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-301ad809-f1a2-41db-8859-ca70ebeea963 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Volume 9963fd8c-47f5-4cf9-a64d-526cc23297c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9963fd8c-47f5-4cf9-a64d-526cc23297c1', 'volume_size': 1} Jul 22 03:33:46 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-301ad809-f1a2-41db-8859-ca70ebeea963 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:33:46 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-9e68cfdf-3085-4637-8d9c-4f8931ef2402 tempest-CreateVolumesFromImageTest-284360659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-55287bd0-d888-474e-bff1-0183ce0ada02 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:33:46 devstack sudo[104833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-55287bd0-d888-474e-bff1-0183ce0ada02 Jul 22 03:33:46 devstack sudo[104833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:33:46 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-c99a302d-6f25-4240-a46d-20fb403c070d tempest-VolumeAndVolumeTypeFromImageTest-2121925634 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:33:46 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-c99a302d-6f25-4240-a46d-20fb403c070d tempest-VolumeAndVolumeTypeFromImageTest-2121925634 None] Flow 'volume_create_manager' (33f956b3-5b51-4466-aaee-ad65627b12af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:33:46 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-c99a302d-6f25-4240-a46d-20fb403c070d tempest-VolumeAndVolumeTypeFromImageTest-2121925634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (398e5f03-c6c3-42c4-80f4-17dce4e7b4bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:46 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-c99a302d-6f25-4240-a46d-20fb403c070d tempest-VolumeAndVolumeTypeFromImageTest-2121925634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (398e5f03-c6c3-42c4-80f4-17dce4e7b4bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:33:46Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2546cf0-d274-4f16-95ed-641920edaed1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39d2d667a24048fe82d4af5857880b1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:33:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:33:46Z,use_quota=True,user_id='5daee779883841d9895756a24e625de9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(86d006c0-8f87-49f7-8fab-08e76d49dec6),volume_type_id=86d006c0-8f87-49f7-8fab-08e76d49dec6)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:46 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-c99a302d-6f25-4240-a46d-20fb403c070d tempest-VolumeAndVolumeTypeFromImageTest-2121925634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31127689-8c19-454b-9966-94e2bb49e61a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:46 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-c99a302d-6f25-4240-a46d-20fb403c070d tempest-VolumeAndVolumeTypeFromImageTest-2121925634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31127689-8c19-454b-9966-94e2bb49e61a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:46 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-c99a302d-6f25-4240-a46d-20fb403c070d tempest-VolumeAndVolumeTypeFromImageTest-2121925634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1679a938-6546-461d-8a0e-7004f4bdb14f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:46 devstack cinder-volume[87747]: DEBUG cinder.image.glance [None req-c99a302d-6f25-4240-a46d-20fb403c070d tempest-VolumeAndVolumeTypeFromImageTest-2121925634 None] Creating Keystone auth plugin from conf {{(pid=87747) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 22 03:33:46 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd6bc853-f941-4f4c-b7fe-7c2b1a8691e5 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:33:46 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-cd6bc853-f941-4f4c-b7fe-7c2b1a8691e5 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Flow 'volume_create_manager' (6ac28523-666a-4377-a05f-cb8d4403046e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:33:46 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-cd6bc853-f941-4f4c-b7fe-7c2b1a8691e5 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e29aa9d5-e8c2-4704-b0cb-341a610fd07e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:46 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-cd6bc853-f941-4f4c-b7fe-7c2b1a8691e5 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e29aa9d5-e8c2-4704-b0cb-341a610fd07e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:33:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-216005422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48ce7741-b169-4cb2-8946-89307bb6aece,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='859b16a72cbe43ef9fe7635d919c6982',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:33:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:33:46Z,use_quota=True,user_id='bb2594bec8ab4b78917d3a8228203573',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:46 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-cd6bc853-f941-4f4c-b7fe-7c2b1a8691e5 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2516ff59-86fd-4ebd-8ce6-58a17b41f3c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:46 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-cd6bc853-f941-4f4c-b7fe-7c2b1a8691e5 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2516ff59-86fd-4ebd-8ce6-58a17b41f3c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:46 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-cd6bc853-f941-4f4c-b7fe-7c2b1a8691e5 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32b6ff9f-b46d-44e4-b9dd-cfefa98c10b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:46 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-cd6bc853-f941-4f4c-b7fe-7c2b1a8691e5 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32b6ff9f-b46d-44e4-b9dd-cfefa98c10b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48ce7741-b169-4cb2-8946-89307bb6aece', 'volume_name': 'volume-48ce7741-b169-4cb2-8946-89307bb6aece', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:46 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-cd6bc853-f941-4f4c-b7fe-7c2b1a8691e5 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9320046-1454-4e83-a568-d7c124e74376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:46 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-cd6bc853-f941-4f4c-b7fe-7c2b1a8691e5 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9320046-1454-4e83-a568-d7c124e74376) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:46 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-cd6bc853-f941-4f4c-b7fe-7c2b1a8691e5 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e17805bb-2c05-41ce-8587-080fe2195cfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:46 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-cd6bc853-f941-4f4c-b7fe-7c2b1a8691e5 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Volume 48ce7741-b169-4cb2-8946-89307bb6aece: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48ce7741-b169-4cb2-8946-89307bb6aece', 'volume_size': 1} Jul 22 03:33:46 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-cd6bc853-f941-4f4c-b7fe-7c2b1a8691e5 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:33:46 devstack sudo[104833]: pam_unix(sudo:session): session closed for user root Jul 22 03:33:46 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-9e68cfdf-3085-4637-8d9c-4f8931ef2402 tempest-CreateVolumesFromImageTest-284360659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-55287bd0-d888-474e-bff1-0183ce0ada02" returned: 0 in 0.277s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:33:46 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-9e68cfdf-3085-4637-8d9c-4f8931ef2402 tempest-CreateVolumesFromImageTest-284360659 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:33:46 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-9e68cfdf-3085-4637-8d9c-4f8931ef2402 tempest-CreateVolumesFromImageTest-284360659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:33:46 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-8c82587f-d16f-4c68-818e-e3abde1e3eca tempest-CreateVolumesFromImageTest-284360659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.335s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:33:46 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-8c82587f-d16f-4c68-818e-e3abde1e3eca tempest-CreateVolumesFromImageTest-284360659 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:33:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2027067256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98e26f32-6fcb-49b1-a7a1-223d8931ca91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1291a90e3830447199bbf52100066e7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:33:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:33:43Z,use_quota=True,user_id='7cb0032b759943cab42bc0e2aa5dd378',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:33:46 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-8c82587f-d16f-4c68-818e-e3abde1e3eca tempest-CreateVolumesFromImageTest-284360659 None] Creating volume 98e26f32-6fcb-49b1-a7a1-223d8931ca91 {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:33:46 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-8c82587f-d16f-4c68-818e-e3abde1e3eca tempest-CreateVolumesFromImageTest-284360659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:33:46 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-8c82587f-d16f-4c68-818e-e3abde1e3eca tempest-CreateVolumesFromImageTest-284360659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:33:46 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-8c82587f-d16f-4c68-818e-e3abde1e3eca tempest-CreateVolumesFromImageTest-284360659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:33:46 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-8c82587f-d16f-4c68-818e-e3abde1e3eca tempest-CreateVolumesFromImageTest-284360659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:33:46 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-8c82587f-d16f-4c68-818e-e3abde1e3eca tempest-CreateVolumesFromImageTest-284360659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:33:46 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-8c82587f-d16f-4c68-818e-e3abde1e3eca tempest-CreateVolumesFromImageTest-284360659 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:33:46 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-8c82587f-d16f-4c68-818e-e3abde1e3eca tempest-CreateVolumesFromImageTest-284360659 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:33:46 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-8c82587f-d16f-4c68-818e-e3abde1e3eca tempest-CreateVolumesFromImageTest-284360659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-98e26f32-6fcb-49b1-a7a1-223d8931ca91 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:33:46 devstack sudo[104836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-98e26f32-6fcb-49b1-a7a1-223d8931ca91 1073741824 Jul 22 03:33:46 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-9e68cfdf-3085-4637-8d9c-4f8931ef2402 tempest-CreateVolumesFromImageTest-284360659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (940f74ea-f435-4980-8cdc-154563461fa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55287bd0-d888-474e-bff1-0183ce0ada02', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:46 devstack sudo[104836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:33:46 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-9e68cfdf-3085-4637-8d9c-4f8931ef2402 tempest-CreateVolumesFromImageTest-284360659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb07b4e3-66f0-4a70-a8bf-e246560edfb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:46 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-9e68cfdf-3085-4637-8d9c-4f8931ef2402 tempest-CreateVolumesFromImageTest-284360659 None] Volume volume-55287bd0-d888-474e-bff1-0183ce0ada02 (55287bd0-d888-474e-bff1-0183ce0ada02): created successfully Jul 22 03:33:46 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-9e68cfdf-3085-4637-8d9c-4f8931ef2402 tempest-CreateVolumesFromImageTest-284360659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb07b4e3-66f0-4a70-a8bf-e246560edfb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:46 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-9e68cfdf-3085-4637-8d9c-4f8931ef2402 tempest-CreateVolumesFromImageTest-284360659 None] Flow 'volume_create_manager' (4063daf3-6200-4e70-be6a-53be9b86eec8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:33:46 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-9e68cfdf-3085-4637-8d9c-4f8931ef2402 tempest-CreateVolumesFromImageTest-284360659 None] Created volume successfully. Jul 22 03:33:46 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-c99a302d-6f25-4240-a46d-20fb403c070d tempest-VolumeAndVolumeTypeFromImageTest-2121925634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1679a938-6546-461d-8a0e-7004f4bdb14f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd2546cf0-d274-4f16-95ed-641920edaed1', 'volume_name': 'volume-d2546cf0-d274-4f16-95ed-641920edaed1', 'volume_size': 1, 'image_id': '01288d01-5efe-42bd-84e1-f31bf79afefa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/01288d01-5efe-42bd-84e1-f31bf79afefa', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'efe7aff9794f9ffd32e8305003467d9c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '39d2d667a24048fe82d4af5857880b1c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '88ef9696b38e2aedbaf9db6474abc9c3aac39600d43c8e86a6082ecec9924ccb301670e3391fad2330bad0944aa4d22c2eb7e56b73e5005b001197e11c2faa7e', 'id': '01288d01-5efe-42bd-84e1-f31bf79afefa', 'created_at': datetime.datetime(2026, 7, 22, 1, 33, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 22, 1, 33, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/01288d01-5efe-42bd-84e1-f31bf79afefa/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:46 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-c99a302d-6f25-4240-a46d-20fb403c070d tempest-VolumeAndVolumeTypeFromImageTest-2121925634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24a4d547-4ccc-4bc9-9df7-57410c1bb24d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:46 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-c99a302d-6f25-4240-a46d-20fb403c070d tempest-VolumeAndVolumeTypeFromImageTest-2121925634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24a4d547-4ccc-4bc9-9df7-57410c1bb24d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:46 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-c99a302d-6f25-4240-a46d-20fb403c070d tempest-VolumeAndVolumeTypeFromImageTest-2121925634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4d57d24-6244-4d79-974a-71eb7696ce54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:46 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-c99a302d-6f25-4240-a46d-20fb403c070d tempest-VolumeAndVolumeTypeFromImageTest-2121925634 None] Volume d2546cf0-d274-4f16-95ed-641920edaed1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d2546cf0-d274-4f16-95ed-641920edaed1', 'volume_size': 1, 'image_id': '01288d01-5efe-42bd-84e1-f31bf79afefa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/01288d01-5efe-42bd-84e1-f31bf79afefa', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'efe7aff9794f9ffd32e8305003467d9c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '39d2d667a24048fe82d4af5857880b1c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '88ef9696b38e2aedbaf9db6474abc9c3aac39600d43c8e86a6082ecec9924ccb301670e3391fad2330bad0944aa4d22c2eb7e56b73e5005b001197e11c2faa7e', 'id': '01288d01-5efe-42bd-84e1-f31bf79afefa', 'created_at': datetime.datetime(2026, 7, 22, 1, 33, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 22, 1, 33, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/01288d01-5efe-42bd-84e1-f31bf79afefa/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 22 03:33:46 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-c99a302d-6f25-4240-a46d-20fb403c070d tempest-VolumeAndVolumeTypeFromImageTest-2121925634 None] Trying to clone d2546cf0-d274-4f16-95ed-641920edaed1 from image 01288d01-5efe-42bd-84e1-f31bf79afefa at location (None, [{'url': 'file:///opt/stack/data/glance/images/01288d01-5efe-42bd-84e1-f31bf79afefa', 'metadata': {}}]). {{(pid=87747) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 22 03:33:46 devstack cinder-volume[87747]: DEBUG cinder.image.image_utils [None req-c99a302d-6f25-4240-a46d-20fb403c070d tempest-VolumeAndVolumeTypeFromImageTest-2121925634 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_01288d01-5efe-42bd-84e1-f31bf79afefa_407ql6tpdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87747) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 22 03:33:46 devstack cinder-volume[87747]: INFO cinder.image.image_utils [None req-c99a302d-6f25-4240-a46d-20fb403c070d tempest-VolumeAndVolumeTypeFromImageTest-2121925634 None] Image download 0.00 MB at 0.00 MB/s Jul 22 03:33:46 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba5a76a8-05fd-4015-9f4d-2c8ec1500bb5]: (4, 'raw') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:33:46 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-c99a302d-6f25-4240-a46d-20fb403c070d tempest-VolumeAndVolumeTypeFromImageTest-2121925634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_01288d01-5efe-42bd-84e1-f31bf79afefa_407ql6tpdevstack@QuobyteHD {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:33:47 devstack sudo[104842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_01288d01-5efe-42bd-84e1-f31bf79afefa_407ql6tpdevstack@QuobyteHD Jul 22 03:33:47 devstack sudo[104842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:33:47 devstack sudo[104836]: pam_unix(sudo:session): session closed for user root Jul 22 03:33:47 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-8c82587f-d16f-4c68-818e-e3abde1e3eca tempest-CreateVolumesFromImageTest-284360659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-98e26f32-6fcb-49b1-a7a1-223d8931ca91 1073741824" returned: 0 in 0.541s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:33:47 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-7d3fb7ee-9ba1-4295-b84e-d55ba7edc654 tempest-CreateVolumesFromSnapshotTest-653456616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:33:47 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-8c82587f-d16f-4c68-818e-e3abde1e3eca tempest-CreateVolumesFromImageTest-284360659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-98e26f32-6fcb-49b1-a7a1-223d8931ca91 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:33:47 devstack sudo[104844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-98e26f32-6fcb-49b1-a7a1-223d8931ca91 Jul 22 03:33:47 devstack sudo[104844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:33:47 devstack sudo[104842]: pam_unix(sudo:session): session closed for user root Jul 22 03:33:47 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-c99a302d-6f25-4240-a46d-20fb403c070d tempest-VolumeAndVolumeTypeFromImageTest-2121925634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_01288d01-5efe-42bd-84e1-f31bf79afefa_407ql6tpdevstack@QuobyteHD" returned: 0 in 0.368s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:33:47 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-c99a302d-6f25-4240-a46d-20fb403c070d tempest-VolumeAndVolumeTypeFromImageTest-2121925634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_01288d01-5efe-42bd-84e1-f31bf79afefa_407ql6tpdevstack@QuobyteHD {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:33:47 devstack sudo[104848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_01288d01-5efe-42bd-84e1-f31bf79afefa_407ql6tpdevstack@QuobyteHD Jul 22 03:33:47 devstack sudo[104848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:33:47 devstack sudo[104844]: pam_unix(sudo:session): session closed for user root Jul 22 03:33:47 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-8c82587f-d16f-4c68-818e-e3abde1e3eca tempest-CreateVolumesFromImageTest-284360659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-98e26f32-6fcb-49b1-a7a1-223d8931ca91" returned: 0 in 0.244s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:33:47 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-8c82587f-d16f-4c68-818e-e3abde1e3eca tempest-CreateVolumesFromImageTest-284360659 None] <== create_volume: return (837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:33:47 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-8c82587f-d16f-4c68-818e-e3abde1e3eca tempest-CreateVolumesFromImageTest-284360659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.840s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:33:47 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-8b5a5fe3-b821-4ac6-b671-db1222d43042 tempest-CreateVolumesFromImageTest-284360659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.850s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:33:47 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-8b5a5fe3-b821-4ac6-b671-db1222d43042 tempest-CreateVolumesFromImageTest-284360659 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:33:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1680333515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20354406-0586-44e3-a680-0d1517ca8a60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1291a90e3830447199bbf52100066e7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:33:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:33:43Z,use_quota=True,user_id='7cb0032b759943cab42bc0e2aa5dd378',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:33:47 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-8b5a5fe3-b821-4ac6-b671-db1222d43042 tempest-CreateVolumesFromImageTest-284360659 None] Creating volume 20354406-0586-44e3-a680-0d1517ca8a60 {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:33:47 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-8b5a5fe3-b821-4ac6-b671-db1222d43042 tempest-CreateVolumesFromImageTest-284360659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:33:47 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-8b5a5fe3-b821-4ac6-b671-db1222d43042 tempest-CreateVolumesFromImageTest-284360659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:33:47 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-8b5a5fe3-b821-4ac6-b671-db1222d43042 tempest-CreateVolumesFromImageTest-284360659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:33:47 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-8b5a5fe3-b821-4ac6-b671-db1222d43042 tempest-CreateVolumesFromImageTest-284360659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:33:47 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-8b5a5fe3-b821-4ac6-b671-db1222d43042 tempest-CreateVolumesFromImageTest-284360659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:33:47 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-8b5a5fe3-b821-4ac6-b671-db1222d43042 tempest-CreateVolumesFromImageTest-284360659 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:33:47 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-8b5a5fe3-b821-4ac6-b671-db1222d43042 tempest-CreateVolumesFromImageTest-284360659 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:33:47 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-8b5a5fe3-b821-4ac6-b671-db1222d43042 tempest-CreateVolumesFromImageTest-284360659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-20354406-0586-44e3-a680-0d1517ca8a60 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:33:47 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-8c82587f-d16f-4c68-818e-e3abde1e3eca tempest-CreateVolumesFromImageTest-284360659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8943cafd-0387-4533-a204-901bd188a961) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98e26f32-6fcb-49b1-a7a1-223d8931ca91', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:47 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-8c82587f-d16f-4c68-818e-e3abde1e3eca tempest-CreateVolumesFromImageTest-284360659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfba3a8c-34da-4d76-8504-004b1f2f103c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:47 devstack sudo[104851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-20354406-0586-44e3-a680-0d1517ca8a60 1073741824 Jul 22 03:33:47 devstack sudo[104851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:33:47 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-8c82587f-d16f-4c68-818e-e3abde1e3eca tempest-CreateVolumesFromImageTest-284360659 None] Volume volume-98e26f32-6fcb-49b1-a7a1-223d8931ca91 (98e26f32-6fcb-49b1-a7a1-223d8931ca91): created successfully Jul 22 03:33:47 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-8c82587f-d16f-4c68-818e-e3abde1e3eca tempest-CreateVolumesFromImageTest-284360659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfba3a8c-34da-4d76-8504-004b1f2f103c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:47 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-8c82587f-d16f-4c68-818e-e3abde1e3eca tempest-CreateVolumesFromImageTest-284360659 None] Flow 'volume_create_manager' (7d43f921-f0f6-416e-b8a4-7144d81ce465) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:33:47 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-8c82587f-d16f-4c68-818e-e3abde1e3eca tempest-CreateVolumesFromImageTest-284360659 None] Created volume successfully. Jul 22 03:33:47 devstack sudo[104848]: pam_unix(sudo:session): session closed for user root Jul 22 03:33:47 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-c99a302d-6f25-4240-a46d-20fb403c070d tempest-VolumeAndVolumeTypeFromImageTest-2121925634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_01288d01-5efe-42bd-84e1-f31bf79afefa_407ql6tpdevstack@QuobyteHD" returned: 1 in 0.349s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:33:47 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-c99a302d-6f25-4240-a46d-20fb403c070d tempest-VolumeAndVolumeTypeFromImageTest-2121925634 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_01288d01-5efe-42bd-84e1-f31bf79afefa_407ql6tpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 22 03:33:47 devstack cinder-volume[87747]: DEBUG cinder.image.image_utils [None req-c99a302d-6f25-4240-a46d-20fb403c070d tempest-VolumeAndVolumeTypeFromImageTest-2121925634 None] Temporary image 01288d01-5efe-42bd-84e1-f31bf79afefa is fetched for user 5daee779883841d9895756a24e625de9. {{(pid=87747) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 22 03:33:47 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[18d9af32-dd80-4ea4-b248-ee4b357e7ec5]: (4, 'raw') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:33:47 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-c99a302d-6f25-4240-a46d-20fb403c070d tempest-VolumeAndVolumeTypeFromImageTest-2121925634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_01288d01-5efe-42bd-84e1-f31bf79afefa_407ql6tpdevstack@QuobyteHD {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:33:47 devstack sudo[104859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_01288d01-5efe-42bd-84e1-f31bf79afefa_407ql6tpdevstack@QuobyteHD Jul 22 03:33:47 devstack sudo[104859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:33:47 devstack sudo[104851]: pam_unix(sudo:session): session closed for user root Jul 22 03:33:47 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-8b5a5fe3-b821-4ac6-b671-db1222d43042 tempest-CreateVolumesFromImageTest-284360659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-20354406-0586-44e3-a680-0d1517ca8a60 1073741824" returned: 0 in 0.429s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:33:47 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-8b5a5fe3-b821-4ac6-b671-db1222d43042 tempest-CreateVolumesFromImageTest-284360659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-20354406-0586-44e3-a680-0d1517ca8a60 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:33:47 devstack sudo[104862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-20354406-0586-44e3-a680-0d1517ca8a60 Jul 22 03:33:47 devstack sudo[104862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:33:48 devstack sudo[104859]: pam_unix(sudo:session): session closed for user root Jul 22 03:33:48 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-c99a302d-6f25-4240-a46d-20fb403c070d tempest-VolumeAndVolumeTypeFromImageTest-2121925634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_01288d01-5efe-42bd-84e1-f31bf79afefa_407ql6tpdevstack@QuobyteHD" returned: 0 in 0.359s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:33:48 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-c99a302d-6f25-4240-a46d-20fb403c070d tempest-VolumeAndVolumeTypeFromImageTest-2121925634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_01288d01-5efe-42bd-84e1-f31bf79afefa_407ql6tpdevstack@QuobyteHD {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:33:48 devstack sudo[104862]: pam_unix(sudo:session): session closed for user root Jul 22 03:33:48 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-8b5a5fe3-b821-4ac6-b671-db1222d43042 tempest-CreateVolumesFromImageTest-284360659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-20354406-0586-44e3-a680-0d1517ca8a60" returned: 0 in 0.250s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:33:48 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-8b5a5fe3-b821-4ac6-b671-db1222d43042 tempest-CreateVolumesFromImageTest-284360659 None] <== create_volume: return (722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:33:48 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-8b5a5fe3-b821-4ac6-b671-db1222d43042 tempest-CreateVolumesFromImageTest-284360659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.729s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:33:48 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-a2ba1772-ac22-4351-a1d9-160241a885f1 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.422s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:33:48 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-a2ba1772-ac22-4351-a1d9-160241a885f1 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:33:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-775893767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d76001a-dc81-4d48-bd7c-d878406c1632,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='859b16a72cbe43ef9fe7635d919c6982',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:33:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:33:45Z,use_quota=True,user_id='bb2594bec8ab4b78917d3a8228203573',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:33:48 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-a2ba1772-ac22-4351-a1d9-160241a885f1 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Creating volume 0d76001a-dc81-4d48-bd7c-d878406c1632 {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:33:48 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-a2ba1772-ac22-4351-a1d9-160241a885f1 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:33:48 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-a2ba1772-ac22-4351-a1d9-160241a885f1 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:33:48 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-a2ba1772-ac22-4351-a1d9-160241a885f1 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:33:48 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-a2ba1772-ac22-4351-a1d9-160241a885f1 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:33:48 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-a2ba1772-ac22-4351-a1d9-160241a885f1 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:33:48 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-a2ba1772-ac22-4351-a1d9-160241a885f1 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:33:48 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-a2ba1772-ac22-4351-a1d9-160241a885f1 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:33:48 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-a2ba1772-ac22-4351-a1d9-160241a885f1 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0d76001a-dc81-4d48-bd7c-d878406c1632 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:33:48 devstack sudo[104866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_01288d01-5efe-42bd-84e1-f31bf79afefa_407ql6tpdevstack@QuobyteHD Jul 22 03:33:48 devstack sudo[104866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:33:48 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-8b5a5fe3-b821-4ac6-b671-db1222d43042 tempest-CreateVolumesFromImageTest-284360659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22784564-f6f9-4854-9a35-6dd37e288691) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20354406-0586-44e3-a680-0d1517ca8a60', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:48 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-8b5a5fe3-b821-4ac6-b671-db1222d43042 tempest-CreateVolumesFromImageTest-284360659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c80a050-6c7d-4ea6-a59c-1d2ac722cd3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:48 devstack sudo[104869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0d76001a-dc81-4d48-bd7c-d878406c1632 1073741824 Jul 22 03:33:48 devstack sudo[104869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:33:48 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-8b5a5fe3-b821-4ac6-b671-db1222d43042 tempest-CreateVolumesFromImageTest-284360659 None] Volume volume-20354406-0586-44e3-a680-0d1517ca8a60 (20354406-0586-44e3-a680-0d1517ca8a60): created successfully Jul 22 03:33:48 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-8b5a5fe3-b821-4ac6-b671-db1222d43042 tempest-CreateVolumesFromImageTest-284360659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c80a050-6c7d-4ea6-a59c-1d2ac722cd3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:48 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-8b5a5fe3-b821-4ac6-b671-db1222d43042 tempest-CreateVolumesFromImageTest-284360659 None] Flow 'volume_create_manager' (4e104d59-cfe0-47aa-9ef7-b88045da821a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:33:48 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-8b5a5fe3-b821-4ac6-b671-db1222d43042 tempest-CreateVolumesFromImageTest-284360659 None] Created volume successfully. Jul 22 03:33:48 devstack sudo[104866]: pam_unix(sudo:session): session closed for user root Jul 22 03:33:48 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-c99a302d-6f25-4240-a46d-20fb403c070d tempest-VolumeAndVolumeTypeFromImageTest-2121925634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_01288d01-5efe-42bd-84e1-f31bf79afefa_407ql6tpdevstack@QuobyteHD" returned: 1 in 0.355s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:33:48 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-c99a302d-6f25-4240-a46d-20fb403c070d tempest-VolumeAndVolumeTypeFromImageTest-2121925634 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_01288d01-5efe-42bd-84e1-f31bf79afefa_407ql6tpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 22 03:33:48 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-c99a302d-6f25-4240-a46d-20fb403c070d tempest-VolumeAndVolumeTypeFromImageTest-2121925634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:33:48 devstack sudo[104869]: pam_unix(sudo:session): session closed for user root Jul 22 03:33:48 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-a2ba1772-ac22-4351-a1d9-160241a885f1 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0d76001a-dc81-4d48-bd7c-d878406c1632 1073741824" returned: 0 in 0.418s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:33:48 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-a2ba1772-ac22-4351-a1d9-160241a885f1 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0d76001a-dc81-4d48-bd7c-d878406c1632 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:33:48 devstack sudo[104878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0d76001a-dc81-4d48-bd7c-d878406c1632 Jul 22 03:33:48 devstack sudo[104878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:33:48 devstack sudo[104878]: pam_unix(sudo:session): session closed for user root Jul 22 03:33:48 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-a2ba1772-ac22-4351-a1d9-160241a885f1 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0d76001a-dc81-4d48-bd7c-d878406c1632" returned: 0 in 0.250s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:33:48 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-a2ba1772-ac22-4351-a1d9-160241a885f1 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] <== create_volume: return (717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:33:48 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-a2ba1772-ac22-4351-a1d9-160241a885f1 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.719s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:33:48 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-a34f7de9-9b70-4d68-8e3a-1c540dd031f5 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.713s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:33:48 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-a34f7de9-9b70-4d68-8e3a-1c540dd031f5 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:33:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1473134038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c190d4a5-36b1-499c-8dac-47d7fee50d58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='859b16a72cbe43ef9fe7635d919c6982',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:33:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:33:45Z,use_quota=True,user_id='bb2594bec8ab4b78917d3a8228203573',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:33:48 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-a34f7de9-9b70-4d68-8e3a-1c540dd031f5 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Creating volume c190d4a5-36b1-499c-8dac-47d7fee50d58 {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:33:48 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-a34f7de9-9b70-4d68-8e3a-1c540dd031f5 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:33:48 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-a34f7de9-9b70-4d68-8e3a-1c540dd031f5 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:33:48 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-a34f7de9-9b70-4d68-8e3a-1c540dd031f5 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:33:48 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-a34f7de9-9b70-4d68-8e3a-1c540dd031f5 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:33:48 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-a34f7de9-9b70-4d68-8e3a-1c540dd031f5 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:33:48 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-a34f7de9-9b70-4d68-8e3a-1c540dd031f5 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:33:48 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-a34f7de9-9b70-4d68-8e3a-1c540dd031f5 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:33:48 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-a34f7de9-9b70-4d68-8e3a-1c540dd031f5 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c190d4a5-36b1-499c-8dac-47d7fee50d58 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:33:48 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-a2ba1772-ac22-4351-a1d9-160241a885f1 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0468869d-a5f2-4083-917e-a21d3dcf5c7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d76001a-dc81-4d48-bd7c-d878406c1632', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:48 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-a2ba1772-ac22-4351-a1d9-160241a885f1 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b33f201-b0c4-4778-8950-139d80238a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:48 devstack sudo[104881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c190d4a5-36b1-499c-8dac-47d7fee50d58 1073741824 Jul 22 03:33:48 devstack sudo[104881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:33:48 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-a2ba1772-ac22-4351-a1d9-160241a885f1 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Volume volume-0d76001a-dc81-4d48-bd7c-d878406c1632 (0d76001a-dc81-4d48-bd7c-d878406c1632): created successfully Jul 22 03:33:48 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-a2ba1772-ac22-4351-a1d9-160241a885f1 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b33f201-b0c4-4778-8950-139d80238a8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:48 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-a2ba1772-ac22-4351-a1d9-160241a885f1 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Flow 'volume_create_manager' (12e0b72a-43b4-49b4-8678-c2c233e3aeef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:33:48 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-a2ba1772-ac22-4351-a1d9-160241a885f1 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Created volume successfully. Jul 22 03:33:49 devstack sudo[104881]: pam_unix(sudo:session): session closed for user root Jul 22 03:33:49 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-a34f7de9-9b70-4d68-8e3a-1c540dd031f5 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c190d4a5-36b1-499c-8dac-47d7fee50d58 1073741824" returned: 0 in 0.402s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:33:49 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-8b46e6dc-a211-49f1-b1f7-82c38c55a0af tempest-CreateVolumesFromImageTest-284360659 None] Acquiring lock "cinder-20354406-0586-44e3-a680-0d1517ca8a60-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:33:49 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-a34f7de9-9b70-4d68-8e3a-1c540dd031f5 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c190d4a5-36b1-499c-8dac-47d7fee50d58 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:33:49 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-8b46e6dc-a211-49f1-b1f7-82c38c55a0af tempest-CreateVolumesFromImageTest-284360659 None] Lock "cinder-20354406-0586-44e3-a680-0d1517ca8a60-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:33:49 devstack sudo[104887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c190d4a5-36b1-499c-8dac-47d7fee50d58 Jul 22 03:33:49 devstack sudo[104887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:33:49 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-8b46e6dc-a211-49f1-b1f7-82c38c55a0af tempest-CreateVolumesFromImageTest-284360659 None] Acquiring lock "cinder-quobyte-20354406-0586-44e3-a680-0d1517ca8a60" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:33:49 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-8b46e6dc-a211-49f1-b1f7-82c38c55a0af tempest-CreateVolumesFromImageTest-284360659 None] Lock "cinder-quobyte-20354406-0586-44e3-a680-0d1517ca8a60" acquired by "delete_volume" :: waited 0.016s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:33:49 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2583ba0-5cea-4c5a-a8ff-734c7aea5c33]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:33:49 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-8b46e6dc-a211-49f1-b1f7-82c38c55a0af tempest-CreateVolumesFromImageTest-284360659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-20354406-0586-44e3-a680-0d1517ca8a60 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:33:49 devstack sudo[104889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-20354406-0586-44e3-a680-0d1517ca8a60 Jul 22 03:33:49 devstack sudo[104889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:33:49 devstack sudo[104887]: pam_unix(sudo:session): session closed for user root Jul 22 03:33:49 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-a34f7de9-9b70-4d68-8e3a-1c540dd031f5 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c190d4a5-36b1-499c-8dac-47d7fee50d58" returned: 0 in 0.267s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:33:49 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-a34f7de9-9b70-4d68-8e3a-1c540dd031f5 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] <== create_volume: return (713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:33:49 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-a34f7de9-9b70-4d68-8e3a-1c540dd031f5 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.715s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:33:49 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-6d3e3dc9-9fd5-4847-83b5-f77a8cd78ff4 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.997s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:33:49 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-6d3e3dc9-9fd5-4847-83b5-f77a8cd78ff4 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:33:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1756759857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7865afb3-06ef-41e9-8526-82b52e9bd765,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='859b16a72cbe43ef9fe7635d919c6982',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:33:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:33:45Z,use_quota=True,user_id='bb2594bec8ab4b78917d3a8228203573',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:33:49 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-6d3e3dc9-9fd5-4847-83b5-f77a8cd78ff4 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Creating volume 7865afb3-06ef-41e9-8526-82b52e9bd765 {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:33:49 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-6d3e3dc9-9fd5-4847-83b5-f77a8cd78ff4 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:33:49 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-6d3e3dc9-9fd5-4847-83b5-f77a8cd78ff4 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:33:49 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-6d3e3dc9-9fd5-4847-83b5-f77a8cd78ff4 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:33:49 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-6d3e3dc9-9fd5-4847-83b5-f77a8cd78ff4 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:33:49 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-6d3e3dc9-9fd5-4847-83b5-f77a8cd78ff4 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:33:49 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-6d3e3dc9-9fd5-4847-83b5-f77a8cd78ff4 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:33:49 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-6d3e3dc9-9fd5-4847-83b5-f77a8cd78ff4 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:33:49 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-6d3e3dc9-9fd5-4847-83b5-f77a8cd78ff4 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-7865afb3-06ef-41e9-8526-82b52e9bd765 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:33:49 devstack sudo[104892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-7865afb3-06ef-41e9-8526-82b52e9bd765 1073741824 Jul 22 03:33:49 devstack sudo[104892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:33:49 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-a34f7de9-9b70-4d68-8e3a-1c540dd031f5 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0eacc93a-6783-44df-b1c5-7d6d77c80709) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c190d4a5-36b1-499c-8dac-47d7fee50d58', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:49 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-a34f7de9-9b70-4d68-8e3a-1c540dd031f5 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (094c54ab-2b13-4ff8-9c9f-58aac69f98d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:49 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-a34f7de9-9b70-4d68-8e3a-1c540dd031f5 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Volume volume-c190d4a5-36b1-499c-8dac-47d7fee50d58 (c190d4a5-36b1-499c-8dac-47d7fee50d58): created successfully Jul 22 03:33:49 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-a34f7de9-9b70-4d68-8e3a-1c540dd031f5 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (094c54ab-2b13-4ff8-9c9f-58aac69f98d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:49 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-a34f7de9-9b70-4d68-8e3a-1c540dd031f5 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Flow 'volume_create_manager' (139a0606-9ff1-4adc-a9af-5b48d36c59c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:33:49 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-a34f7de9-9b70-4d68-8e3a-1c540dd031f5 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Created volume successfully. Jul 22 03:33:49 devstack sudo[104889]: pam_unix(sudo:session): session closed for user root Jul 22 03:33:49 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-8b46e6dc-a211-49f1-b1f7-82c38c55a0af tempest-CreateVolumesFromImageTest-284360659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-20354406-0586-44e3-a680-0d1517ca8a60" returned: 0 in 0.349s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:33:49 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-8b46e6dc-a211-49f1-b1f7-82c38c55a0af tempest-CreateVolumesFromImageTest-284360659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-20354406-0586-44e3-a680-0d1517ca8a60 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:33:49 devstack sudo[104897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-20354406-0586-44e3-a680-0d1517ca8a60 Jul 22 03:33:49 devstack sudo[104897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:33:50 devstack sudo[104892]: pam_unix(sudo:session): session closed for user root Jul 22 03:33:50 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-6d3e3dc9-9fd5-4847-83b5-f77a8cd78ff4 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-7865afb3-06ef-41e9-8526-82b52e9bd765 1073741824" returned: 0 in 0.429s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:33:50 devstack sudo[104897]: pam_unix(sudo:session): session closed for user root Jul 22 03:33:50 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-8b46e6dc-a211-49f1-b1f7-82c38c55a0af tempest-CreateVolumesFromImageTest-284360659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-20354406-0586-44e3-a680-0d1517ca8a60" returned: 0 in 0.258s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:33:50 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-8b46e6dc-a211-49f1-b1f7-82c38c55a0af tempest-CreateVolumesFromImageTest-284360659 None] Lock "cinder-quobyte-20354406-0586-44e3-a680-0d1517ca8a60" released by "delete_volume" :: held 0.647s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:33:50 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-6d3e3dc9-9fd5-4847-83b5-f77a8cd78ff4 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-7865afb3-06ef-41e9-8526-82b52e9bd765 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:33:50 devstack sudo[104904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-7865afb3-06ef-41e9-8526-82b52e9bd765 Jul 22 03:33:50 devstack sudo[104904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:33:50 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-8b46e6dc-a211-49f1-b1f7-82c38c55a0af tempest-CreateVolumesFromImageTest-284360659 None] Created reservations ['87f73b52-0f58-492e-b653-3290fcbec304', '6bf7e068-93a4-4f62-b9de-098de442167c', 'dbf32baa-a3e4-4ec1-8594-a55c7c31a2ee', '57eb4f98-d9ec-4963-b487-c096e2f547b4'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:33:50 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-8b46e6dc-a211-49f1-b1f7-82c38c55a0af tempest-CreateVolumesFromImageTest-284360659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:33:50 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-8b46e6dc-a211-49f1-b1f7-82c38c55a0af tempest-CreateVolumesFromImageTest-284360659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:33:50 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-8b46e6dc-a211-49f1-b1f7-82c38c55a0af tempest-CreateVolumesFromImageTest-284360659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:33:50 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-8b46e6dc-a211-49f1-b1f7-82c38c55a0af tempest-CreateVolumesFromImageTest-284360659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:33:50 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-8b46e6dc-a211-49f1-b1f7-82c38c55a0af tempest-CreateVolumesFromImageTest-284360659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:33:50 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-8b46e6dc-a211-49f1-b1f7-82c38c55a0af tempest-CreateVolumesFromImageTest-284360659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:33:50 devstack sudo[104906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:33:50 devstack sudo[104906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:33:50 devstack sudo[104904]: pam_unix(sudo:session): session closed for user root Jul 22 03:33:50 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-6d3e3dc9-9fd5-4847-83b5-f77a8cd78ff4 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-7865afb3-06ef-41e9-8526-82b52e9bd765" returned: 0 in 0.261s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:33:50 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-6d3e3dc9-9fd5-4847-83b5-f77a8cd78ff4 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] <== create_volume: return (747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:33:50 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-6d3e3dc9-9fd5-4847-83b5-f77a8cd78ff4 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.750s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:33:50 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-301ad809-f1a2-41db-8859-ca70ebeea963 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.089s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:33:50 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-301ad809-f1a2-41db-8859-ca70ebeea963 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:33:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-837523899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9963fd8c-47f5-4cf9-a64d-526cc23297c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='859b16a72cbe43ef9fe7635d919c6982',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:33:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:33:46Z,use_quota=True,user_id='bb2594bec8ab4b78917d3a8228203573',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:33:50 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-301ad809-f1a2-41db-8859-ca70ebeea963 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Creating volume 9963fd8c-47f5-4cf9-a64d-526cc23297c1 {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:33:50 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-301ad809-f1a2-41db-8859-ca70ebeea963 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:33:50 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-301ad809-f1a2-41db-8859-ca70ebeea963 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:33:50 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-301ad809-f1a2-41db-8859-ca70ebeea963 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:33:50 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-301ad809-f1a2-41db-8859-ca70ebeea963 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:33:50 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-301ad809-f1a2-41db-8859-ca70ebeea963 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:33:50 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-301ad809-f1a2-41db-8859-ca70ebeea963 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:33:50 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-301ad809-f1a2-41db-8859-ca70ebeea963 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:33:50 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-301ad809-f1a2-41db-8859-ca70ebeea963 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9963fd8c-47f5-4cf9-a64d-526cc23297c1 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:33:50 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-6d3e3dc9-9fd5-4847-83b5-f77a8cd78ff4 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2b762e9-f526-48c7-aaba-efb6504d0fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7865afb3-06ef-41e9-8526-82b52e9bd765', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:50 devstack sudo[104909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9963fd8c-47f5-4cf9-a64d-526cc23297c1 1073741824 Jul 22 03:33:50 devstack sudo[104909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:33:50 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-6d3e3dc9-9fd5-4847-83b5-f77a8cd78ff4 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (caf864ed-9946-4282-9290-02ff7188aa30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:50 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-6d3e3dc9-9fd5-4847-83b5-f77a8cd78ff4 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Volume volume-7865afb3-06ef-41e9-8526-82b52e9bd765 (7865afb3-06ef-41e9-8526-82b52e9bd765): created successfully Jul 22 03:33:50 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-6d3e3dc9-9fd5-4847-83b5-f77a8cd78ff4 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (caf864ed-9946-4282-9290-02ff7188aa30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:50 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-6d3e3dc9-9fd5-4847-83b5-f77a8cd78ff4 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Flow 'volume_create_manager' (dc69b163-6c23-4a1d-8da5-2d104d6fbeae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:33:50 devstack sudo[104906]: pam_unix(sudo:session): session closed for user root Jul 22 03:33:50 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-8b46e6dc-a211-49f1-b1f7-82c38c55a0af tempest-CreateVolumesFromImageTest-284360659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.252s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:33:50 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-8b46e6dc-a211-49f1-b1f7-82c38c55a0af tempest-CreateVolumesFromImageTest-284360659 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:33:50 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-6d3e3dc9-9fd5-4847-83b5-f77a8cd78ff4 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Created volume successfully. Jul 22 03:33:50 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-8b46e6dc-a211-49f1-b1f7-82c38c55a0af tempest-CreateVolumesFromImageTest-284360659 None] Deleted volume successfully. Jul 22 03:33:50 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-8b46e6dc-a211-49f1-b1f7-82c38c55a0af tempest-CreateVolumesFromImageTest-284360659 None] Lock "cinder-20354406-0586-44e3-a680-0d1517ca8a60-delete_volume" released by "delete_volume" :: held 1.129s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:33:50 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-c8659e7d-ecf2-4a33-a8b8-20ebb221a863 tempest-CreateVolumesFromImageTest-284360659 None] Acquiring lock "cinder-98e26f32-6fcb-49b1-a7a1-223d8931ca91-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:33:50 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-c8659e7d-ecf2-4a33-a8b8-20ebb221a863 tempest-CreateVolumesFromImageTest-284360659 None] Lock "cinder-98e26f32-6fcb-49b1-a7a1-223d8931ca91-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:33:50 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-c8659e7d-ecf2-4a33-a8b8-20ebb221a863 tempest-CreateVolumesFromImageTest-284360659 None] Acquiring lock "cinder-quobyte-98e26f32-6fcb-49b1-a7a1-223d8931ca91" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:33:50 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-c8659e7d-ecf2-4a33-a8b8-20ebb221a863 tempest-CreateVolumesFromImageTest-284360659 None] Lock "cinder-quobyte-98e26f32-6fcb-49b1-a7a1-223d8931ca91" acquired by "delete_volume" :: waited 0.029s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:33:50 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[e368b217-b48f-4be1-88f7-be344cd21817]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:33:50 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-c8659e7d-ecf2-4a33-a8b8-20ebb221a863 tempest-CreateVolumesFromImageTest-284360659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-98e26f32-6fcb-49b1-a7a1-223d8931ca91 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:33:50 devstack sudo[104914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-98e26f32-6fcb-49b1-a7a1-223d8931ca91 Jul 22 03:33:50 devstack sudo[104914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:33:50 devstack sudo[104909]: pam_unix(sudo:session): session closed for user root Jul 22 03:33:50 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-301ad809-f1a2-41db-8859-ca70ebeea963 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9963fd8c-47f5-4cf9-a64d-526cc23297c1 1073741824" returned: 0 in 0.516s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:33:50 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-301ad809-f1a2-41db-8859-ca70ebeea963 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9963fd8c-47f5-4cf9-a64d-526cc23297c1 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:33:50 devstack sudo[104917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9963fd8c-47f5-4cf9-a64d-526cc23297c1 Jul 22 03:33:50 devstack sudo[104917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:33:51 devstack sudo[104914]: pam_unix(sudo:session): session closed for user root Jul 22 03:33:51 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-c8659e7d-ecf2-4a33-a8b8-20ebb221a863 tempest-CreateVolumesFromImageTest-284360659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-98e26f32-6fcb-49b1-a7a1-223d8931ca91" returned: 0 in 0.390s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:33:51 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-c8659e7d-ecf2-4a33-a8b8-20ebb221a863 tempest-CreateVolumesFromImageTest-284360659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-98e26f32-6fcb-49b1-a7a1-223d8931ca91 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:33:51 devstack sudo[104922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-98e26f32-6fcb-49b1-a7a1-223d8931ca91 Jul 22 03:33:51 devstack sudo[104922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:33:51 devstack sudo[104917]: pam_unix(sudo:session): session closed for user root Jul 22 03:33:51 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-301ad809-f1a2-41db-8859-ca70ebeea963 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9963fd8c-47f5-4cf9-a64d-526cc23297c1" returned: 0 in 0.266s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:33:51 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-301ad809-f1a2-41db-8859-ca70ebeea963 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] <== create_volume: return (826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:33:51 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-301ad809-f1a2-41db-8859-ca70ebeea963 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.828s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:33:51 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-cd6bc853-f941-4f4c-b7fe-7c2b1a8691e5 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.667s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:33:51 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-cd6bc853-f941-4f4c-b7fe-7c2b1a8691e5 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:33:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-216005422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48ce7741-b169-4cb2-8946-89307bb6aece,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='859b16a72cbe43ef9fe7635d919c6982',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:33:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:33:46Z,use_quota=True,user_id='bb2594bec8ab4b78917d3a8228203573',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:33:51 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-cd6bc853-f941-4f4c-b7fe-7c2b1a8691e5 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Creating volume 48ce7741-b169-4cb2-8946-89307bb6aece {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:33:51 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-cd6bc853-f941-4f4c-b7fe-7c2b1a8691e5 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:33:51 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-cd6bc853-f941-4f4c-b7fe-7c2b1a8691e5 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:33:51 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-cd6bc853-f941-4f4c-b7fe-7c2b1a8691e5 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:33:51 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-cd6bc853-f941-4f4c-b7fe-7c2b1a8691e5 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:33:51 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-cd6bc853-f941-4f4c-b7fe-7c2b1a8691e5 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:33:51 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-cd6bc853-f941-4f4c-b7fe-7c2b1a8691e5 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:33:51 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-cd6bc853-f941-4f4c-b7fe-7c2b1a8691e5 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:33:51 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-cd6bc853-f941-4f4c-b7fe-7c2b1a8691e5 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-48ce7741-b169-4cb2-8946-89307bb6aece 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:33:51 devstack sudo[104925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-48ce7741-b169-4cb2-8946-89307bb6aece 1073741824 Jul 22 03:33:51 devstack sudo[104925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:33:51 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-301ad809-f1a2-41db-8859-ca70ebeea963 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f7d1f42-028d-4113-8e52-b92976c0cd8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9963fd8c-47f5-4cf9-a64d-526cc23297c1', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:51 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-301ad809-f1a2-41db-8859-ca70ebeea963 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e139e70f-80c3-4a34-b85a-f386c095810f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:51 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-301ad809-f1a2-41db-8859-ca70ebeea963 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Volume volume-9963fd8c-47f5-4cf9-a64d-526cc23297c1 (9963fd8c-47f5-4cf9-a64d-526cc23297c1): created successfully Jul 22 03:33:51 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-301ad809-f1a2-41db-8859-ca70ebeea963 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e139e70f-80c3-4a34-b85a-f386c095810f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:51 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-301ad809-f1a2-41db-8859-ca70ebeea963 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Flow 'volume_create_manager' (f120f703-a0ec-453c-a7cc-9dc5ce4b599c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:33:51 devstack sudo[104922]: pam_unix(sudo:session): session closed for user root Jul 22 03:33:51 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-c8659e7d-ecf2-4a33-a8b8-20ebb221a863 tempest-CreateVolumesFromImageTest-284360659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-98e26f32-6fcb-49b1-a7a1-223d8931ca91" returned: 0 in 0.281s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:33:51 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-c8659e7d-ecf2-4a33-a8b8-20ebb221a863 tempest-CreateVolumesFromImageTest-284360659 None] Lock "cinder-quobyte-98e26f32-6fcb-49b1-a7a1-223d8931ca91" released by "delete_volume" :: held 0.727s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:33:51 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-301ad809-f1a2-41db-8859-ca70ebeea963 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Created volume successfully. Jul 22 03:33:51 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-c8659e7d-ecf2-4a33-a8b8-20ebb221a863 tempest-CreateVolumesFromImageTest-284360659 None] Created reservations ['cc11aeea-4a9b-47a8-a0a8-6bdbdb76bcb1', 'cfd742ec-11d9-473b-a252-54df145def56', '23cb09c6-7973-428f-91d5-88a477727188', '90936d3c-84ea-42bb-985a-82584161a904'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:33:51 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-c8659e7d-ecf2-4a33-a8b8-20ebb221a863 tempest-CreateVolumesFromImageTest-284360659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:33:51 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-c8659e7d-ecf2-4a33-a8b8-20ebb221a863 tempest-CreateVolumesFromImageTest-284360659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:33:51 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-c8659e7d-ecf2-4a33-a8b8-20ebb221a863 tempest-CreateVolumesFromImageTest-284360659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:33:51 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-c8659e7d-ecf2-4a33-a8b8-20ebb221a863 tempest-CreateVolumesFromImageTest-284360659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:33:51 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-c8659e7d-ecf2-4a33-a8b8-20ebb221a863 tempest-CreateVolumesFromImageTest-284360659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:33:51 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-c8659e7d-ecf2-4a33-a8b8-20ebb221a863 tempest-CreateVolumesFromImageTest-284360659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:33:51 devstack sudo[104931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:33:51 devstack sudo[104931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:33:51 devstack sudo[104925]: pam_unix(sudo:session): session closed for user root Jul 22 03:33:51 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-cd6bc853-f941-4f4c-b7fe-7c2b1a8691e5 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-48ce7741-b169-4cb2-8946-89307bb6aece 1073741824" returned: 0 in 0.452s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:33:51 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-cd6bc853-f941-4f4c-b7fe-7c2b1a8691e5 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-48ce7741-b169-4cb2-8946-89307bb6aece {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:33:51 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-2521a522-ebce-405f-8ec1-dc8a7761f408 tempest-CreateVolumesFromImageTest-284360659 None] Acquiring lock "cinder-55287bd0-d888-474e-bff1-0183ce0ada02-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:33:51 devstack sudo[104935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-48ce7741-b169-4cb2-8946-89307bb6aece Jul 22 03:33:51 devstack sudo[104935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:33:51 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-2521a522-ebce-405f-8ec1-dc8a7761f408 tempest-CreateVolumesFromImageTest-284360659 None] Lock "cinder-55287bd0-d888-474e-bff1-0183ce0ada02-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:33:51 devstack sudo[104931]: pam_unix(sudo:session): session closed for user root Jul 22 03:33:51 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-c8659e7d-ecf2-4a33-a8b8-20ebb221a863 tempest-CreateVolumesFromImageTest-284360659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.275s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:33:51 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-c8659e7d-ecf2-4a33-a8b8-20ebb221a863 tempest-CreateVolumesFromImageTest-284360659 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:33:51 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-c8659e7d-ecf2-4a33-a8b8-20ebb221a863 tempest-CreateVolumesFromImageTest-284360659 None] Deleted volume successfully. Jul 22 03:33:51 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-2521a522-ebce-405f-8ec1-dc8a7761f408 tempest-CreateVolumesFromImageTest-284360659 None] Acquiring lock "cinder-quobyte-55287bd0-d888-474e-bff1-0183ce0ada02" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:33:51 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-c8659e7d-ecf2-4a33-a8b8-20ebb221a863 tempest-CreateVolumesFromImageTest-284360659 None] Lock "cinder-98e26f32-6fcb-49b1-a7a1-223d8931ca91-delete_volume" released by "delete_volume" :: held 1.262s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:33:51 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-2521a522-ebce-405f-8ec1-dc8a7761f408 tempest-CreateVolumesFromImageTest-284360659 None] Lock "cinder-quobyte-55287bd0-d888-474e-bff1-0183ce0ada02" acquired by "delete_volume" :: waited 0.021s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:33:51 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[765b1bd7-f957-4b7e-8e16-374feb223a6a]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:33:51 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2521a522-ebce-405f-8ec1-dc8a7761f408 tempest-CreateVolumesFromImageTest-284360659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-55287bd0-d888-474e-bff1-0183ce0ada02 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:33:52 devstack sudo[104937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-55287bd0-d888-474e-bff1-0183ce0ada02 Jul 22 03:33:52 devstack sudo[104937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:33:52 devstack sudo[104935]: pam_unix(sudo:session): session closed for user root Jul 22 03:33:52 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-cd6bc853-f941-4f4c-b7fe-7c2b1a8691e5 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-48ce7741-b169-4cb2-8946-89307bb6aece" returned: 0 in 0.302s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:33:52 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-cd6bc853-f941-4f4c-b7fe-7c2b1a8691e5 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] <== create_volume: return (805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:33:52 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-cd6bc853-f941-4f4c-b7fe-7c2b1a8691e5 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.808s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:33:52 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-7d3fb7ee-9ba1-4295-b84e-d55ba7edc654 tempest-CreateVolumesFromSnapshotTest-653456616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.837s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:33:52 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-cd6bc853-f941-4f4c-b7fe-7c2b1a8691e5 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e17805bb-2c05-41ce-8587-080fe2195cfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48ce7741-b169-4cb2-8946-89307bb6aece', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:52 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-cd6bc853-f941-4f4c-b7fe-7c2b1a8691e5 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e5dee2c-08ad-4a1a-94c4-28d6a223b4bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:52 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-7d3fb7ee-9ba1-4295-b84e-d55ba7edc654 tempest-CreateVolumesFromSnapshotTest-653456616 None] Creating offline snapshot e792e9b3-f162-4b03-afd8-b27fc26145cf of volume 942e7752-6415-40b2-aaae-fcb41088682f {{(pid=87747) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 03:33:52 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-cd6bc853-f941-4f4c-b7fe-7c2b1a8691e5 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Volume volume-48ce7741-b169-4cb2-8946-89307bb6aece (48ce7741-b169-4cb2-8946-89307bb6aece): created successfully Jul 22 03:33:52 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-cd6bc853-f941-4f4c-b7fe-7c2b1a8691e5 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e5dee2c-08ad-4a1a-94c4-28d6a223b4bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:52 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-cd6bc853-f941-4f4c-b7fe-7c2b1a8691e5 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Flow 'volume_create_manager' (6ac28523-666a-4377-a05f-cb8d4403046e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:33:52 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd79c2e-b629-49ae-939f-4411cb69f199]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:33:52 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-7d3fb7ee-9ba1-4295-b84e-d55ba7edc654 tempest-CreateVolumesFromSnapshotTest-653456616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-942e7752-6415-40b2-aaae-fcb41088682f {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:33:52 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-cd6bc853-f941-4f4c-b7fe-7c2b1a8691e5 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Created volume successfully. Jul 22 03:33:52 devstack sudo[104940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-942e7752-6415-40b2-aaae-fcb41088682f Jul 22 03:33:52 devstack sudo[104940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:33:52 devstack sudo[104937]: pam_unix(sudo:session): session closed for user root Jul 22 03:33:52 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2521a522-ebce-405f-8ec1-dc8a7761f408 tempest-CreateVolumesFromImageTest-284360659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-55287bd0-d888-474e-bff1-0183ce0ada02" returned: 0 in 0.373s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:33:52 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2521a522-ebce-405f-8ec1-dc8a7761f408 tempest-CreateVolumesFromImageTest-284360659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-55287bd0-d888-474e-bff1-0183ce0ada02 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:33:52 devstack sudo[104946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-55287bd0-d888-474e-bff1-0183ce0ada02 Jul 22 03:33:52 devstack sudo[104946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:33:52 devstack sudo[104940]: pam_unix(sudo:session): session closed for user root Jul 22 03:33:52 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-7d3fb7ee-9ba1-4295-b84e-d55ba7edc654 tempest-CreateVolumesFromSnapshotTest-653456616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-942e7752-6415-40b2-aaae-fcb41088682f" returned: 0 in 0.376s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:33:52 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-7d3fb7ee-9ba1-4295-b84e-d55ba7edc654 tempest-CreateVolumesFromSnapshotTest-653456616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-942e7752-6415-40b2-aaae-fcb41088682f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-942e7752-6415-40b2-aaae-fcb41088682f.e792e9b3-f162-4b03-afd8-b27fc26145cf 1G {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:33:52 devstack sudo[104951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-942e7752-6415-40b2-aaae-fcb41088682f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-942e7752-6415-40b2-aaae-fcb41088682f.e792e9b3-f162-4b03-afd8-b27fc26145cf 1G Jul 22 03:33:52 devstack sudo[104951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:33:52 devstack sudo[104946]: pam_unix(sudo:session): session closed for user root Jul 22 03:33:52 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2521a522-ebce-405f-8ec1-dc8a7761f408 tempest-CreateVolumesFromImageTest-284360659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-55287bd0-d888-474e-bff1-0183ce0ada02" returned: 0 in 0.252s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:33:52 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-2521a522-ebce-405f-8ec1-dc8a7761f408 tempest-CreateVolumesFromImageTest-284360659 None] Lock "cinder-quobyte-55287bd0-d888-474e-bff1-0183ce0ada02" released by "delete_volume" :: held 0.689s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:33:52 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-2521a522-ebce-405f-8ec1-dc8a7761f408 tempest-CreateVolumesFromImageTest-284360659 None] Created reservations ['7c667ade-85e8-4dfb-b13c-9aad4e8efef3', 'e0e09afa-73a1-4793-8576-2045b935dc05', '1ec3b998-5826-415c-88ff-f6c5195eaa66', '90488cfa-abcc-4f92-9021-7c59fa64a072'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:33:52 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-2521a522-ebce-405f-8ec1-dc8a7761f408 tempest-CreateVolumesFromImageTest-284360659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:33:52 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-2521a522-ebce-405f-8ec1-dc8a7761f408 tempest-CreateVolumesFromImageTest-284360659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:33:52 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-2521a522-ebce-405f-8ec1-dc8a7761f408 tempest-CreateVolumesFromImageTest-284360659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:33:52 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-2521a522-ebce-405f-8ec1-dc8a7761f408 tempest-CreateVolumesFromImageTest-284360659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:33:52 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-2521a522-ebce-405f-8ec1-dc8a7761f408 tempest-CreateVolumesFromImageTest-284360659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:33:52 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2521a522-ebce-405f-8ec1-dc8a7761f408 tempest-CreateVolumesFromImageTest-284360659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:33:52 devstack sudo[104954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:33:52 devstack sudo[104954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:33:52 devstack sudo[104951]: pam_unix(sudo:session): session closed for user root Jul 22 03:33:52 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-7d3fb7ee-9ba1-4295-b84e-d55ba7edc654 tempest-CreateVolumesFromSnapshotTest-653456616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-942e7752-6415-40b2-aaae-fcb41088682f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-942e7752-6415-40b2-aaae-fcb41088682f.e792e9b3-f162-4b03-afd8-b27fc26145cf 1G" returned: 0 in 0.426s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:33:52 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-7d3fb7ee-9ba1-4295-b84e-d55ba7edc654 tempest-CreateVolumesFromSnapshotTest-653456616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-942e7752-6415-40b2-aaae-fcb41088682f -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-942e7752-6415-40b2-aaae-fcb41088682f.e792e9b3-f162-4b03-afd8-b27fc26145cf {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:33:52 devstack sudo[104954]: pam_unix(sudo:session): session closed for user root Jul 22 03:33:52 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2521a522-ebce-405f-8ec1-dc8a7761f408 tempest-CreateVolumesFromImageTest-284360659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.256s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:33:52 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-2521a522-ebce-405f-8ec1-dc8a7761f408 tempest-CreateVolumesFromImageTest-284360659 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:33:52 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-2521a522-ebce-405f-8ec1-dc8a7761f408 tempest-CreateVolumesFromImageTest-284360659 None] Deleted volume successfully. Jul 22 03:33:52 devstack sudo[104961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-942e7752-6415-40b2-aaae-fcb41088682f -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-942e7752-6415-40b2-aaae-fcb41088682f.e792e9b3-f162-4b03-afd8-b27fc26145cf Jul 22 03:33:52 devstack sudo[104961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:33:52 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-acd04c4b-5d4c-4768-a390-3b509e59c6ba tempest-CreateVolumesFromImageTest-284360659 None] Acquiring lock "cinder-7b79490b-c9e5-4218-b8df-cabfb040cf7d-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:33:52 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-2521a522-ebce-405f-8ec1-dc8a7761f408 tempest-CreateVolumesFromImageTest-284360659 None] Lock "cinder-55287bd0-d888-474e-bff1-0183ce0ada02-delete_volume" released by "delete_volume" :: held 1.191s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:33:52 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-acd04c4b-5d4c-4768-a390-3b509e59c6ba tempest-CreateVolumesFromImageTest-284360659 None] Lock "cinder-7b79490b-c9e5-4218-b8df-cabfb040cf7d-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:33:53 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-acd04c4b-5d4c-4768-a390-3b509e59c6ba tempest-CreateVolumesFromImageTest-284360659 None] Acquiring lock "cinder-quobyte-7b79490b-c9e5-4218-b8df-cabfb040cf7d" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:33:53 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-acd04c4b-5d4c-4768-a390-3b509e59c6ba tempest-CreateVolumesFromImageTest-284360659 None] Lock "cinder-quobyte-7b79490b-c9e5-4218-b8df-cabfb040cf7d" acquired by "delete_volume" :: waited 0.020s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:33:53 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-cf3c1d04-67f3-4850-a95f-0e12e574512f tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Acquiring lock "cinder-48ce7741-b169-4cb2-8946-89307bb6aece-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:33:53 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fe8e16b-7813-48b7-bdda-dfd7118ab7ca]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:33:53 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-acd04c4b-5d4c-4768-a390-3b509e59c6ba tempest-CreateVolumesFromImageTest-284360659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-7b79490b-c9e5-4218-b8df-cabfb040cf7d {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:33:53 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-cf3c1d04-67f3-4850-a95f-0e12e574512f tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Lock "cinder-48ce7741-b169-4cb2-8946-89307bb6aece-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:33:53 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-cf3c1d04-67f3-4850-a95f-0e12e574512f tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Acquiring lock "cinder-quobyte-48ce7741-b169-4cb2-8946-89307bb6aece" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:33:53 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-cf3c1d04-67f3-4850-a95f-0e12e574512f tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Lock "cinder-quobyte-48ce7741-b169-4cb2-8946-89307bb6aece" acquired by "delete_volume" :: waited 0.025s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:33:53 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[057bd1f1-8169-40d4-884f-38b911007a5e]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:33:53 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-cf3c1d04-67f3-4850-a95f-0e12e574512f tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-48ce7741-b169-4cb2-8946-89307bb6aece {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:33:53 devstack sudo[104963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-7b79490b-c9e5-4218-b8df-cabfb040cf7d Jul 22 03:33:53 devstack sudo[104963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:33:53 devstack sudo[104961]: pam_unix(sudo:session): session closed for user root Jul 22 03:33:53 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-7d3fb7ee-9ba1-4295-b84e-d55ba7edc654 tempest-CreateVolumesFromSnapshotTest-653456616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-942e7752-6415-40b2-aaae-fcb41088682f -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-942e7752-6415-40b2-aaae-fcb41088682f.e792e9b3-f162-4b03-afd8-b27fc26145cf" returned: 0 in 0.388s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:33:53 devstack cinder-volume[87747]: WARNING cinder.volume.drivers.remotefs [None req-7d3fb7ee-9ba1-4295-b84e-d55ba7edc654 tempest-CreateVolumesFromSnapshotTest-653456616 None] /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-942e7752-6415-40b2-aaae-fcb41088682f.e792e9b3-f162-4b03-afd8-b27fc26145cf is being set with open permissions: ugo+rw Jul 22 03:33:53 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-7d3fb7ee-9ba1-4295-b84e-d55ba7edc654 tempest-CreateVolumesFromSnapshotTest-653456616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-942e7752-6415-40b2-aaae-fcb41088682f.e792e9b3-f162-4b03-afd8-b27fc26145cf {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:33:53 devstack sudo[104965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-48ce7741-b169-4cb2-8946-89307bb6aece Jul 22 03:33:53 devstack sudo[104965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:33:53 devstack sudo[104969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-942e7752-6415-40b2-aaae-fcb41088682f.e792e9b3-f162-4b03-afd8-b27fc26145cf Jul 22 03:33:53 devstack sudo[104969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:33:53 devstack sudo[104963]: pam_unix(sudo:session): session closed for user root Jul 22 03:33:53 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-acd04c4b-5d4c-4768-a390-3b509e59c6ba tempest-CreateVolumesFromImageTest-284360659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-7b79490b-c9e5-4218-b8df-cabfb040cf7d" returned: 0 in 0.388s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:33:53 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-acd04c4b-5d4c-4768-a390-3b509e59c6ba tempest-CreateVolumesFromImageTest-284360659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-7b79490b-c9e5-4218-b8df-cabfb040cf7d {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:33:53 devstack sudo[104976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-7b79490b-c9e5-4218-b8df-cabfb040cf7d Jul 22 03:33:53 devstack sudo[104976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:33:53 devstack sudo[104969]: pam_unix(sudo:session): session closed for user root Jul 22 03:33:53 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-7d3fb7ee-9ba1-4295-b84e-d55ba7edc654 tempest-CreateVolumesFromSnapshotTest-653456616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-942e7752-6415-40b2-aaae-fcb41088682f.e792e9b3-f162-4b03-afd8-b27fc26145cf" returned: 0 in 0.275s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:33:53 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-7d3fb7ee-9ba1-4295-b84e-d55ba7edc654 tempest-CreateVolumesFromSnapshotTest-653456616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-942e7752-6415-40b2-aaae-fcb41088682f.info {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:33:53 devstack sudo[104965]: pam_unix(sudo:session): session closed for user root Jul 22 03:33:53 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-cf3c1d04-67f3-4850-a95f-0e12e574512f tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-48ce7741-b169-4cb2-8946-89307bb6aece" returned: 0 in 0.427s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:33:53 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-cf3c1d04-67f3-4850-a95f-0e12e574512f tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-48ce7741-b169-4cb2-8946-89307bb6aece {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:33:53 devstack sudo[104982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-942e7752-6415-40b2-aaae-fcb41088682f.info Jul 22 03:33:53 devstack sudo[104982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:33:53 devstack sudo[104983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-48ce7741-b169-4cb2-8946-89307bb6aece Jul 22 03:33:53 devstack sudo[104983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:33:53 devstack sudo[104976]: pam_unix(sudo:session): session closed for user root Jul 22 03:33:53 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-acd04c4b-5d4c-4768-a390-3b509e59c6ba tempest-CreateVolumesFromImageTest-284360659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-7b79490b-c9e5-4218-b8df-cabfb040cf7d" returned: 0 in 0.268s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:33:53 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-acd04c4b-5d4c-4768-a390-3b509e59c6ba tempest-CreateVolumesFromImageTest-284360659 None] Lock "cinder-quobyte-7b79490b-c9e5-4218-b8df-cabfb040cf7d" released by "delete_volume" :: held 0.705s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:33:53 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-acd04c4b-5d4c-4768-a390-3b509e59c6ba tempest-CreateVolumesFromImageTest-284360659 None] Created reservations ['7867a168-13b0-4497-86ab-5aab0b9192c0', '0940f3fd-9ebe-4ac3-a89c-085b70748299', '40870188-4bc9-4e92-acc7-10a24257285f', '76926784-d1aa-45f0-9a11-fc63628d78a2'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:33:53 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-acd04c4b-5d4c-4768-a390-3b509e59c6ba tempest-CreateVolumesFromImageTest-284360659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:33:53 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-acd04c4b-5d4c-4768-a390-3b509e59c6ba tempest-CreateVolumesFromImageTest-284360659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:33:53 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-acd04c4b-5d4c-4768-a390-3b509e59c6ba tempest-CreateVolumesFromImageTest-284360659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:33:53 devstack sudo[104983]: pam_unix(sudo:session): session closed for user root Jul 22 03:33:53 devstack sudo[104982]: pam_unix(sudo:session): session closed for user root Jul 22 03:33:53 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-acd04c4b-5d4c-4768-a390-3b509e59c6ba tempest-CreateVolumesFromImageTest-284360659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:33:53 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-acd04c4b-5d4c-4768-a390-3b509e59c6ba tempest-CreateVolumesFromImageTest-284360659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:33:53 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-acd04c4b-5d4c-4768-a390-3b509e59c6ba tempest-CreateVolumesFromImageTest-284360659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:33:53 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-7d3fb7ee-9ba1-4295-b84e-d55ba7edc654 tempest-CreateVolumesFromSnapshotTest-653456616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-942e7752-6415-40b2-aaae-fcb41088682f.info" returned: 0 in 0.288s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:33:53 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-cf3c1d04-67f3-4850-a95f-0e12e574512f tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-48ce7741-b169-4cb2-8946-89307bb6aece" returned: 0 in 0.271s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:33:53 devstack cinder-volume[87747]: WARNING cinder.volume.drivers.remotefs [None req-7d3fb7ee-9ba1-4295-b84e-d55ba7edc654 tempest-CreateVolumesFromSnapshotTest-653456616 None] /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-942e7752-6415-40b2-aaae-fcb41088682f.info is being set with open permissions: ugo+rw Jul 22 03:33:53 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-7d3fb7ee-9ba1-4295-b84e-d55ba7edc654 tempest-CreateVolumesFromSnapshotTest-653456616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-942e7752-6415-40b2-aaae-fcb41088682f.info {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:33:53 devstack sudo[104989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:33:53 devstack sudo[104989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:33:53 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-cf3c1d04-67f3-4850-a95f-0e12e574512f tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Lock "cinder-quobyte-48ce7741-b169-4cb2-8946-89307bb6aece" released by "delete_volume" :: held 0.754s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:33:53 devstack sudo[104990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-942e7752-6415-40b2-aaae-fcb41088682f.info Jul 22 03:33:53 devstack sudo[104990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:33:53 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-cf3c1d04-67f3-4850-a95f-0e12e574512f tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Created reservations ['79fa8301-c84f-453a-a491-880bd836351b', '61233bb8-0c0d-4786-8c22-8e65b4b61d74', 'ec441f57-0da0-4588-ba5d-aed6fa5495fd', '592b2f75-b9fe-4e9e-9bce-e010475d82d1'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:33:54 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-cf3c1d04-67f3-4850-a95f-0e12e574512f tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:33:54 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-cf3c1d04-67f3-4850-a95f-0e12e574512f tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:33:54 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-cf3c1d04-67f3-4850-a95f-0e12e574512f tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:33:54 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-cf3c1d04-67f3-4850-a95f-0e12e574512f tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:33:54 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-cf3c1d04-67f3-4850-a95f-0e12e574512f tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:33:54 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-cf3c1d04-67f3-4850-a95f-0e12e574512f tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:33:54 devstack sudo[104993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:33:54 devstack sudo[104993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:33:54 devstack sudo[104990]: pam_unix(sudo:session): session closed for user root Jul 22 03:33:54 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-693db3f1-e349-490a-83cb-9fc4b2e260be tempest-CreateVolumesFromImageTest-284360659 None] Acquiring lock "cinder-cef7e3c9-5317-49b5-b984-6af817c41213-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:33:54 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-7d3fb7ee-9ba1-4295-b84e-d55ba7edc654 tempest-CreateVolumesFromSnapshotTest-653456616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-942e7752-6415-40b2-aaae-fcb41088682f.info" returned: 0 in 0.280s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:33:54 devstack sudo[104989]: pam_unix(sudo:session): session closed for user root Jul 22 03:33:54 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-7d3fb7ee-9ba1-4295-b84e-d55ba7edc654 tempest-CreateVolumesFromSnapshotTest-653456616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.171s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:33:54 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-c99a302d-6f25-4240-a46d-20fb403c070d tempest-VolumeAndVolumeTypeFromImageTest-2121925634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.764s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:33:54 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-c99a302d-6f25-4240-a46d-20fb403c070d tempest-VolumeAndVolumeTypeFromImageTest-2121925634 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:33:46Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2546cf0-d274-4f16-95ed-641920edaed1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39d2d667a24048fe82d4af5857880b1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:33:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:33:46Z,use_quota=True,user_id='5daee779883841d9895756a24e625de9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(86d006c0-8f87-49f7-8fab-08e76d49dec6),volume_type_id=86d006c0-8f87-49f7-8fab-08e76d49dec6)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:33:54 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-c99a302d-6f25-4240-a46d-20fb403c070d tempest-VolumeAndVolumeTypeFromImageTest-2121925634 None] Creating volume d2546cf0-d274-4f16-95ed-641920edaed1 {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:33:54 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-c99a302d-6f25-4240-a46d-20fb403c070d tempest-VolumeAndVolumeTypeFromImageTest-2121925634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:33:54 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-c99a302d-6f25-4240-a46d-20fb403c070d tempest-VolumeAndVolumeTypeFromImageTest-2121925634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:33:54 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-c99a302d-6f25-4240-a46d-20fb403c070d tempest-VolumeAndVolumeTypeFromImageTest-2121925634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:33:54 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-c99a302d-6f25-4240-a46d-20fb403c070d tempest-VolumeAndVolumeTypeFromImageTest-2121925634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:33:54 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-c99a302d-6f25-4240-a46d-20fb403c070d tempest-VolumeAndVolumeTypeFromImageTest-2121925634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:33:54 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-c99a302d-6f25-4240-a46d-20fb403c070d tempest-VolumeAndVolumeTypeFromImageTest-2121925634 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:33:54 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-c99a302d-6f25-4240-a46d-20fb403c070d tempest-VolumeAndVolumeTypeFromImageTest-2121925634 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:33:54 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-c99a302d-6f25-4240-a46d-20fb403c070d tempest-VolumeAndVolumeTypeFromImageTest-2121925634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d2546cf0-d274-4f16-95ed-641920edaed1 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:33:54 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-acd04c4b-5d4c-4768-a390-3b509e59c6ba tempest-CreateVolumesFromImageTest-284360659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.372s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:33:54 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-acd04c4b-5d4c-4768-a390-3b509e59c6ba tempest-CreateVolumesFromImageTest-284360659 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:33:54 devstack sudo[104997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d2546cf0-d274-4f16-95ed-641920edaed1 1073741824 Jul 22 03:33:54 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-693db3f1-e349-490a-83cb-9fc4b2e260be tempest-CreateVolumesFromImageTest-284360659 None] Lock "cinder-cef7e3c9-5317-49b5-b984-6af817c41213-delete_volume" acquired by "delete_volume" :: waited 0.098s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:33:54 devstack sudo[104997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:33:54 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-acd04c4b-5d4c-4768-a390-3b509e59c6ba tempest-CreateVolumesFromImageTest-284360659 None] Deleted volume successfully. Jul 22 03:33:54 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-ec0c43e1-17a3-4fa3-8c6f-54a0f7b24859 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Acquiring lock "cinder-9963fd8c-47f5-4cf9-a64d-526cc23297c1-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:33:54 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-7d3fb7ee-9ba1-4295-b84e-d55ba7edc654 tempest-CreateVolumesFromSnapshotTest-653456616 None] Create snapshot completed successfully Jul 22 03:33:54 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-ec0c43e1-17a3-4fa3-8c6f-54a0f7b24859 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Lock "cinder-9963fd8c-47f5-4cf9-a64d-526cc23297c1-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:33:54 devstack sudo[104993]: pam_unix(sudo:session): session closed for user root Jul 22 03:33:54 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-acd04c4b-5d4c-4768-a390-3b509e59c6ba tempest-CreateVolumesFromImageTest-284360659 None] Lock "cinder-7b79490b-c9e5-4218-b8df-cabfb040cf7d-delete_volume" released by "delete_volume" :: held 1.349s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:33:54 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-cf3c1d04-67f3-4850-a95f-0e12e574512f tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.316s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:33:54 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-cf3c1d04-67f3-4850-a95f-0e12e574512f tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:33:54 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-693db3f1-e349-490a-83cb-9fc4b2e260be tempest-CreateVolumesFromImageTest-284360659 None] Acquiring lock "cinder-quobyte-cef7e3c9-5317-49b5-b984-6af817c41213" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:33:54 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-cf3c1d04-67f3-4850-a95f-0e12e574512f tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Deleted volume successfully. Jul 22 03:33:54 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-693db3f1-e349-490a-83cb-9fc4b2e260be tempest-CreateVolumesFromImageTest-284360659 None] Lock "cinder-quobyte-cef7e3c9-5317-49b5-b984-6af817c41213" acquired by "delete_volume" :: waited 0.037s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:33:54 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-ec0c43e1-17a3-4fa3-8c6f-54a0f7b24859 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Acquiring lock "cinder-quobyte-9963fd8c-47f5-4cf9-a64d-526cc23297c1" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:33:54 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-cf3c1d04-67f3-4850-a95f-0e12e574512f tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Lock "cinder-48ce7741-b169-4cb2-8946-89307bb6aece-delete_volume" released by "delete_volume" :: held 1.328s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:33:54 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[832880af-1a6a-41a3-abef-e8e694f95dd8]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:33:54 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-693db3f1-e349-490a-83cb-9fc4b2e260be tempest-CreateVolumesFromImageTest-284360659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-cef7e3c9-5317-49b5-b984-6af817c41213 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:33:54 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-ec0c43e1-17a3-4fa3-8c6f-54a0f7b24859 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Lock "cinder-quobyte-9963fd8c-47f5-4cf9-a64d-526cc23297c1" acquired by "delete_volume" :: waited 0.035s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:33:54 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[38d45691-392f-4980-9eef-73e94f442234]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:33:54 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ec0c43e1-17a3-4fa3-8c6f-54a0f7b24859 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9963fd8c-47f5-4cf9-a64d-526cc23297c1 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:33:54 devstack sudo[105000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-cef7e3c9-5317-49b5-b984-6af817c41213 Jul 22 03:33:54 devstack sudo[105000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:33:54 devstack sudo[105001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9963fd8c-47f5-4cf9-a64d-526cc23297c1 Jul 22 03:33:54 devstack sudo[105001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:33:54 devstack sudo[104997]: pam_unix(sudo:session): session closed for user root Jul 22 03:33:54 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-c99a302d-6f25-4240-a46d-20fb403c070d tempest-VolumeAndVolumeTypeFromImageTest-2121925634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d2546cf0-d274-4f16-95ed-641920edaed1 1073741824" returned: 0 in 0.581s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:33:54 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-c99a302d-6f25-4240-a46d-20fb403c070d tempest-VolumeAndVolumeTypeFromImageTest-2121925634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d2546cf0-d274-4f16-95ed-641920edaed1 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:33:54 devstack sudo[105000]: pam_unix(sudo:session): session closed for user root Jul 22 03:33:54 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-693db3f1-e349-490a-83cb-9fc4b2e260be tempest-CreateVolumesFromImageTest-284360659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-cef7e3c9-5317-49b5-b984-6af817c41213" returned: 0 in 0.468s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:33:54 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-693db3f1-e349-490a-83cb-9fc4b2e260be tempest-CreateVolumesFromImageTest-284360659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-cef7e3c9-5317-49b5-b984-6af817c41213 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:33:54 devstack sudo[105015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d2546cf0-d274-4f16-95ed-641920edaed1 Jul 22 03:33:54 devstack sudo[105015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:33:54 devstack sudo[105016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-cef7e3c9-5317-49b5-b984-6af817c41213 Jul 22 03:33:54 devstack sudo[105016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:33:54 devstack sudo[105001]: pam_unix(sudo:session): session closed for user root Jul 22 03:33:54 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ec0c43e1-17a3-4fa3-8c6f-54a0f7b24859 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9963fd8c-47f5-4cf9-a64d-526cc23297c1" returned: 0 in 0.477s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:33:54 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ec0c43e1-17a3-4fa3-8c6f-54a0f7b24859 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9963fd8c-47f5-4cf9-a64d-526cc23297c1 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:33:55 devstack sudo[105019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9963fd8c-47f5-4cf9-a64d-526cc23297c1 Jul 22 03:33:55 devstack sudo[105019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:33:55 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1cc12d1-3e8c-4edf-bdad-8d7ba53f22ae tempest-CreateVolumesFromSnapshotTest-653456616 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:33:55 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b1cc12d1-3e8c-4edf-bdad-8d7ba53f22ae tempest-CreateVolumesFromSnapshotTest-653456616 None] Flow 'volume_create_manager' (bcbb6fe2-10ea-4583-982f-68bff69e02cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:33:55 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b1cc12d1-3e8c-4edf-bdad-8d7ba53f22ae tempest-CreateVolumesFromSnapshotTest-653456616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fc07b8d-61f3-405d-a0a9-b94e106b18f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:55 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b1cc12d1-3e8c-4edf-bdad-8d7ba53f22ae tempest-CreateVolumesFromSnapshotTest-653456616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fc07b8d-61f3-405d-a0a9-b94e106b18f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:33:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1965932266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2938bf03-f997-49bb-9b54-afe1fa27b976,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6833c4588e2148bebce14bdee1aa2f26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:33:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:33:55Z,use_quota=True,user_id='e17b7acea4db4ed389586494aaaa7915',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:55 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b1cc12d1-3e8c-4edf-bdad-8d7ba53f22ae tempest-CreateVolumesFromSnapshotTest-653456616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2376f50c-7ce8-4fe5-ba81-f2387a3c78ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:55 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b1cc12d1-3e8c-4edf-bdad-8d7ba53f22ae tempest-CreateVolumesFromSnapshotTest-653456616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2376f50c-7ce8-4fe5-ba81-f2387a3c78ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:55 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b1cc12d1-3e8c-4edf-bdad-8d7ba53f22ae tempest-CreateVolumesFromSnapshotTest-653456616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94269266-8d2b-4bde-a146-096b517aaf95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:55 devstack sudo[105015]: pam_unix(sudo:session): session closed for user root Jul 22 03:33:55 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b1cc12d1-3e8c-4edf-bdad-8d7ba53f22ae tempest-CreateVolumesFromSnapshotTest-653456616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94269266-8d2b-4bde-a146-096b517aaf95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2938bf03-f997-49bb-9b54-afe1fa27b976', 'volume_name': 'volume-2938bf03-f997-49bb-9b54-afe1fa27b976', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:55 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b1cc12d1-3e8c-4edf-bdad-8d7ba53f22ae tempest-CreateVolumesFromSnapshotTest-653456616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cccdcd9b-b0b5-4ac0-ab60-bbec7093d9ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:55 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b1cc12d1-3e8c-4edf-bdad-8d7ba53f22ae tempest-CreateVolumesFromSnapshotTest-653456616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cccdcd9b-b0b5-4ac0-ab60-bbec7093d9ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:55 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b1cc12d1-3e8c-4edf-bdad-8d7ba53f22ae tempest-CreateVolumesFromSnapshotTest-653456616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c085ceb-6ece-42c9-9d84-cd2bcbdf8af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:55 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-b1cc12d1-3e8c-4edf-bdad-8d7ba53f22ae tempest-CreateVolumesFromSnapshotTest-653456616 None] Volume 2938bf03-f997-49bb-9b54-afe1fa27b976: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2938bf03-f997-49bb-9b54-afe1fa27b976', 'volume_size': 1} Jul 22 03:33:55 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b1cc12d1-3e8c-4edf-bdad-8d7ba53f22ae tempest-CreateVolumesFromSnapshotTest-653456616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:33:55 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-c99a302d-6f25-4240-a46d-20fb403c070d tempest-VolumeAndVolumeTypeFromImageTest-2121925634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d2546cf0-d274-4f16-95ed-641920edaed1" returned: 0 in 0.334s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:33:55 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-c99a302d-6f25-4240-a46d-20fb403c070d tempest-VolumeAndVolumeTypeFromImageTest-2121925634 None] <== create_volume: return (987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:33:55 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-c99a302d-6f25-4240-a46d-20fb403c070d tempest-VolumeAndVolumeTypeFromImageTest-2121925634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.993s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:33:55 devstack sudo[105016]: pam_unix(sudo:session): session closed for user root Jul 22 03:33:55 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b1cc12d1-3e8c-4edf-bdad-8d7ba53f22ae tempest-CreateVolumesFromSnapshotTest-653456616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.008s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:33:55 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-b1cc12d1-3e8c-4edf-bdad-8d7ba53f22ae tempest-CreateVolumesFromSnapshotTest-653456616 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:33:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1965932266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2938bf03-f997-49bb-9b54-afe1fa27b976,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6833c4588e2148bebce14bdee1aa2f26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:33:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:33:55Z,use_quota=True,user_id='e17b7acea4db4ed389586494aaaa7915',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:33:55 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-b1cc12d1-3e8c-4edf-bdad-8d7ba53f22ae tempest-CreateVolumesFromSnapshotTest-653456616 None] Creating volume 2938bf03-f997-49bb-9b54-afe1fa27b976 {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:33:55 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b1cc12d1-3e8c-4edf-bdad-8d7ba53f22ae tempest-CreateVolumesFromSnapshotTest-653456616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:33:55 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b1cc12d1-3e8c-4edf-bdad-8d7ba53f22ae tempest-CreateVolumesFromSnapshotTest-653456616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:33:55 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-b1cc12d1-3e8c-4edf-bdad-8d7ba53f22ae tempest-CreateVolumesFromSnapshotTest-653456616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:33:55 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-b1cc12d1-3e8c-4edf-bdad-8d7ba53f22ae tempest-CreateVolumesFromSnapshotTest-653456616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:33:55 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b1cc12d1-3e8c-4edf-bdad-8d7ba53f22ae tempest-CreateVolumesFromSnapshotTest-653456616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:33:55 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-b1cc12d1-3e8c-4edf-bdad-8d7ba53f22ae tempest-CreateVolumesFromSnapshotTest-653456616 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:33:55 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-b1cc12d1-3e8c-4edf-bdad-8d7ba53f22ae tempest-CreateVolumesFromSnapshotTest-653456616 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:33:55 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b1cc12d1-3e8c-4edf-bdad-8d7ba53f22ae tempest-CreateVolumesFromSnapshotTest-653456616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2938bf03-f997-49bb-9b54-afe1fa27b976 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:33:55 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-693db3f1-e349-490a-83cb-9fc4b2e260be tempest-CreateVolumesFromImageTest-284360659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-cef7e3c9-5317-49b5-b984-6af817c41213" returned: 0 in 0.340s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:33:55 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-693db3f1-e349-490a-83cb-9fc4b2e260be tempest-CreateVolumesFromImageTest-284360659 None] Lock "cinder-quobyte-cef7e3c9-5317-49b5-b984-6af817c41213" released by "delete_volume" :: held 0.876s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:33:55 devstack cinder-volume[87747]: DEBUG cinder.volume.volume_utils [None req-c99a302d-6f25-4240-a46d-20fb403c070d tempest-VolumeAndVolumeTypeFromImageTest-2121925634 None] Attempting download of 01288d01-5efe-42bd-84e1-f31bf79afefa ((None, [{'url': 'file:///opt/stack/data/glance/images/01288d01-5efe-42bd-84e1-f31bf79afefa', 'metadata': {}}])) to volume d2546cf0-d274-4f16-95ed-641920edaed1. {{(pid=87747) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 22 03:33:55 devstack sudo[105023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2938bf03-f997-49bb-9b54-afe1fa27b976 1073741824 Jul 22 03:33:55 devstack sudo[105023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:33:55 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-693db3f1-e349-490a-83cb-9fc4b2e260be tempest-CreateVolumesFromImageTest-284360659 None] Created reservations ['7c7aa7eb-6ea9-417e-af74-21a0965aae97', '04ab71cf-60db-4d56-91d1-4656319ccd08', 'a613d9df-355e-48a7-897b-a9f0f3894d46', '5ec54a05-13d0-4a37-922d-945278fbd181'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:33:55 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[96820742-1238-4099-acb2-d90cea8efad0]: (4, 'raw') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:33:55 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-c99a302d-6f25-4240-a46d-20fb403c070d tempest-VolumeAndVolumeTypeFromImageTest-2121925634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_01288d01-5efe-42bd-84e1-f31bf79afefa_czfu7o31 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:33:55 devstack sudo[105019]: pam_unix(sudo:session): session closed for user root Jul 22 03:33:55 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ec0c43e1-17a3-4fa3-8c6f-54a0f7b24859 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9963fd8c-47f5-4cf9-a64d-526cc23297c1" returned: 0 in 0.464s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:33:55 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-ec0c43e1-17a3-4fa3-8c6f-54a0f7b24859 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Lock "cinder-quobyte-9963fd8c-47f5-4cf9-a64d-526cc23297c1" released by "delete_volume" :: held 1.025s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:33:55 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-693db3f1-e349-490a-83cb-9fc4b2e260be tempest-CreateVolumesFromImageTest-284360659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:33:55 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-693db3f1-e349-490a-83cb-9fc4b2e260be tempest-CreateVolumesFromImageTest-284360659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:33:55 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-693db3f1-e349-490a-83cb-9fc4b2e260be tempest-CreateVolumesFromImageTest-284360659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:33:55 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-693db3f1-e349-490a-83cb-9fc4b2e260be tempest-CreateVolumesFromImageTest-284360659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:33:55 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-693db3f1-e349-490a-83cb-9fc4b2e260be tempest-CreateVolumesFromImageTest-284360659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:33:55 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-693db3f1-e349-490a-83cb-9fc4b2e260be tempest-CreateVolumesFromImageTest-284360659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:33:55 devstack sudo[105027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:33:55 devstack sudo[105027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:33:55 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-91ce6a60-3fb9-42ce-b792-1d58e4cae8b0 tempest-CreateVolumesFromSnapshotTest-653456616 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:33:55 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-91ce6a60-3fb9-42ce-b792-1d58e4cae8b0 tempest-CreateVolumesFromSnapshotTest-653456616 None] Flow 'volume_create_manager' (92c4e087-b945-40ad-9085-91881c52c5a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:33:55 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-91ce6a60-3fb9-42ce-b792-1d58e4cae8b0 tempest-CreateVolumesFromSnapshotTest-653456616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cff35bd7-acfb-4714-9418-4bf1fdf5c412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:55 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-ec0c43e1-17a3-4fa3-8c6f-54a0f7b24859 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Created reservations ['e1d18c40-63ff-4287-8d36-d07c817951b9', '9db1c0ba-2f7c-4df3-bdc9-a8bc3970848f', 'ca429c58-6885-4249-b5f0-8493d9cb04f3', '62e3966e-72f2-4625-a101-c7e6df121fa9'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:33:55 devstack sudo[105026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_01288d01-5efe-42bd-84e1-f31bf79afefa_czfu7o31 Jul 22 03:33:55 devstack sudo[105026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:33:55 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-91ce6a60-3fb9-42ce-b792-1d58e4cae8b0 tempest-CreateVolumesFromSnapshotTest-653456616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cff35bd7-acfb-4714-9418-4bf1fdf5c412) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:33:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-957186974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=804d4c1c-bd02-4cd2-9dfa-56c1a5c2b0e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6833c4588e2148bebce14bdee1aa2f26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:33:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:33:56Z,use_quota=True,user_id='e17b7acea4db4ed389586494aaaa7915',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:55 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-91ce6a60-3fb9-42ce-b792-1d58e4cae8b0 tempest-CreateVolumesFromSnapshotTest-653456616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e755bcc-67f7-4e64-b2bd-d25b60e24438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:55 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-91ce6a60-3fb9-42ce-b792-1d58e4cae8b0 tempest-CreateVolumesFromSnapshotTest-653456616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e755bcc-67f7-4e64-b2bd-d25b60e24438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:55 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-91ce6a60-3fb9-42ce-b792-1d58e4cae8b0 tempest-CreateVolumesFromSnapshotTest-653456616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e53e5de-d9af-4774-98b7-08ee1aa27c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:55 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-91ce6a60-3fb9-42ce-b792-1d58e4cae8b0 tempest-CreateVolumesFromSnapshotTest-653456616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e53e5de-d9af-4774-98b7-08ee1aa27c76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '804d4c1c-bd02-4cd2-9dfa-56c1a5c2b0e8', 'volume_name': 'volume-804d4c1c-bd02-4cd2-9dfa-56c1a5c2b0e8', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:55 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-91ce6a60-3fb9-42ce-b792-1d58e4cae8b0 tempest-CreateVolumesFromSnapshotTest-653456616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (feb7c5d3-3037-4355-b149-fbb2c62876d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:55 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-91ce6a60-3fb9-42ce-b792-1d58e4cae8b0 tempest-CreateVolumesFromSnapshotTest-653456616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (feb7c5d3-3037-4355-b149-fbb2c62876d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:55 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-91ce6a60-3fb9-42ce-b792-1d58e4cae8b0 tempest-CreateVolumesFromSnapshotTest-653456616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3482de1-1309-462c-90f6-69d6cee03738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:55 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-91ce6a60-3fb9-42ce-b792-1d58e4cae8b0 tempest-CreateVolumesFromSnapshotTest-653456616 None] Volume 804d4c1c-bd02-4cd2-9dfa-56c1a5c2b0e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-804d4c1c-bd02-4cd2-9dfa-56c1a5c2b0e8', 'volume_size': 1} Jul 22 03:33:55 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-91ce6a60-3fb9-42ce-b792-1d58e4cae8b0 tempest-CreateVolumesFromSnapshotTest-653456616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:33:55 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-ec0c43e1-17a3-4fa3-8c6f-54a0f7b24859 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:33:55 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-ec0c43e1-17a3-4fa3-8c6f-54a0f7b24859 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:33:55 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-ec0c43e1-17a3-4fa3-8c6f-54a0f7b24859 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:33:55 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-ec0c43e1-17a3-4fa3-8c6f-54a0f7b24859 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:33:55 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-ec0c43e1-17a3-4fa3-8c6f-54a0f7b24859 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:33:55 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ec0c43e1-17a3-4fa3-8c6f-54a0f7b24859 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:33:55 devstack sudo[105034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:33:55 devstack sudo[105034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:33:55 devstack sudo[105027]: pam_unix(sudo:session): session closed for user root Jul 22 03:33:55 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-693db3f1-e349-490a-83cb-9fc4b2e260be tempest-CreateVolumesFromImageTest-284360659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.355s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:33:55 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-693db3f1-e349-490a-83cb-9fc4b2e260be tempest-CreateVolumesFromImageTest-284360659 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:33:55 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-693db3f1-e349-490a-83cb-9fc4b2e260be tempest-CreateVolumesFromImageTest-284360659 None] Deleted volume successfully. Jul 22 03:33:55 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-693db3f1-e349-490a-83cb-9fc4b2e260be tempest-CreateVolumesFromImageTest-284360659 None] Lock "cinder-cef7e3c9-5317-49b5-b984-6af817c41213-delete_volume" released by "delete_volume" :: held 1.668s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:33:55 devstack sudo[105026]: pam_unix(sudo:session): session closed for user root Jul 22 03:33:55 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-c99a302d-6f25-4240-a46d-20fb403c070d tempest-VolumeAndVolumeTypeFromImageTest-2121925634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_01288d01-5efe-42bd-84e1-f31bf79afefa_czfu7o31" returned: 0 in 0.590s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:33:55 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-c99a302d-6f25-4240-a46d-20fb403c070d tempest-VolumeAndVolumeTypeFromImageTest-2121925634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_01288d01-5efe-42bd-84e1-f31bf79afefa_czfu7o31 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:33:56 devstack sudo[105023]: pam_unix(sudo:session): session closed for user root Jul 22 03:33:56 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b1cc12d1-3e8c-4edf-bdad-8d7ba53f22ae tempest-CreateVolumesFromSnapshotTest-653456616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2938bf03-f997-49bb-9b54-afe1fa27b976 1073741824" returned: 0 in 0.810s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:33:56 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b1cc12d1-3e8c-4edf-bdad-8d7ba53f22ae tempest-CreateVolumesFromSnapshotTest-653456616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2938bf03-f997-49bb-9b54-afe1fa27b976 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:33:56 devstack sudo[105038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_01288d01-5efe-42bd-84e1-f31bf79afefa_czfu7o31 Jul 22 03:33:56 devstack sudo[105038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:33:56 devstack sudo[105040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2938bf03-f997-49bb-9b54-afe1fa27b976 Jul 22 03:33:56 devstack sudo[105040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:33:56 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-07b121d4-3001-4998-873f-08526dc45e7c tempest-CreateVolumesFromSnapshotTest-653456616 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:33:56 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-07b121d4-3001-4998-873f-08526dc45e7c tempest-CreateVolumesFromSnapshotTest-653456616 None] Flow 'volume_create_manager' (107c93de-0ed0-434c-87a7-fdaa34cd01a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:33:56 devstack sudo[105034]: pam_unix(sudo:session): session closed for user root Jul 22 03:33:56 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-07b121d4-3001-4998-873f-08526dc45e7c tempest-CreateVolumesFromSnapshotTest-653456616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (570da3b7-2513-4464-afeb-3938d7db909f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:56 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ec0c43e1-17a3-4fa3-8c6f-54a0f7b24859 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.538s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:33:56 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-ec0c43e1-17a3-4fa3-8c6f-54a0f7b24859 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:33:56 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-ec0c43e1-17a3-4fa3-8c6f-54a0f7b24859 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Deleted volume successfully. Jul 22 03:33:56 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-07b121d4-3001-4998-873f-08526dc45e7c tempest-CreateVolumesFromSnapshotTest-653456616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (570da3b7-2513-4464-afeb-3938d7db909f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:33:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2052025652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21ed6243-8afd-4780-9459-f14e1b8c85ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6833c4588e2148bebce14bdee1aa2f26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:33:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:33:56Z,use_quota=True,user_id='e17b7acea4db4ed389586494aaaa7915',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:56 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-07b121d4-3001-4998-873f-08526dc45e7c tempest-CreateVolumesFromSnapshotTest-653456616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c680627f-0ab9-4305-8366-758cc0ef3614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:56 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-07b121d4-3001-4998-873f-08526dc45e7c tempest-CreateVolumesFromSnapshotTest-653456616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c680627f-0ab9-4305-8366-758cc0ef3614) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:56 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-07b121d4-3001-4998-873f-08526dc45e7c tempest-CreateVolumesFromSnapshotTest-653456616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e6902ba-dc62-4571-94ff-b3da1eaa3900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:56 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-07b121d4-3001-4998-873f-08526dc45e7c tempest-CreateVolumesFromSnapshotTest-653456616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e6902ba-dc62-4571-94ff-b3da1eaa3900) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21ed6243-8afd-4780-9459-f14e1b8c85ba', 'volume_name': 'volume-21ed6243-8afd-4780-9459-f14e1b8c85ba', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:56 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-07b121d4-3001-4998-873f-08526dc45e7c tempest-CreateVolumesFromSnapshotTest-653456616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96c11243-c0ac-40ae-8318-cc887c70df28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:56 devstack sudo[105040]: pam_unix(sudo:session): session closed for user root Jul 22 03:33:56 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-07b121d4-3001-4998-873f-08526dc45e7c tempest-CreateVolumesFromSnapshotTest-653456616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96c11243-c0ac-40ae-8318-cc887c70df28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:56 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-07b121d4-3001-4998-873f-08526dc45e7c tempest-CreateVolumesFromSnapshotTest-653456616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27cc6c02-2037-4ea0-9b9a-5de9339dee17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:56 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-07b121d4-3001-4998-873f-08526dc45e7c tempest-CreateVolumesFromSnapshotTest-653456616 None] Volume 21ed6243-8afd-4780-9459-f14e1b8c85ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21ed6243-8afd-4780-9459-f14e1b8c85ba', 'volume_size': 1} Jul 22 03:33:56 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-07b121d4-3001-4998-873f-08526dc45e7c tempest-CreateVolumesFromSnapshotTest-653456616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:33:56 devstack sudo[105038]: pam_unix(sudo:session): session closed for user root Jul 22 03:33:56 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b1cc12d1-3e8c-4edf-bdad-8d7ba53f22ae tempest-CreateVolumesFromSnapshotTest-653456616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2938bf03-f997-49bb-9b54-afe1fa27b976" returned: 0 in 0.351s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:33:56 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-b1cc12d1-3e8c-4edf-bdad-8d7ba53f22ae tempest-CreateVolumesFromSnapshotTest-653456616 None] <== create_volume: return (1225ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:33:56 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b1cc12d1-3e8c-4edf-bdad-8d7ba53f22ae tempest-CreateVolumesFromSnapshotTest-653456616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.227s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:33:56 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-91ce6a60-3fb9-42ce-b792-1d58e4cae8b0 tempest-CreateVolumesFromSnapshotTest-653456616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.729s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:33:56 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-91ce6a60-3fb9-42ce-b792-1d58e4cae8b0 tempest-CreateVolumesFromSnapshotTest-653456616 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:33:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-957186974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=804d4c1c-bd02-4cd2-9dfa-56c1a5c2b0e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6833c4588e2148bebce14bdee1aa2f26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:33:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:33:56Z,use_quota=True,user_id='e17b7acea4db4ed389586494aaaa7915',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:33:56 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-91ce6a60-3fb9-42ce-b792-1d58e4cae8b0 tempest-CreateVolumesFromSnapshotTest-653456616 None] Creating volume 804d4c1c-bd02-4cd2-9dfa-56c1a5c2b0e8 {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:33:56 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-91ce6a60-3fb9-42ce-b792-1d58e4cae8b0 tempest-CreateVolumesFromSnapshotTest-653456616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:33:56 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-91ce6a60-3fb9-42ce-b792-1d58e4cae8b0 tempest-CreateVolumesFromSnapshotTest-653456616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:33:56 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-91ce6a60-3fb9-42ce-b792-1d58e4cae8b0 tempest-CreateVolumesFromSnapshotTest-653456616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:33:56 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-91ce6a60-3fb9-42ce-b792-1d58e4cae8b0 tempest-CreateVolumesFromSnapshotTest-653456616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:33:56 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-91ce6a60-3fb9-42ce-b792-1d58e4cae8b0 tempest-CreateVolumesFromSnapshotTest-653456616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:33:56 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-91ce6a60-3fb9-42ce-b792-1d58e4cae8b0 tempest-CreateVolumesFromSnapshotTest-653456616 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:33:56 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-91ce6a60-3fb9-42ce-b792-1d58e4cae8b0 tempest-CreateVolumesFromSnapshotTest-653456616 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:33:56 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-91ce6a60-3fb9-42ce-b792-1d58e4cae8b0 tempest-CreateVolumesFromSnapshotTest-653456616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-804d4c1c-bd02-4cd2-9dfa-56c1a5c2b0e8 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:33:56 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-c99a302d-6f25-4240-a46d-20fb403c070d tempest-VolumeAndVolumeTypeFromImageTest-2121925634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_01288d01-5efe-42bd-84e1-f31bf79afefa_czfu7o31" returned: 1 in 0.510s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:33:56 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-c99a302d-6f25-4240-a46d-20fb403c070d tempest-VolumeAndVolumeTypeFromImageTest-2121925634 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_01288d01-5efe-42bd-84e1-f31bf79afefa_czfu7o31' failed. Not Retrying. {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 22 03:33:56 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a3dc80e-ab11-4b30-b3fc-5dd912984602]: (4, 'raw') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:33:56 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-ec0c43e1-17a3-4fa3-8c6f-54a0f7b24859 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Lock "cinder-9963fd8c-47f5-4cf9-a64d-526cc23297c1-delete_volume" released by "delete_volume" :: held 2.159s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:33:56 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-c99a302d-6f25-4240-a46d-20fb403c070d tempest-VolumeAndVolumeTypeFromImageTest-2121925634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_01288d01-5efe-42bd-84e1-f31bf79afefa_407ql6tpdevstack@QuobyteHD {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:33:56 devstack sudo[105047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-804d4c1c-bd02-4cd2-9dfa-56c1a5c2b0e8 1073741824 Jul 22 03:33:56 devstack sudo[105047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:33:56 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b1cc12d1-3e8c-4edf-bdad-8d7ba53f22ae tempest-CreateVolumesFromSnapshotTest-653456616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c085ceb-6ece-42c9-9d84-cd2bcbdf8af2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2938bf03-f997-49bb-9b54-afe1fa27b976', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:56 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b1cc12d1-3e8c-4edf-bdad-8d7ba53f22ae tempest-CreateVolumesFromSnapshotTest-653456616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36371280-d2e7-4346-8151-1b193d48bf5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:56 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-b1cc12d1-3e8c-4edf-bdad-8d7ba53f22ae tempest-CreateVolumesFromSnapshotTest-653456616 None] Volume volume-2938bf03-f997-49bb-9b54-afe1fa27b976 (2938bf03-f997-49bb-9b54-afe1fa27b976): created successfully Jul 22 03:33:56 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b1cc12d1-3e8c-4edf-bdad-8d7ba53f22ae tempest-CreateVolumesFromSnapshotTest-653456616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36371280-d2e7-4346-8151-1b193d48bf5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:56 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b1cc12d1-3e8c-4edf-bdad-8d7ba53f22ae tempest-CreateVolumesFromSnapshotTest-653456616 None] Flow 'volume_create_manager' (bcbb6fe2-10ea-4583-982f-68bff69e02cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:33:56 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-b1cc12d1-3e8c-4edf-bdad-8d7ba53f22ae tempest-CreateVolumesFromSnapshotTest-653456616 None] Created volume successfully. Jul 22 03:33:56 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-9d4720d3-6762-406d-b31a-a779c74ea55f tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Acquiring lock "cinder-7865afb3-06ef-41e9-8526-82b52e9bd765-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:33:56 devstack sudo[105048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_01288d01-5efe-42bd-84e1-f31bf79afefa_407ql6tpdevstack@QuobyteHD Jul 22 03:33:56 devstack sudo[105048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:33:56 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-9d4720d3-6762-406d-b31a-a779c74ea55f tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Lock "cinder-7865afb3-06ef-41e9-8526-82b52e9bd765-delete_volume" acquired by "delete_volume" :: waited 0.089s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:33:56 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4107cb3-6ec3-4be4-b858-b54fbc91c7f6 tempest-CreateVolumesFromSnapshotTest-653456616 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:33:56 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-c4107cb3-6ec3-4be4-b858-b54fbc91c7f6 tempest-CreateVolumesFromSnapshotTest-653456616 None] Flow 'volume_create_manager' (23afc053-ea52-49f3-92f4-9714fe80e096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:33:56 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-c4107cb3-6ec3-4be4-b858-b54fbc91c7f6 tempest-CreateVolumesFromSnapshotTest-653456616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (916ec2c8-ab48-4177-9a32-a030ae3518d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:56 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-9d4720d3-6762-406d-b31a-a779c74ea55f tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Acquiring lock "cinder-quobyte-7865afb3-06ef-41e9-8526-82b52e9bd765" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:33:56 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-c4107cb3-6ec3-4be4-b858-b54fbc91c7f6 tempest-CreateVolumesFromSnapshotTest-653456616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (916ec2c8-ab48-4177-9a32-a030ae3518d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:33:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2128216741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5815f9e-b0bb-4629-bb7c-64ef4f75a5f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6833c4588e2148bebce14bdee1aa2f26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:33:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:33:57Z,use_quota=True,user_id='e17b7acea4db4ed389586494aaaa7915',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:56 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-c4107cb3-6ec3-4be4-b858-b54fbc91c7f6 tempest-CreateVolumesFromSnapshotTest-653456616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be72a5c4-6e22-4191-94b6-d34fa380c3b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:56 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-c4107cb3-6ec3-4be4-b858-b54fbc91c7f6 tempest-CreateVolumesFromSnapshotTest-653456616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be72a5c4-6e22-4191-94b6-d34fa380c3b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:56 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-c4107cb3-6ec3-4be4-b858-b54fbc91c7f6 tempest-CreateVolumesFromSnapshotTest-653456616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65d689e2-af2e-4020-9f64-ec0bd5bb30ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:56 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-c4107cb3-6ec3-4be4-b858-b54fbc91c7f6 tempest-CreateVolumesFromSnapshotTest-653456616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65d689e2-af2e-4020-9f64-ec0bd5bb30ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5815f9e-b0bb-4629-bb7c-64ef4f75a5f8', 'volume_name': 'volume-e5815f9e-b0bb-4629-bb7c-64ef4f75a5f8', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:56 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-c4107cb3-6ec3-4be4-b858-b54fbc91c7f6 tempest-CreateVolumesFromSnapshotTest-653456616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba628ba1-4a11-41e3-817c-e2d320d561f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:56 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-c4107cb3-6ec3-4be4-b858-b54fbc91c7f6 tempest-CreateVolumesFromSnapshotTest-653456616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba628ba1-4a11-41e3-817c-e2d320d561f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:56 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-c4107cb3-6ec3-4be4-b858-b54fbc91c7f6 tempest-CreateVolumesFromSnapshotTest-653456616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ae0c5c7-dd04-4c6d-b3fc-5e3179656639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:56 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-c4107cb3-6ec3-4be4-b858-b54fbc91c7f6 tempest-CreateVolumesFromSnapshotTest-653456616 None] Volume e5815f9e-b0bb-4629-bb7c-64ef4f75a5f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5815f9e-b0bb-4629-bb7c-64ef4f75a5f8', 'volume_size': 1} Jul 22 03:33:56 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-c4107cb3-6ec3-4be4-b858-b54fbc91c7f6 tempest-CreateVolumesFromSnapshotTest-653456616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:33:57 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-9d4720d3-6762-406d-b31a-a779c74ea55f tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Lock "cinder-quobyte-7865afb3-06ef-41e9-8526-82b52e9bd765" acquired by "delete_volume" :: waited 0.071s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:33:57 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[4248b81d-b31e-49c1-bf58-e66286ab52ce]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:33:57 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-9d4720d3-6762-406d-b31a-a779c74ea55f tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-7865afb3-06ef-41e9-8526-82b52e9bd765 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:33:57 devstack sudo[105048]: pam_unix(sudo:session): session closed for user root Jul 22 03:33:57 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-c99a302d-6f25-4240-a46d-20fb403c070d tempest-VolumeAndVolumeTypeFromImageTest-2121925634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_01288d01-5efe-42bd-84e1-f31bf79afefa_407ql6tpdevstack@QuobyteHD" returned: 0 in 0.590s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:33:57 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-c99a302d-6f25-4240-a46d-20fb403c070d tempest-VolumeAndVolumeTypeFromImageTest-2121925634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_01288d01-5efe-42bd-84e1-f31bf79afefa_407ql6tpdevstack@QuobyteHD {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:33:57 devstack sudo[105047]: pam_unix(sudo:session): session closed for user root Jul 22 03:33:57 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-91ce6a60-3fb9-42ce-b792-1d58e4cae8b0 tempest-CreateVolumesFromSnapshotTest-653456616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-804d4c1c-bd02-4cd2-9dfa-56c1a5c2b0e8 1073741824" returned: 0 in 0.682s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:33:57 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-91ce6a60-3fb9-42ce-b792-1d58e4cae8b0 tempest-CreateVolumesFromSnapshotTest-653456616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-804d4c1c-bd02-4cd2-9dfa-56c1a5c2b0e8 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:33:57 devstack sudo[105058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_01288d01-5efe-42bd-84e1-f31bf79afefa_407ql6tpdevstack@QuobyteHD Jul 22 03:33:57 devstack sudo[105058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:33:57 devstack sudo[105059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-804d4c1c-bd02-4cd2-9dfa-56c1a5c2b0e8 Jul 22 03:33:57 devstack sudo[105059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:33:57 devstack sudo[105057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-7865afb3-06ef-41e9-8526-82b52e9bd765 Jul 22 03:33:57 devstack sudo[105057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:33:57 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-fafd6a9f-985b-40c6-b13b-765b660e1a37 tempest-CreateVolumesFromSnapshotTest-653456616 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:33:57 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-fafd6a9f-985b-40c6-b13b-765b660e1a37 tempest-CreateVolumesFromSnapshotTest-653456616 None] Flow 'volume_create_manager' (4e87ff90-ba73-4bb7-a065-201bb3a6c94e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:33:57 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-fafd6a9f-985b-40c6-b13b-765b660e1a37 tempest-CreateVolumesFromSnapshotTest-653456616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (672f3cf0-db8c-414e-9ca2-c85ac078cd30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:57 devstack sudo[105058]: pam_unix(sudo:session): session closed for user root Jul 22 03:33:57 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-fafd6a9f-985b-40c6-b13b-765b660e1a37 tempest-CreateVolumesFromSnapshotTest-653456616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (672f3cf0-db8c-414e-9ca2-c85ac078cd30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:33:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-408782472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dc92f60-e126-49f0-87f7-3093d06df955,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6833c4588e2148bebce14bdee1aa2f26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:33:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:33:57Z,use_quota=True,user_id='e17b7acea4db4ed389586494aaaa7915',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:57 devstack sudo[105057]: pam_unix(sudo:session): session closed for user root Jul 22 03:33:57 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-fafd6a9f-985b-40c6-b13b-765b660e1a37 tempest-CreateVolumesFromSnapshotTest-653456616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f7283e2-24c9-4a5c-899b-40d52e214d93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:57 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-fafd6a9f-985b-40c6-b13b-765b660e1a37 tempest-CreateVolumesFromSnapshotTest-653456616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f7283e2-24c9-4a5c-899b-40d52e214d93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:57 devstack sudo[105059]: pam_unix(sudo:session): session closed for user root Jul 22 03:33:57 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-fafd6a9f-985b-40c6-b13b-765b660e1a37 tempest-CreateVolumesFromSnapshotTest-653456616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87c17601-23a5-498b-bd55-009df9c78efa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:57 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-fafd6a9f-985b-40c6-b13b-765b660e1a37 tempest-CreateVolumesFromSnapshotTest-653456616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87c17601-23a5-498b-bd55-009df9c78efa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5dc92f60-e126-49f0-87f7-3093d06df955', 'volume_name': 'volume-5dc92f60-e126-49f0-87f7-3093d06df955', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:57 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-fafd6a9f-985b-40c6-b13b-765b660e1a37 tempest-CreateVolumesFromSnapshotTest-653456616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3851fba-4e2a-4f03-a792-8718261b3064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:57 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-fafd6a9f-985b-40c6-b13b-765b660e1a37 tempest-CreateVolumesFromSnapshotTest-653456616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3851fba-4e2a-4f03-a792-8718261b3064) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:57 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-fafd6a9f-985b-40c6-b13b-765b660e1a37 tempest-CreateVolumesFromSnapshotTest-653456616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cbbb2ba-f8cb-47d3-8fcb-03f3cddaf163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:57 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-fafd6a9f-985b-40c6-b13b-765b660e1a37 tempest-CreateVolumesFromSnapshotTest-653456616 None] Volume 5dc92f60-e126-49f0-87f7-3093d06df955: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5dc92f60-e126-49f0-87f7-3093d06df955', 'volume_size': 1} Jul 22 03:33:57 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-fafd6a9f-985b-40c6-b13b-765b660e1a37 tempest-CreateVolumesFromSnapshotTest-653456616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:33:57 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-91ce6a60-3fb9-42ce-b792-1d58e4cae8b0 tempest-CreateVolumesFromSnapshotTest-653456616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-804d4c1c-bd02-4cd2-9dfa-56c1a5c2b0e8" returned: 0 in 0.415s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:33:57 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-c99a302d-6f25-4240-a46d-20fb403c070d tempest-VolumeAndVolumeTypeFromImageTest-2121925634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_01288d01-5efe-42bd-84e1-f31bf79afefa_407ql6tpdevstack@QuobyteHD" returned: 1 in 0.542s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:33:57 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-c99a302d-6f25-4240-a46d-20fb403c070d tempest-VolumeAndVolumeTypeFromImageTest-2121925634 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_01288d01-5efe-42bd-84e1-f31bf79afefa_407ql6tpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 22 03:33:57 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-9d4720d3-6762-406d-b31a-a779c74ea55f tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-7865afb3-06ef-41e9-8526-82b52e9bd765" returned: 0 in 0.593s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:33:57 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-91ce6a60-3fb9-42ce-b792-1d58e4cae8b0 tempest-CreateVolumesFromSnapshotTest-653456616 None] <== create_volume: return (1181ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:33:57 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-91ce6a60-3fb9-42ce-b792-1d58e4cae8b0 tempest-CreateVolumesFromSnapshotTest-653456616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.184s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:33:57 devstack cinder-volume[87747]: DEBUG cinder.image.image_utils [None req-c99a302d-6f25-4240-a46d-20fb403c070d tempest-VolumeAndVolumeTypeFromImageTest-2121925634 None] 01288d01-5efe-42bd-84e1-f31bf79afefa was raw, converting to qcow2 {{(pid=87747) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 22 03:33:57 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-c99a302d-6f25-4240-a46d-20fb403c070d tempest-VolumeAndVolumeTypeFromImageTest-2121925634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_01288d01-5efe-42bd-84e1-f31bf79afefa_407ql6tpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d2546cf0-d274-4f16-95ed-641920edaed1 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:33:57 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-9d4720d3-6762-406d-b31a-a779c74ea55f tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-7865afb3-06ef-41e9-8526-82b52e9bd765 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:33:57 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-07b121d4-3001-4998-873f-08526dc45e7c tempest-CreateVolumesFromSnapshotTest-653456616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.228s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:33:57 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-07b121d4-3001-4998-873f-08526dc45e7c tempest-CreateVolumesFromSnapshotTest-653456616 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:33:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2052025652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21ed6243-8afd-4780-9459-f14e1b8c85ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6833c4588e2148bebce14bdee1aa2f26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:33:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:33:56Z,use_quota=True,user_id='e17b7acea4db4ed389586494aaaa7915',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:33:57 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-07b121d4-3001-4998-873f-08526dc45e7c tempest-CreateVolumesFromSnapshotTest-653456616 None] Creating volume 21ed6243-8afd-4780-9459-f14e1b8c85ba {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:33:57 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-07b121d4-3001-4998-873f-08526dc45e7c tempest-CreateVolumesFromSnapshotTest-653456616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:33:57 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-07b121d4-3001-4998-873f-08526dc45e7c tempest-CreateVolumesFromSnapshotTest-653456616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:33:57 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-07b121d4-3001-4998-873f-08526dc45e7c tempest-CreateVolumesFromSnapshotTest-653456616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:33:57 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-07b121d4-3001-4998-873f-08526dc45e7c tempest-CreateVolumesFromSnapshotTest-653456616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:33:57 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-07b121d4-3001-4998-873f-08526dc45e7c tempest-CreateVolumesFromSnapshotTest-653456616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:33:57 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-07b121d4-3001-4998-873f-08526dc45e7c tempest-CreateVolumesFromSnapshotTest-653456616 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:33:57 devstack sudo[105071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_01288d01-5efe-42bd-84e1-f31bf79afefa_407ql6tpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d2546cf0-d274-4f16-95ed-641920edaed1 Jul 22 03:33:57 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-07b121d4-3001-4998-873f-08526dc45e7c tempest-CreateVolumesFromSnapshotTest-653456616 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:33:57 devstack sudo[105071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:33:57 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-07b121d4-3001-4998-873f-08526dc45e7c tempest-CreateVolumesFromSnapshotTest-653456616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-21ed6243-8afd-4780-9459-f14e1b8c85ba 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:33:57 devstack sudo[105072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-7865afb3-06ef-41e9-8526-82b52e9bd765 Jul 22 03:33:57 devstack sudo[105072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:33:57 devstack sudo[105075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-21ed6243-8afd-4780-9459-f14e1b8c85ba 1073741824 Jul 22 03:33:57 devstack sudo[105075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:33:57 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-91ce6a60-3fb9-42ce-b792-1d58e4cae8b0 tempest-CreateVolumesFromSnapshotTest-653456616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3482de1-1309-462c-90f6-69d6cee03738) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-804d4c1c-bd02-4cd2-9dfa-56c1a5c2b0e8', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:57 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-91ce6a60-3fb9-42ce-b792-1d58e4cae8b0 tempest-CreateVolumesFromSnapshotTest-653456616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0bbd5a3-b0df-4bf6-856a-0dd085a4372f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:57 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-91ce6a60-3fb9-42ce-b792-1d58e4cae8b0 tempest-CreateVolumesFromSnapshotTest-653456616 None] Volume volume-804d4c1c-bd02-4cd2-9dfa-56c1a5c2b0e8 (804d4c1c-bd02-4cd2-9dfa-56c1a5c2b0e8): created successfully Jul 22 03:33:57 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-91ce6a60-3fb9-42ce-b792-1d58e4cae8b0 tempest-CreateVolumesFromSnapshotTest-653456616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0bbd5a3-b0df-4bf6-856a-0dd085a4372f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:57 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-91ce6a60-3fb9-42ce-b792-1d58e4cae8b0 tempest-CreateVolumesFromSnapshotTest-653456616 None] Flow 'volume_create_manager' (92c4e087-b945-40ad-9085-91881c52c5a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:33:57 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-91ce6a60-3fb9-42ce-b792-1d58e4cae8b0 tempest-CreateVolumesFromSnapshotTest-653456616 None] Created volume successfully. Jul 22 03:33:57 devstack sudo[105072]: pam_unix(sudo:session): session closed for user root Jul 22 03:33:57 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-9d4720d3-6762-406d-b31a-a779c74ea55f tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-7865afb3-06ef-41e9-8526-82b52e9bd765" returned: 0 in 0.322s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:33:57 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-9d4720d3-6762-406d-b31a-a779c74ea55f tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Lock "cinder-quobyte-7865afb3-06ef-41e9-8526-82b52e9bd765" released by "delete_volume" :: held 0.991s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:33:58 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-9d4720d3-6762-406d-b31a-a779c74ea55f tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Created reservations ['aae1f0d5-d016-471c-b9fc-b37970c332ea', '2bc69ee2-3984-485b-bac8-43f89081a07c', '4ba177eb-1903-4d93-b3ab-50bd2d36ffdc', '48863463-36fc-4651-a931-bce6c00f5f87'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:33:58 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-9d4720d3-6762-406d-b31a-a779c74ea55f tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:33:58 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-9d4720d3-6762-406d-b31a-a779c74ea55f tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:33:58 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-9d4720d3-6762-406d-b31a-a779c74ea55f tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:33:58 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-9d4720d3-6762-406d-b31a-a779c74ea55f tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:33:58 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-9d4720d3-6762-406d-b31a-a779c74ea55f tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:33:58 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-9d4720d3-6762-406d-b31a-a779c74ea55f tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:33:58 devstack sudo[105086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:33:58 devstack sudo[105086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:33:58 devstack sudo[105075]: pam_unix(sudo:session): session closed for user root Jul 22 03:33:58 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-07b121d4-3001-4998-873f-08526dc45e7c tempest-CreateVolumesFromSnapshotTest-653456616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-21ed6243-8afd-4780-9459-f14e1b8c85ba 1073741824" returned: 0 in 0.563s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:33:58 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-07b121d4-3001-4998-873f-08526dc45e7c tempest-CreateVolumesFromSnapshotTest-653456616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-21ed6243-8afd-4780-9459-f14e1b8c85ba {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:33:58 devstack sudo[105071]: pam_unix(sudo:session): session closed for user root Jul 22 03:33:58 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-c99a302d-6f25-4240-a46d-20fb403c070d tempest-VolumeAndVolumeTypeFromImageTest-2121925634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_01288d01-5efe-42bd-84e1-f31bf79afefa_407ql6tpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d2546cf0-d274-4f16-95ed-641920edaed1" returned: 0 in 0.675s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:33:58 devstack cinder-volume[87747]: DEBUG cinder.image.image_utils [None req-c99a302d-6f25-4240-a46d-20fb403c070d tempest-VolumeAndVolumeTypeFromImageTest-2121925634 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_01288d01-5efe-42bd-84e1-f31bf79afefa_407ql6tpdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d2546cf0-d274-4f16-95ed-641920edaed1 {{(pid=87747) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 22 03:33:58 devstack cinder-volume[87747]: INFO cinder.image.image_utils [None req-c99a302d-6f25-4240-a46d-20fb403c070d tempest-VolumeAndVolumeTypeFromImageTest-2121925634 None] Converted 0.00 MB image at 0.00 MB/s Jul 22 03:33:58 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-c99a302d-6f25-4240-a46d-20fb403c070d tempest-VolumeAndVolumeTypeFromImageTest-2121925634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d2546cf0-d274-4f16-95ed-641920edaed1 1G {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:33:58 devstack sudo[105088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-21ed6243-8afd-4780-9459-f14e1b8c85ba Jul 22 03:33:58 devstack sudo[105088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:33:58 devstack sudo[105090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d2546cf0-d274-4f16-95ed-641920edaed1 1G Jul 22 03:33:58 devstack sudo[105090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:33:58 devstack sudo[105086]: pam_unix(sudo:session): session closed for user root Jul 22 03:33:58 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-9d4720d3-6762-406d-b31a-a779c74ea55f tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.374s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:33:58 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-9d4720d3-6762-406d-b31a-a779c74ea55f tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:33:58 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-9d4720d3-6762-406d-b31a-a779c74ea55f tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Deleted volume successfully. Jul 22 03:33:58 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-9d4720d3-6762-406d-b31a-a779c74ea55f tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Lock "cinder-7865afb3-06ef-41e9-8526-82b52e9bd765-delete_volume" released by "delete_volume" :: held 1.739s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:33:58 devstack sudo[105088]: pam_unix(sudo:session): session closed for user root Jul 22 03:33:58 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-07b121d4-3001-4998-873f-08526dc45e7c tempest-CreateVolumesFromSnapshotTest-653456616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-21ed6243-8afd-4780-9459-f14e1b8c85ba" returned: 0 in 0.340s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:33:58 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-07b121d4-3001-4998-873f-08526dc45e7c tempest-CreateVolumesFromSnapshotTest-653456616 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:33:58 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-07b121d4-3001-4998-873f-08526dc45e7c tempest-CreateVolumesFromSnapshotTest-653456616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:33:58 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-c4107cb3-6ec3-4be4-b858-b54fbc91c7f6 tempest-CreateVolumesFromSnapshotTest-653456616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.657s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:33:58 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-c4107cb3-6ec3-4be4-b858-b54fbc91c7f6 tempest-CreateVolumesFromSnapshotTest-653456616 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:33:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2128216741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5815f9e-b0bb-4629-bb7c-64ef4f75a5f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6833c4588e2148bebce14bdee1aa2f26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:33:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:33:57Z,use_quota=True,user_id='e17b7acea4db4ed389586494aaaa7915',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:33:58 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-c4107cb3-6ec3-4be4-b858-b54fbc91c7f6 tempest-CreateVolumesFromSnapshotTest-653456616 None] Creating volume e5815f9e-b0bb-4629-bb7c-64ef4f75a5f8 {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:33:58 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-c4107cb3-6ec3-4be4-b858-b54fbc91c7f6 tempest-CreateVolumesFromSnapshotTest-653456616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:33:58 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-c4107cb3-6ec3-4be4-b858-b54fbc91c7f6 tempest-CreateVolumesFromSnapshotTest-653456616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:33:58 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-c4107cb3-6ec3-4be4-b858-b54fbc91c7f6 tempest-CreateVolumesFromSnapshotTest-653456616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:33:58 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-c4107cb3-6ec3-4be4-b858-b54fbc91c7f6 tempest-CreateVolumesFromSnapshotTest-653456616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:33:58 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-c4107cb3-6ec3-4be4-b858-b54fbc91c7f6 tempest-CreateVolumesFromSnapshotTest-653456616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:33:58 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-c4107cb3-6ec3-4be4-b858-b54fbc91c7f6 tempest-CreateVolumesFromSnapshotTest-653456616 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:33:58 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-c4107cb3-6ec3-4be4-b858-b54fbc91c7f6 tempest-CreateVolumesFromSnapshotTest-653456616 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:33:58 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-c4107cb3-6ec3-4be4-b858-b54fbc91c7f6 tempest-CreateVolumesFromSnapshotTest-653456616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-e5815f9e-b0bb-4629-bb7c-64ef4f75a5f8 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:33:58 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-07b121d4-3001-4998-873f-08526dc45e7c tempest-CreateVolumesFromSnapshotTest-653456616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27cc6c02-2037-4ea0-9b9a-5de9339dee17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21ed6243-8afd-4780-9459-f14e1b8c85ba', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:58 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-07b121d4-3001-4998-873f-08526dc45e7c tempest-CreateVolumesFromSnapshotTest-653456616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da141c9f-7472-4db9-966c-5fc56b6ea045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:58 devstack sudo[105098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-e5815f9e-b0bb-4629-bb7c-64ef4f75a5f8 1073741824 Jul 22 03:33:58 devstack sudo[105098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:33:58 devstack sudo[105090]: pam_unix(sudo:session): session closed for user root Jul 22 03:33:58 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-c99a302d-6f25-4240-a46d-20fb403c070d tempest-VolumeAndVolumeTypeFromImageTest-2121925634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d2546cf0-d274-4f16-95ed-641920edaed1 1G" returned: 0 in 0.382s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:33:58 devstack cinder-volume[87747]: DEBUG cinder.volume.volume_utils [None req-c99a302d-6f25-4240-a46d-20fb403c070d tempest-VolumeAndVolumeTypeFromImageTest-2121925634 None] Downloaded image 01288d01-5efe-42bd-84e1-f31bf79afefa ((None, [{'url': 'file:///opt/stack/data/glance/images/01288d01-5efe-42bd-84e1-f31bf79afefa', 'metadata': {}}])) to volume d2546cf0-d274-4f16-95ed-641920edaed1 successfully. {{(pid=87747) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 22 03:33:58 devstack cinder-volume[87747]: DEBUG cinder.image.image_utils [None req-c99a302d-6f25-4240-a46d-20fb403c070d tempest-VolumeAndVolumeTypeFromImageTest-2121925634 None] Temporary image 01288d01-5efe-42bd-84e1-f31bf79afefa for user 5daee779883841d9895756a24e625de9 is deleted. {{(pid=87747) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 22 03:33:58 devstack cinder-volume[87747]: DEBUG cinder.volume.volume_utils [None req-c99a302d-6f25-4240-a46d-20fb403c070d tempest-VolumeAndVolumeTypeFromImageTest-2121925634 None] Marking volume d2546cf0-d274-4f16-95ed-641920edaed1 as bootable. {{(pid=87747) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 22 03:33:58 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-07b121d4-3001-4998-873f-08526dc45e7c tempest-CreateVolumesFromSnapshotTest-653456616 None] Volume volume-21ed6243-8afd-4780-9459-f14e1b8c85ba (21ed6243-8afd-4780-9459-f14e1b8c85ba): created successfully Jul 22 03:33:58 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-07b121d4-3001-4998-873f-08526dc45e7c tempest-CreateVolumesFromSnapshotTest-653456616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da141c9f-7472-4db9-966c-5fc56b6ea045) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:58 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-07b121d4-3001-4998-873f-08526dc45e7c tempest-CreateVolumesFromSnapshotTest-653456616 None] Flow 'volume_create_manager' (107c93de-0ed0-434c-87a7-fdaa34cd01a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:33:58 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-07b121d4-3001-4998-873f-08526dc45e7c tempest-CreateVolumesFromSnapshotTest-653456616 None] Created volume successfully. Jul 22 03:33:58 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-c99a302d-6f25-4240-a46d-20fb403c070d tempest-VolumeAndVolumeTypeFromImageTest-2121925634 None] Copying metadata from image 01288d01-5efe-42bd-84e1-f31bf79afefa to d2546cf0-d274-4f16-95ed-641920edaed1. {{(pid=87747) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 22 03:33:58 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-c99a302d-6f25-4240-a46d-20fb403c070d tempest-VolumeAndVolumeTypeFromImageTest-2121925634 None] Creating volume glance metadata for volume d2546cf0-d274-4f16-95ed-641920edaed1 backed by image 01288d01-5efe-42bd-84e1-f31bf79afefa with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '01288d01-5efe-42bd-84e1-f31bf79afefa', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'efe7aff9794f9ffd32e8305003467d9c', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87747) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 22 03:33:58 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-c99a302d-6f25-4240-a46d-20fb403c070d tempest-VolumeAndVolumeTypeFromImageTest-2121925634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4d57d24-6244-4d79-974a-71eb7696ce54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2546cf0-d274-4f16-95ed-641920edaed1', 'volume_size': 1, 'image_id': '01288d01-5efe-42bd-84e1-f31bf79afefa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/01288d01-5efe-42bd-84e1-f31bf79afefa', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'efe7aff9794f9ffd32e8305003467d9c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '39d2d667a24048fe82d4af5857880b1c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '88ef9696b38e2aedbaf9db6474abc9c3aac39600d43c8e86a6082ecec9924ccb301670e3391fad2330bad0944aa4d22c2eb7e56b73e5005b001197e11c2faa7e', 'id': '01288d01-5efe-42bd-84e1-f31bf79afefa', 'created_at': datetime.datetime(2026, 7, 22, 1, 33, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 22, 1, 33, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/01288d01-5efe-42bd-84e1-f31bf79afefa/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:58 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-c99a302d-6f25-4240-a46d-20fb403c070d tempest-VolumeAndVolumeTypeFromImageTest-2121925634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3aa69d16-9fe0-4b8b-97d2-4ef1c9e4848c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:58 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-c99a302d-6f25-4240-a46d-20fb403c070d tempest-VolumeAndVolumeTypeFromImageTest-2121925634 None] Volume volume-d2546cf0-d274-4f16-95ed-641920edaed1 (d2546cf0-d274-4f16-95ed-641920edaed1): created successfully Jul 22 03:33:58 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-c99a302d-6f25-4240-a46d-20fb403c070d tempest-VolumeAndVolumeTypeFromImageTest-2121925634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3aa69d16-9fe0-4b8b-97d2-4ef1c9e4848c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:58 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-c99a302d-6f25-4240-a46d-20fb403c070d tempest-VolumeAndVolumeTypeFromImageTest-2121925634 None] Flow 'volume_create_manager' (33f956b3-5b51-4466-aaee-ad65627b12af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:33:58 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-c99a302d-6f25-4240-a46d-20fb403c070d tempest-VolumeAndVolumeTypeFromImageTest-2121925634 None] Created volume successfully. Jul 22 03:33:59 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-488fe8ed-0188-4e2b-9eb9-402f7399c123 tempest-VolumeAndVolumeTypeFromImageTest-2121925634 None] Acquiring lock "cinder-d2546cf0-d274-4f16-95ed-641920edaed1-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:33:59 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-488fe8ed-0188-4e2b-9eb9-402f7399c123 tempest-VolumeAndVolumeTypeFromImageTest-2121925634 None] Lock "cinder-d2546cf0-d274-4f16-95ed-641920edaed1-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:33:59 devstack sudo[105098]: pam_unix(sudo:session): session closed for user root Jul 22 03:33:59 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-c4107cb3-6ec3-4be4-b858-b54fbc91c7f6 tempest-CreateVolumesFromSnapshotTest-653456616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-e5815f9e-b0bb-4629-bb7c-64ef4f75a5f8 1073741824" returned: 0 in 0.519s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:33:59 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-b40578a8-a3a5-4ce8-bcd8-bd209b083b79 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Acquiring lock "cinder-c190d4a5-36b1-499c-8dac-47d7fee50d58-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:33:59 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-488fe8ed-0188-4e2b-9eb9-402f7399c123 tempest-VolumeAndVolumeTypeFromImageTest-2121925634 None] Acquiring lock "cinder-quobyte-d2546cf0-d274-4f16-95ed-641920edaed1" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:33:59 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-b40578a8-a3a5-4ce8-bcd8-bd209b083b79 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Lock "cinder-c190d4a5-36b1-499c-8dac-47d7fee50d58-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:33:59 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-c4107cb3-6ec3-4be4-b858-b54fbc91c7f6 tempest-CreateVolumesFromSnapshotTest-653456616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-e5815f9e-b0bb-4629-bb7c-64ef4f75a5f8 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:33:59 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-488fe8ed-0188-4e2b-9eb9-402f7399c123 tempest-VolumeAndVolumeTypeFromImageTest-2121925634 None] Lock "cinder-quobyte-d2546cf0-d274-4f16-95ed-641920edaed1" acquired by "delete_volume" :: waited 0.049s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:33:59 devstack sudo[105106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-e5815f9e-b0bb-4629-bb7c-64ef4f75a5f8 Jul 22 03:33:59 devstack sudo[105106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:33:59 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab37784d-64b7-4362-b4b2-5b90c4dea4e2]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:33:59 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-488fe8ed-0188-4e2b-9eb9-402f7399c123 tempest-VolumeAndVolumeTypeFromImageTest-2121925634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d2546cf0-d274-4f16-95ed-641920edaed1 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:33:59 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-b40578a8-a3a5-4ce8-bcd8-bd209b083b79 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Acquiring lock "cinder-quobyte-c190d4a5-36b1-499c-8dac-47d7fee50d58" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:33:59 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-b40578a8-a3a5-4ce8-bcd8-bd209b083b79 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Lock "cinder-quobyte-c190d4a5-36b1-499c-8dac-47d7fee50d58" acquired by "delete_volume" :: waited 0.015s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:33:59 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f599b28-f4e8-494b-91bc-e3ae3aca7e42]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:33:59 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b40578a8-a3a5-4ce8-bcd8-bd209b083b79 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c190d4a5-36b1-499c-8dac-47d7fee50d58 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:33:59 devstack sudo[105108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d2546cf0-d274-4f16-95ed-641920edaed1 Jul 22 03:33:59 devstack sudo[105108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:33:59 devstack sudo[105109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c190d4a5-36b1-499c-8dac-47d7fee50d58 Jul 22 03:33:59 devstack sudo[105109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:33:59 devstack sudo[105106]: pam_unix(sudo:session): session closed for user root Jul 22 03:33:59 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-c4107cb3-6ec3-4be4-b858-b54fbc91c7f6 tempest-CreateVolumesFromSnapshotTest-653456616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-e5815f9e-b0bb-4629-bb7c-64ef4f75a5f8" returned: 0 in 0.340s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:33:59 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-c4107cb3-6ec3-4be4-b858-b54fbc91c7f6 tempest-CreateVolumesFromSnapshotTest-653456616 None] <== create_volume: return (950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:33:59 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-c4107cb3-6ec3-4be4-b858-b54fbc91c7f6 tempest-CreateVolumesFromSnapshotTest-653456616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:33:59 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-fafd6a9f-985b-40c6-b13b-765b660e1a37 tempest-CreateVolumesFromSnapshotTest-653456616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.979s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:33:59 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-fafd6a9f-985b-40c6-b13b-765b660e1a37 tempest-CreateVolumesFromSnapshotTest-653456616 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:33:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-408782472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dc92f60-e126-49f0-87f7-3093d06df955,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6833c4588e2148bebce14bdee1aa2f26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:33:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:33:57Z,use_quota=True,user_id='e17b7acea4db4ed389586494aaaa7915',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:33:59 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-fafd6a9f-985b-40c6-b13b-765b660e1a37 tempest-CreateVolumesFromSnapshotTest-653456616 None] Creating volume 5dc92f60-e126-49f0-87f7-3093d06df955 {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:33:59 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-fafd6a9f-985b-40c6-b13b-765b660e1a37 tempest-CreateVolumesFromSnapshotTest-653456616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:33:59 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-fafd6a9f-985b-40c6-b13b-765b660e1a37 tempest-CreateVolumesFromSnapshotTest-653456616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:33:59 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-fafd6a9f-985b-40c6-b13b-765b660e1a37 tempest-CreateVolumesFromSnapshotTest-653456616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:33:59 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-fafd6a9f-985b-40c6-b13b-765b660e1a37 tempest-CreateVolumesFromSnapshotTest-653456616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:33:59 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-fafd6a9f-985b-40c6-b13b-765b660e1a37 tempest-CreateVolumesFromSnapshotTest-653456616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:33:59 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-fafd6a9f-985b-40c6-b13b-765b660e1a37 tempest-CreateVolumesFromSnapshotTest-653456616 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:33:59 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-fafd6a9f-985b-40c6-b13b-765b660e1a37 tempest-CreateVolumesFromSnapshotTest-653456616 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:33:59 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-fafd6a9f-985b-40c6-b13b-765b660e1a37 tempest-CreateVolumesFromSnapshotTest-653456616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-5dc92f60-e126-49f0-87f7-3093d06df955 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:33:59 devstack sudo[105113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-5dc92f60-e126-49f0-87f7-3093d06df955 1073741824 Jul 22 03:33:59 devstack sudo[105113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:33:59 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-c4107cb3-6ec3-4be4-b858-b54fbc91c7f6 tempest-CreateVolumesFromSnapshotTest-653456616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ae0c5c7-dd04-4c6d-b3fc-5e3179656639) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5815f9e-b0bb-4629-bb7c-64ef4f75a5f8', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:59 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-c4107cb3-6ec3-4be4-b858-b54fbc91c7f6 tempest-CreateVolumesFromSnapshotTest-653456616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7817b1a9-0dd8-4291-9be9-6c16e81252b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:33:59 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-c4107cb3-6ec3-4be4-b858-b54fbc91c7f6 tempest-CreateVolumesFromSnapshotTest-653456616 None] Volume volume-e5815f9e-b0bb-4629-bb7c-64ef4f75a5f8 (e5815f9e-b0bb-4629-bb7c-64ef4f75a5f8): created successfully Jul 22 03:33:59 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-c4107cb3-6ec3-4be4-b858-b54fbc91c7f6 tempest-CreateVolumesFromSnapshotTest-653456616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7817b1a9-0dd8-4291-9be9-6c16e81252b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:33:59 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-c4107cb3-6ec3-4be4-b858-b54fbc91c7f6 tempest-CreateVolumesFromSnapshotTest-653456616 None] Flow 'volume_create_manager' (23afc053-ea52-49f3-92f4-9714fe80e096) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:33:59 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-c4107cb3-6ec3-4be4-b858-b54fbc91c7f6 tempest-CreateVolumesFromSnapshotTest-653456616 None] Created volume successfully. Jul 22 03:33:59 devstack sudo[105108]: pam_unix(sudo:session): session closed for user root Jul 22 03:33:59 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-488fe8ed-0188-4e2b-9eb9-402f7399c123 tempest-VolumeAndVolumeTypeFromImageTest-2121925634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d2546cf0-d274-4f16-95ed-641920edaed1" returned: 0 in 0.500s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:33:59 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-488fe8ed-0188-4e2b-9eb9-402f7399c123 tempest-VolumeAndVolumeTypeFromImageTest-2121925634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d2546cf0-d274-4f16-95ed-641920edaed1 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:33:59 devstack sudo[105109]: pam_unix(sudo:session): session closed for user root Jul 22 03:33:59 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b40578a8-a3a5-4ce8-bcd8-bd209b083b79 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c190d4a5-36b1-499c-8dac-47d7fee50d58" returned: 0 in 0.450s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:33:59 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b40578a8-a3a5-4ce8-bcd8-bd209b083b79 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c190d4a5-36b1-499c-8dac-47d7fee50d58 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:33:59 devstack sudo[105121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d2546cf0-d274-4f16-95ed-641920edaed1 Jul 22 03:33:59 devstack sudo[105121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:33:59 devstack sudo[105122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c190d4a5-36b1-499c-8dac-47d7fee50d58 Jul 22 03:33:59 devstack sudo[105122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:00 devstack sudo[105121]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:00 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-488fe8ed-0188-4e2b-9eb9-402f7399c123 tempest-VolumeAndVolumeTypeFromImageTest-2121925634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d2546cf0-d274-4f16-95ed-641920edaed1" returned: 0 in 0.309s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:00 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-488fe8ed-0188-4e2b-9eb9-402f7399c123 tempest-VolumeAndVolumeTypeFromImageTest-2121925634 None] Lock "cinder-quobyte-d2546cf0-d274-4f16-95ed-641920edaed1" released by "delete_volume" :: held 0.868s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:34:00 devstack sudo[105122]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:00 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b40578a8-a3a5-4ce8-bcd8-bd209b083b79 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c190d4a5-36b1-499c-8dac-47d7fee50d58" returned: 0 in 0.339s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:00 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-b40578a8-a3a5-4ce8-bcd8-bd209b083b79 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Lock "cinder-quobyte-c190d4a5-36b1-499c-8dac-47d7fee50d58" released by "delete_volume" :: held 0.832s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:34:00 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-488fe8ed-0188-4e2b-9eb9-402f7399c123 tempest-VolumeAndVolumeTypeFromImageTest-2121925634 None] Created reservations ['2e43e2cf-7f97-466b-ab44-0e2edc8d8fdc', 'efe4db1a-b460-48de-b69b-b4ee60655035', '0471833d-b1b8-47d3-a4ee-09d77beb4d33', 'a01e55e5-b1ba-4124-a68a-8b2532c7d889'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:34:00 devstack sudo[105113]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:00 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-fafd6a9f-985b-40c6-b13b-765b660e1a37 tempest-CreateVolumesFromSnapshotTest-653456616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-5dc92f60-e126-49f0-87f7-3093d06df955 1073741824" returned: 0 in 0.638s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:00 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-b40578a8-a3a5-4ce8-bcd8-bd209b083b79 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Created reservations ['e4a92d73-fc0b-445c-90d7-e8666785d853', '53e1bcd0-bf4b-48ec-ba4b-835c4e0d86d0', '480edc7c-81b1-457c-a9ed-418f03f50eb4', '6dd04d5f-884e-4316-88ac-4e0451b5e50b'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:34:00 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-fafd6a9f-985b-40c6-b13b-765b660e1a37 tempest-CreateVolumesFromSnapshotTest-653456616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-5dc92f60-e126-49f0-87f7-3093d06df955 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:00 devstack sudo[105131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-5dc92f60-e126-49f0-87f7-3093d06df955 Jul 22 03:34:00 devstack sudo[105131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:00 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-488fe8ed-0188-4e2b-9eb9-402f7399c123 tempest-VolumeAndVolumeTypeFromImageTest-2121925634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:34:00 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-488fe8ed-0188-4e2b-9eb9-402f7399c123 tempest-VolumeAndVolumeTypeFromImageTest-2121925634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:34:00 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-488fe8ed-0188-4e2b-9eb9-402f7399c123 tempest-VolumeAndVolumeTypeFromImageTest-2121925634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:34:00 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-488fe8ed-0188-4e2b-9eb9-402f7399c123 tempest-VolumeAndVolumeTypeFromImageTest-2121925634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:34:00 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-488fe8ed-0188-4e2b-9eb9-402f7399c123 tempest-VolumeAndVolumeTypeFromImageTest-2121925634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:34:00 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-488fe8ed-0188-4e2b-9eb9-402f7399c123 tempest-VolumeAndVolumeTypeFromImageTest-2121925634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:00 devstack sudo[105133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:34:00 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-ad882aa3-8db2-4541-9d43-1388e49df7bd tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Acquiring lock "cinder-0d76001a-dc81-4d48-bd7c-d878406c1632-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:34:00 devstack sudo[105133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:00 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab74f6a7-75ef-40f7-846f-831d163498ee tempest-VolumeDependencyTests-1653473485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:34:00 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-ab74f6a7-75ef-40f7-846f-831d163498ee tempest-VolumeDependencyTests-1653473485 None] Flow 'volume_create_manager' (e7468845-836d-429c-a4d6-041797436b13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:34:00 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-ab74f6a7-75ef-40f7-846f-831d163498ee tempest-VolumeDependencyTests-1653473485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8533102d-f312-4bf2-a74d-5f94f571e2a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:34:00 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b40578a8-a3a5-4ce8-bcd8-bd209b083b79 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:34:00 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b40578a8-a3a5-4ce8-bcd8-bd209b083b79 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:34:00 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-b40578a8-a3a5-4ce8-bcd8-bd209b083b79 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:34:00 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-b40578a8-a3a5-4ce8-bcd8-bd209b083b79 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:34:00 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b40578a8-a3a5-4ce8-bcd8-bd209b083b79 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:34:00 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b40578a8-a3a5-4ce8-bcd8-bd209b083b79 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:00 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-ad882aa3-8db2-4541-9d43-1388e49df7bd tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Lock "cinder-0d76001a-dc81-4d48-bd7c-d878406c1632-delete_volume" acquired by "delete_volume" :: waited 0.098s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:34:00 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-ab74f6a7-75ef-40f7-846f-831d163498ee tempest-VolumeDependencyTests-1653473485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8533102d-f312-4bf2-a74d-5f94f571e2a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:34:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1203598069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=beea5fb1-e4c7-4d97-bdfb-fb034d108c44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af07ecf7688d46c09864159ed453318c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:34:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:34:00Z,use_quota=True,user_id='be53e3148be34bb8859d6e39306b974c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:34:00 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-ab74f6a7-75ef-40f7-846f-831d163498ee tempest-VolumeDependencyTests-1653473485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba88ab52-69f6-452b-b1d3-120af71aa27c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:34:00 devstack sudo[105135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:34:00 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-ab74f6a7-75ef-40f7-846f-831d163498ee tempest-VolumeDependencyTests-1653473485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba88ab52-69f6-452b-b1d3-120af71aa27c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:34:00 devstack sudo[105135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:00 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-ab74f6a7-75ef-40f7-846f-831d163498ee tempest-VolumeDependencyTests-1653473485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11c1ef3d-4f8c-427d-a749-f87275199f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:34:00 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-ab74f6a7-75ef-40f7-846f-831d163498ee tempest-VolumeDependencyTests-1653473485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11c1ef3d-4f8c-427d-a749-f87275199f44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'beea5fb1-e4c7-4d97-bdfb-fb034d108c44', 'volume_name': 'volume-beea5fb1-e4c7-4d97-bdfb-fb034d108c44', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:34:00 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-ab74f6a7-75ef-40f7-846f-831d163498ee tempest-VolumeDependencyTests-1653473485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4f3b614-7dce-421c-9204-dfb793c5597d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:34:00 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-ab74f6a7-75ef-40f7-846f-831d163498ee tempest-VolumeDependencyTests-1653473485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4f3b614-7dce-421c-9204-dfb793c5597d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:34:00 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-ab74f6a7-75ef-40f7-846f-831d163498ee tempest-VolumeDependencyTests-1653473485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc6c6bdb-8e30-4440-a105-a38652842ee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:34:00 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-ab74f6a7-75ef-40f7-846f-831d163498ee tempest-VolumeDependencyTests-1653473485 None] Volume beea5fb1-e4c7-4d97-bdfb-fb034d108c44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-beea5fb1-e4c7-4d97-bdfb-fb034d108c44', 'volume_size': 1} Jul 22 03:34:00 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-ab74f6a7-75ef-40f7-846f-831d163498ee tempest-VolumeDependencyTests-1653473485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:34:00 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-ad882aa3-8db2-4541-9d43-1388e49df7bd tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Acquiring lock "cinder-quobyte-0d76001a-dc81-4d48-bd7c-d878406c1632" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:34:00 devstack sudo[105131]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:00 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-fafd6a9f-985b-40c6-b13b-765b660e1a37 tempest-CreateVolumesFromSnapshotTest-653456616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-5dc92f60-e126-49f0-87f7-3093d06df955" returned: 0 in 0.337s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:00 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-fafd6a9f-985b-40c6-b13b-765b660e1a37 tempest-CreateVolumesFromSnapshotTest-653456616 None] <== create_volume: return (1049ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:34:00 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-fafd6a9f-985b-40c6-b13b-765b660e1a37 tempest-CreateVolumesFromSnapshotTest-653456616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.055s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:34:00 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-ab74f6a7-75ef-40f7-846f-831d163498ee tempest-VolumeDependencyTests-1653473485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.072s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:34:00 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-ab74f6a7-75ef-40f7-846f-831d163498ee tempest-VolumeDependencyTests-1653473485 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:34:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1203598069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=beea5fb1-e4c7-4d97-bdfb-fb034d108c44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af07ecf7688d46c09864159ed453318c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:34:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:34:00Z,use_quota=True,user_id='be53e3148be34bb8859d6e39306b974c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:34:00 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-ab74f6a7-75ef-40f7-846f-831d163498ee tempest-VolumeDependencyTests-1653473485 None] Creating volume beea5fb1-e4c7-4d97-bdfb-fb034d108c44 {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:34:00 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-ab74f6a7-75ef-40f7-846f-831d163498ee tempest-VolumeDependencyTests-1653473485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:34:00 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-ab74f6a7-75ef-40f7-846f-831d163498ee tempest-VolumeDependencyTests-1653473485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:34:00 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-ab74f6a7-75ef-40f7-846f-831d163498ee tempest-VolumeDependencyTests-1653473485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:34:00 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-ab74f6a7-75ef-40f7-846f-831d163498ee tempest-VolumeDependencyTests-1653473485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:34:00 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-ab74f6a7-75ef-40f7-846f-831d163498ee tempest-VolumeDependencyTests-1653473485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:34:00 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-ab74f6a7-75ef-40f7-846f-831d163498ee tempest-VolumeDependencyTests-1653473485 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:34:00 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-ab74f6a7-75ef-40f7-846f-831d163498ee tempest-VolumeDependencyTests-1653473485 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:34:00 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ab74f6a7-75ef-40f7-846f-831d163498ee tempest-VolumeDependencyTests-1653473485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-beea5fb1-e4c7-4d97-bdfb-fb034d108c44 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:00 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-ad882aa3-8db2-4541-9d43-1388e49df7bd tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Lock "cinder-quobyte-0d76001a-dc81-4d48-bd7c-d878406c1632" acquired by "delete_volume" :: waited 0.069s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:34:00 devstack sudo[105139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-beea5fb1-e4c7-4d97-bdfb-fb034d108c44 1073741824 Jul 22 03:34:00 devstack sudo[105139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:00 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-fafd6a9f-985b-40c6-b13b-765b660e1a37 tempest-CreateVolumesFromSnapshotTest-653456616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cbbb2ba-f8cb-47d3-8fcb-03f3cddaf163) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5dc92f60-e126-49f0-87f7-3093d06df955', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:34:00 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-fafd6a9f-985b-40c6-b13b-765b660e1a37 tempest-CreateVolumesFromSnapshotTest-653456616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a94e216f-abd5-4409-a7a1-2024be0b510e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:34:00 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[067b2f20-42b1-46eb-8d74-5e58902e6acb]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:34:00 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ad882aa3-8db2-4541-9d43-1388e49df7bd tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0d76001a-dc81-4d48-bd7c-d878406c1632 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:00 devstack sudo[105133]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:00 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-488fe8ed-0188-4e2b-9eb9-402f7399c123 tempest-VolumeAndVolumeTypeFromImageTest-2121925634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.388s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:00 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-488fe8ed-0188-4e2b-9eb9-402f7399c123 tempest-VolumeAndVolumeTypeFromImageTest-2121925634 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:34:00 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-488fe8ed-0188-4e2b-9eb9-402f7399c123 tempest-VolumeAndVolumeTypeFromImageTest-2121925634 None] Deleted volume successfully. Jul 22 03:34:00 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-fafd6a9f-985b-40c6-b13b-765b660e1a37 tempest-CreateVolumesFromSnapshotTest-653456616 None] Volume volume-5dc92f60-e126-49f0-87f7-3093d06df955 (5dc92f60-e126-49f0-87f7-3093d06df955): created successfully Jul 22 03:34:00 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-fafd6a9f-985b-40c6-b13b-765b660e1a37 tempest-CreateVolumesFromSnapshotTest-653456616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a94e216f-abd5-4409-a7a1-2024be0b510e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:34:00 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-fafd6a9f-985b-40c6-b13b-765b660e1a37 tempest-CreateVolumesFromSnapshotTest-653456616 None] Flow 'volume_create_manager' (4e87ff90-ba73-4bb7-a065-201bb3a6c94e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:34:00 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-fafd6a9f-985b-40c6-b13b-765b660e1a37 tempest-CreateVolumesFromSnapshotTest-653456616 None] Created volume successfully. Jul 22 03:34:00 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-488fe8ed-0188-4e2b-9eb9-402f7399c123 tempest-VolumeAndVolumeTypeFromImageTest-2121925634 None] Lock "cinder-d2546cf0-d274-4f16-95ed-641920edaed1-delete_volume" released by "delete_volume" :: held 1.690s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:34:00 devstack sudo[105135]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:00 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b40578a8-a3a5-4ce8-bcd8-bd209b083b79 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.373s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:00 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-b40578a8-a3a5-4ce8-bcd8-bd209b083b79 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:34:00 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-b40578a8-a3a5-4ce8-bcd8-bd209b083b79 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Deleted volume successfully. Jul 22 03:34:00 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-b40578a8-a3a5-4ce8-bcd8-bd209b083b79 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Lock "cinder-c190d4a5-36b1-499c-8dac-47d7fee50d58-delete_volume" released by "delete_volume" :: held 1.670s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:34:00 devstack sudo[105141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0d76001a-dc81-4d48-bd7c-d878406c1632 Jul 22 03:34:00 devstack sudo[105141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:00 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-4582200c-b818-403b-9beb-b3f0e48a02d8 tempest-CreateVolumesFromSnapshotTest-653456616 None] Acquiring lock "cinder-5dc92f60-e126-49f0-87f7-3093d06df955-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:34:01 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-4582200c-b818-403b-9beb-b3f0e48a02d8 tempest-CreateVolumesFromSnapshotTest-653456616 None] Lock "cinder-5dc92f60-e126-49f0-87f7-3093d06df955-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:34:01 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-4582200c-b818-403b-9beb-b3f0e48a02d8 tempest-CreateVolumesFromSnapshotTest-653456616 None] Acquiring lock "cinder-quobyte-5dc92f60-e126-49f0-87f7-3093d06df955" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:34:01 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-4582200c-b818-403b-9beb-b3f0e48a02d8 tempest-CreateVolumesFromSnapshotTest-653456616 None] Lock "cinder-quobyte-5dc92f60-e126-49f0-87f7-3093d06df955" acquired by "delete_volume" :: waited 0.023s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:34:01 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dea8f05-bcb0-4c7c-8874-ab2c9321ce5b]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:34:01 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-4582200c-b818-403b-9beb-b3f0e48a02d8 tempest-CreateVolumesFromSnapshotTest-653456616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-5dc92f60-e126-49f0-87f7-3093d06df955 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:01 devstack sudo[105139]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:01 devstack sudo[105148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-5dc92f60-e126-49f0-87f7-3093d06df955 Jul 22 03:34:01 devstack sudo[105148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:01 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ab74f6a7-75ef-40f7-846f-831d163498ee tempest-VolumeDependencyTests-1653473485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-beea5fb1-e4c7-4d97-bdfb-fb034d108c44 1073741824" returned: 0 in 0.533s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:01 devstack sudo[105141]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:01 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ad882aa3-8db2-4541-9d43-1388e49df7bd tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0d76001a-dc81-4d48-bd7c-d878406c1632" returned: 0 in 0.470s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:01 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ad882aa3-8db2-4541-9d43-1388e49df7bd tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0d76001a-dc81-4d48-bd7c-d878406c1632 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:01 devstack sudo[105153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0d76001a-dc81-4d48-bd7c-d878406c1632 Jul 22 03:34:01 devstack sudo[105153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:01 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ab74f6a7-75ef-40f7-846f-831d163498ee tempest-VolumeDependencyTests-1653473485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-beea5fb1-e4c7-4d97-bdfb-fb034d108c44 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:01 devstack sudo[105155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-beea5fb1-e4c7-4d97-bdfb-fb034d108c44 Jul 22 03:34:01 devstack sudo[105155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:01 devstack sudo[105153]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:01 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ad882aa3-8db2-4541-9d43-1388e49df7bd tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0d76001a-dc81-4d48-bd7c-d878406c1632" returned: 0 in 0.278s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:01 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-ad882aa3-8db2-4541-9d43-1388e49df7bd tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Lock "cinder-quobyte-0d76001a-dc81-4d48-bd7c-d878406c1632" released by "delete_volume" :: held 0.827s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:34:01 devstack sudo[105148]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:01 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-4582200c-b818-403b-9beb-b3f0e48a02d8 tempest-CreateVolumesFromSnapshotTest-653456616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-5dc92f60-e126-49f0-87f7-3093d06df955" returned: 0 in 0.464s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:01 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-4582200c-b818-403b-9beb-b3f0e48a02d8 tempest-CreateVolumesFromSnapshotTest-653456616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-5dc92f60-e126-49f0-87f7-3093d06df955 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:01 devstack sudo[105155]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:01 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ab74f6a7-75ef-40f7-846f-831d163498ee tempest-VolumeDependencyTests-1653473485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-beea5fb1-e4c7-4d97-bdfb-fb034d108c44" returned: 0 in 0.312s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:01 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-ab74f6a7-75ef-40f7-846f-831d163498ee tempest-VolumeDependencyTests-1653473485 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:34:01 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-ab74f6a7-75ef-40f7-846f-831d163498ee tempest-VolumeDependencyTests-1653473485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:34:01 devstack sudo[105162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-5dc92f60-e126-49f0-87f7-3093d06df955 Jul 22 03:34:01 devstack sudo[105162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:01 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-ab74f6a7-75ef-40f7-846f-831d163498ee tempest-VolumeDependencyTests-1653473485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc6c6bdb-8e30-4440-a105-a38652842ee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-beea5fb1-e4c7-4d97-bdfb-fb034d108c44', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:34:01 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-ab74f6a7-75ef-40f7-846f-831d163498ee tempest-VolumeDependencyTests-1653473485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c03865f-a977-4bb8-932f-1e200e998aa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:34:01 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-ab74f6a7-75ef-40f7-846f-831d163498ee tempest-VolumeDependencyTests-1653473485 None] Volume volume-beea5fb1-e4c7-4d97-bdfb-fb034d108c44 (beea5fb1-e4c7-4d97-bdfb-fb034d108c44): created successfully Jul 22 03:34:01 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-ab74f6a7-75ef-40f7-846f-831d163498ee tempest-VolumeDependencyTests-1653473485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c03865f-a977-4bb8-932f-1e200e998aa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:34:01 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-ab74f6a7-75ef-40f7-846f-831d163498ee tempest-VolumeDependencyTests-1653473485 None] Flow 'volume_create_manager' (e7468845-836d-429c-a4d6-041797436b13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:34:01 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-ad882aa3-8db2-4541-9d43-1388e49df7bd tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Created reservations ['a942c1f6-2d99-4a79-b645-1a4c01acbdeb', 'fc9f9653-69e0-49ba-80d1-99effd311d3a', '45a1cbdf-f62d-490f-bce6-728449ad253a', '0cf46ec5-24fc-4d39-9d7a-2a38561e13ea'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:34:01 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-ab74f6a7-75ef-40f7-846f-831d163498ee tempest-VolumeDependencyTests-1653473485 None] Created volume successfully. Jul 22 03:34:01 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-ad882aa3-8db2-4541-9d43-1388e49df7bd tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:34:01 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-ad882aa3-8db2-4541-9d43-1388e49df7bd tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:34:01 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-ad882aa3-8db2-4541-9d43-1388e49df7bd tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:34:01 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-ad882aa3-8db2-4541-9d43-1388e49df7bd tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:34:01 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-ad882aa3-8db2-4541-9d43-1388e49df7bd tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:34:01 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ad882aa3-8db2-4541-9d43-1388e49df7bd tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:01 devstack sudo[105164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:34:01 devstack sudo[105164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:01 devstack sudo[105162]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:01 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-4582200c-b818-403b-9beb-b3f0e48a02d8 tempest-CreateVolumesFromSnapshotTest-653456616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-5dc92f60-e126-49f0-87f7-3093d06df955" returned: 0 in 0.278s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:01 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-4582200c-b818-403b-9beb-b3f0e48a02d8 tempest-CreateVolumesFromSnapshotTest-653456616 None] Lock "cinder-quobyte-5dc92f60-e126-49f0-87f7-3093d06df955" released by "delete_volume" :: held 0.784s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:34:01 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-4582200c-b818-403b-9beb-b3f0e48a02d8 tempest-CreateVolumesFromSnapshotTest-653456616 None] Created reservations ['e3941266-aae0-4b34-98cf-2e00c1f152cf', '9a59e0dd-ba22-4c87-bc71-d19d04aec55a', 'f48c2107-b7dd-467f-8b3c-9b691d4a6da8', 'e3d3f99a-a2fe-424d-962f-f468f86ae242'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:34:01 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-4582200c-b818-403b-9beb-b3f0e48a02d8 tempest-CreateVolumesFromSnapshotTest-653456616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:34:01 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-4582200c-b818-403b-9beb-b3f0e48a02d8 tempest-CreateVolumesFromSnapshotTest-653456616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:34:01 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-4582200c-b818-403b-9beb-b3f0e48a02d8 tempest-CreateVolumesFromSnapshotTest-653456616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:34:01 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-4582200c-b818-403b-9beb-b3f0e48a02d8 tempest-CreateVolumesFromSnapshotTest-653456616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:34:01 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-4582200c-b818-403b-9beb-b3f0e48a02d8 tempest-CreateVolumesFromSnapshotTest-653456616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:34:01 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-4582200c-b818-403b-9beb-b3f0e48a02d8 tempest-CreateVolumesFromSnapshotTest-653456616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:02 devstack sudo[105168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:34:02 devstack sudo[105168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:02 devstack sudo[105164]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:02 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ad882aa3-8db2-4541-9d43-1388e49df7bd tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.280s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:02 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-ad882aa3-8db2-4541-9d43-1388e49df7bd tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:34:02 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-ad882aa3-8db2-4541-9d43-1388e49df7bd tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Deleted volume successfully. Jul 22 03:34:02 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-ad882aa3-8db2-4541-9d43-1388e49df7bd tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Lock "cinder-0d76001a-dc81-4d48-bd7c-d878406c1632-delete_volume" released by "delete_volume" :: held 1.522s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:34:02 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-398b42dc-4616-4ae6-9c3a-3045e5d99b45 tempest-CreateVolumesFromSnapshotTest-653456616 None] Acquiring lock "cinder-e5815f9e-b0bb-4629-bb7c-64ef4f75a5f8-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:34:02 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-398b42dc-4616-4ae6-9c3a-3045e5d99b45 tempest-CreateVolumesFromSnapshotTest-653456616 None] Lock "cinder-e5815f9e-b0bb-4629-bb7c-64ef4f75a5f8-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:34:02 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-398b42dc-4616-4ae6-9c3a-3045e5d99b45 tempest-CreateVolumesFromSnapshotTest-653456616 None] Acquiring lock "cinder-quobyte-e5815f9e-b0bb-4629-bb7c-64ef4f75a5f8" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:34:02 devstack sudo[105168]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:02 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-398b42dc-4616-4ae6-9c3a-3045e5d99b45 tempest-CreateVolumesFromSnapshotTest-653456616 None] Lock "cinder-quobyte-e5815f9e-b0bb-4629-bb7c-64ef4f75a5f8" acquired by "delete_volume" :: waited 0.021s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:34:02 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-4582200c-b818-403b-9beb-b3f0e48a02d8 tempest-CreateVolumesFromSnapshotTest-653456616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.285s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:02 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-4582200c-b818-403b-9beb-b3f0e48a02d8 tempest-CreateVolumesFromSnapshotTest-653456616 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:34:02 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-4582200c-b818-403b-9beb-b3f0e48a02d8 tempest-CreateVolumesFromSnapshotTest-653456616 None] Deleted volume successfully. Jul 22 03:34:02 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5159ae7-0c4e-4c68-b1dd-d9a6b07dddac]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:34:02 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-398b42dc-4616-4ae6-9c3a-3045e5d99b45 tempest-CreateVolumesFromSnapshotTest-653456616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-e5815f9e-b0bb-4629-bb7c-64ef4f75a5f8 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:02 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-4582200c-b818-403b-9beb-b3f0e48a02d8 tempest-CreateVolumesFromSnapshotTest-653456616 None] Lock "cinder-5dc92f60-e126-49f0-87f7-3093d06df955-delete_volume" released by "delete_volume" :: held 1.315s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:34:02 devstack sudo[105171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-e5815f9e-b0bb-4629-bb7c-64ef4f75a5f8 Jul 22 03:34:02 devstack sudo[105171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:02 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-3ab8aaee-5a61-4b96-8039-b8d21ea7d5d2 tempest-VolumeDependencyTests-1653473485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:34:02 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-3ab8aaee-5a61-4b96-8039-b8d21ea7d5d2 tempest-VolumeDependencyTests-1653473485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:34:02 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-3ab8aaee-5a61-4b96-8039-b8d21ea7d5d2 tempest-VolumeDependencyTests-1653473485 None] Creating offline snapshot e62f5bf1-f17a-4144-8778-460d79d7bf19 of volume beea5fb1-e4c7-4d97-bdfb-fb034d108c44 {{(pid=87747) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 03:34:02 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-3bfa89b2-12d5-4a76-83c8-9dd8597b5fd3 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Acquiring lock "cinder-a6d71831-ad84-45b3-a813-c2017dedf2c7-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:34:02 devstack sudo[105171]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:02 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[367a6555-73b4-4acd-a1a6-8b7510d51151]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:34:02 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-3ab8aaee-5a61-4b96-8039-b8d21ea7d5d2 tempest-VolumeDependencyTests-1653473485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-beea5fb1-e4c7-4d97-bdfb-fb034d108c44 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:02 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-3bfa89b2-12d5-4a76-83c8-9dd8597b5fd3 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Lock "cinder-a6d71831-ad84-45b3-a813-c2017dedf2c7-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:34:02 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-398b42dc-4616-4ae6-9c3a-3045e5d99b45 tempest-CreateVolumesFromSnapshotTest-653456616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-e5815f9e-b0bb-4629-bb7c-64ef4f75a5f8" returned: 0 in 0.483s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:02 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-398b42dc-4616-4ae6-9c3a-3045e5d99b45 tempest-CreateVolumesFromSnapshotTest-653456616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-e5815f9e-b0bb-4629-bb7c-64ef4f75a5f8 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:02 devstack sudo[105178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-e5815f9e-b0bb-4629-bb7c-64ef4f75a5f8 Jul 22 03:34:02 devstack sudo[105178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:02 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-3bfa89b2-12d5-4a76-83c8-9dd8597b5fd3 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Acquiring lock "cinder-quobyte-a6d71831-ad84-45b3-a813-c2017dedf2c7" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:34:02 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-3bfa89b2-12d5-4a76-83c8-9dd8597b5fd3 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Lock "cinder-quobyte-a6d71831-ad84-45b3-a813-c2017dedf2c7" acquired by "delete_volume" :: waited 0.023s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:34:02 devstack sudo[105177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-beea5fb1-e4c7-4d97-bdfb-fb034d108c44 Jul 22 03:34:02 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb5a2b39-3712-467c-9826-653c3f841a05]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:34:02 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-3bfa89b2-12d5-4a76-83c8-9dd8597b5fd3 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a6d71831-ad84-45b3-a813-c2017dedf2c7 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:02 devstack sudo[105177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:03 devstack sudo[105181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a6d71831-ad84-45b3-a813-c2017dedf2c7 Jul 22 03:34:03 devstack sudo[105181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:03 devstack sudo[105178]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:03 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-398b42dc-4616-4ae6-9c3a-3045e5d99b45 tempest-CreateVolumesFromSnapshotTest-653456616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-e5815f9e-b0bb-4629-bb7c-64ef4f75a5f8" returned: 0 in 0.325s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:03 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-398b42dc-4616-4ae6-9c3a-3045e5d99b45 tempest-CreateVolumesFromSnapshotTest-653456616 None] Lock "cinder-quobyte-e5815f9e-b0bb-4629-bb7c-64ef4f75a5f8" released by "delete_volume" :: held 0.863s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:34:03 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-398b42dc-4616-4ae6-9c3a-3045e5d99b45 tempest-CreateVolumesFromSnapshotTest-653456616 None] Created reservations ['2ae9d2df-636b-4e86-94a0-58ac1ea28d3f', 'c3a82a40-1804-48ad-af43-936dd531f671', 'c3ff7714-1fd8-48ef-8c8f-889f4e29156a', 'a97c144f-a96a-4451-a142-80c4b8fb1022'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:34:03 devstack sudo[105177]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:03 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-3ab8aaee-5a61-4b96-8039-b8d21ea7d5d2 tempest-VolumeDependencyTests-1653473485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-beea5fb1-e4c7-4d97-bdfb-fb034d108c44" returned: 0 in 0.496s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:03 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-3ab8aaee-5a61-4b96-8039-b8d21ea7d5d2 tempest-VolumeDependencyTests-1653473485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-beea5fb1-e4c7-4d97-bdfb-fb034d108c44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-beea5fb1-e4c7-4d97-bdfb-fb034d108c44.e62f5bf1-f17a-4144-8778-460d79d7bf19 1G {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:03 devstack sudo[105190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-beea5fb1-e4c7-4d97-bdfb-fb034d108c44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-beea5fb1-e4c7-4d97-bdfb-fb034d108c44.e62f5bf1-f17a-4144-8778-460d79d7bf19 1G Jul 22 03:34:03 devstack sudo[105190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:03 devstack sudo[105181]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:03 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-398b42dc-4616-4ae6-9c3a-3045e5d99b45 tempest-CreateVolumesFromSnapshotTest-653456616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:34:03 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-398b42dc-4616-4ae6-9c3a-3045e5d99b45 tempest-CreateVolumesFromSnapshotTest-653456616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:34:03 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-398b42dc-4616-4ae6-9c3a-3045e5d99b45 tempest-CreateVolumesFromSnapshotTest-653456616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:34:03 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-398b42dc-4616-4ae6-9c3a-3045e5d99b45 tempest-CreateVolumesFromSnapshotTest-653456616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:34:03 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-398b42dc-4616-4ae6-9c3a-3045e5d99b45 tempest-CreateVolumesFromSnapshotTest-653456616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:34:03 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-398b42dc-4616-4ae6-9c3a-3045e5d99b45 tempest-CreateVolumesFromSnapshotTest-653456616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:03 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-3bfa89b2-12d5-4a76-83c8-9dd8597b5fd3 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a6d71831-ad84-45b3-a813-c2017dedf2c7" returned: 0 in 0.444s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:03 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-3bfa89b2-12d5-4a76-83c8-9dd8597b5fd3 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a6d71831-ad84-45b3-a813-c2017dedf2c7 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:03 devstack sudo[105194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:34:03 devstack sudo[105194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:03 devstack sudo[105195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a6d71831-ad84-45b3-a813-c2017dedf2c7 Jul 22 03:34:03 devstack sudo[105195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:03 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-eb14b006-8016-49fb-b87a-3de9ee5e3ad5 tempest-CreateVolumesFromSnapshotTest-653456616 None] Acquiring lock "cinder-21ed6243-8afd-4780-9459-f14e1b8c85ba-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:34:03 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-eb14b006-8016-49fb-b87a-3de9ee5e3ad5 tempest-CreateVolumesFromSnapshotTest-653456616 None] Lock "cinder-21ed6243-8afd-4780-9459-f14e1b8c85ba-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:34:03 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-eb14b006-8016-49fb-b87a-3de9ee5e3ad5 tempest-CreateVolumesFromSnapshotTest-653456616 None] Acquiring lock "cinder-quobyte-21ed6243-8afd-4780-9459-f14e1b8c85ba" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:34:03 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-eb14b006-8016-49fb-b87a-3de9ee5e3ad5 tempest-CreateVolumesFromSnapshotTest-653456616 None] Lock "cinder-quobyte-21ed6243-8afd-4780-9459-f14e1b8c85ba" acquired by "delete_volume" :: waited 0.035s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:34:03 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[acd4d17b-31d3-42bc-b295-9562f60299f3]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:34:03 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-eb14b006-8016-49fb-b87a-3de9ee5e3ad5 tempest-CreateVolumesFromSnapshotTest-653456616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-21ed6243-8afd-4780-9459-f14e1b8c85ba {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:03 devstack sudo[105194]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:03 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-398b42dc-4616-4ae6-9c3a-3045e5d99b45 tempest-CreateVolumesFromSnapshotTest-653456616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.407s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:03 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-398b42dc-4616-4ae6-9c3a-3045e5d99b45 tempest-CreateVolumesFromSnapshotTest-653456616 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:34:03 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-398b42dc-4616-4ae6-9c3a-3045e5d99b45 tempest-CreateVolumesFromSnapshotTest-653456616 None] Deleted volume successfully. Jul 22 03:34:03 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-398b42dc-4616-4ae6-9c3a-3045e5d99b45 tempest-CreateVolumesFromSnapshotTest-653456616 None] Lock "cinder-e5815f9e-b0bb-4629-bb7c-64ef4f75a5f8-delete_volume" released by "delete_volume" :: held 1.583s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:34:03 devstack sudo[105202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-21ed6243-8afd-4780-9459-f14e1b8c85ba Jul 22 03:34:03 devstack sudo[105202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:03 devstack sudo[105195]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:03 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-3bfa89b2-12d5-4a76-83c8-9dd8597b5fd3 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a6d71831-ad84-45b3-a813-c2017dedf2c7" returned: 0 in 0.488s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:03 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-3bfa89b2-12d5-4a76-83c8-9dd8597b5fd3 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Lock "cinder-quobyte-a6d71831-ad84-45b3-a813-c2017dedf2c7" released by "delete_volume" :: held 1.004s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:34:03 devstack sudo[105190]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:03 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-3ab8aaee-5a61-4b96-8039-b8d21ea7d5d2 tempest-VolumeDependencyTests-1653473485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-beea5fb1-e4c7-4d97-bdfb-fb034d108c44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-beea5fb1-e4c7-4d97-bdfb-fb034d108c44.e62f5bf1-f17a-4144-8778-460d79d7bf19 1G" returned: 0 in 0.636s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:03 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-3ab8aaee-5a61-4b96-8039-b8d21ea7d5d2 tempest-VolumeDependencyTests-1653473485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-beea5fb1-e4c7-4d97-bdfb-fb034d108c44 -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-beea5fb1-e4c7-4d97-bdfb-fb034d108c44.e62f5bf1-f17a-4144-8778-460d79d7bf19 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:03 devstack sudo[105206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-beea5fb1-e4c7-4d97-bdfb-fb034d108c44 -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-beea5fb1-e4c7-4d97-bdfb-fb034d108c44.e62f5bf1-f17a-4144-8778-460d79d7bf19 Jul 22 03:34:03 devstack sudo[105206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:03 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-3bfa89b2-12d5-4a76-83c8-9dd8597b5fd3 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Created reservations ['17ab217c-360c-4edf-8507-9d0693e1b8b7', '2747ee8c-3809-4ddd-bb58-1c5ddb2dacb6', 'ffdbf97b-5eac-4656-892b-6d0b5867a45b', '77c6b6af-0064-4216-9c2f-89da443d285c'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:34:04 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-3bfa89b2-12d5-4a76-83c8-9dd8597b5fd3 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:34:04 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-3bfa89b2-12d5-4a76-83c8-9dd8597b5fd3 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:34:04 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-3bfa89b2-12d5-4a76-83c8-9dd8597b5fd3 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:34:04 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-3bfa89b2-12d5-4a76-83c8-9dd8597b5fd3 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:34:04 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-3bfa89b2-12d5-4a76-83c8-9dd8597b5fd3 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:34:04 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-3bfa89b2-12d5-4a76-83c8-9dd8597b5fd3 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:04 devstack sudo[105208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:34:04 devstack sudo[105208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:04 devstack sudo[105202]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:04 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-eb14b006-8016-49fb-b87a-3de9ee5e3ad5 tempest-CreateVolumesFromSnapshotTest-653456616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-21ed6243-8afd-4780-9459-f14e1b8c85ba" returned: 0 in 0.546s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:04 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-eb14b006-8016-49fb-b87a-3de9ee5e3ad5 tempest-CreateVolumesFromSnapshotTest-653456616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-21ed6243-8afd-4780-9459-f14e1b8c85ba {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:04 devstack sudo[105206]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:04 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-3ab8aaee-5a61-4b96-8039-b8d21ea7d5d2 tempest-VolumeDependencyTests-1653473485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-beea5fb1-e4c7-4d97-bdfb-fb034d108c44 -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-beea5fb1-e4c7-4d97-bdfb-fb034d108c44.e62f5bf1-f17a-4144-8778-460d79d7bf19" returned: 0 in 0.342s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:04 devstack cinder-volume[87747]: WARNING cinder.volume.drivers.remotefs [None req-3ab8aaee-5a61-4b96-8039-b8d21ea7d5d2 tempest-VolumeDependencyTests-1653473485 None] /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-beea5fb1-e4c7-4d97-bdfb-fb034d108c44.e62f5bf1-f17a-4144-8778-460d79d7bf19 is being set with open permissions: ugo+rw Jul 22 03:34:04 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-3ab8aaee-5a61-4b96-8039-b8d21ea7d5d2 tempest-VolumeDependencyTests-1653473485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-beea5fb1-e4c7-4d97-bdfb-fb034d108c44.e62f5bf1-f17a-4144-8778-460d79d7bf19 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:04 devstack sudo[105216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-21ed6243-8afd-4780-9459-f14e1b8c85ba Jul 22 03:34:04 devstack sudo[105216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:04 devstack sudo[105217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-beea5fb1-e4c7-4d97-bdfb-fb034d108c44.e62f5bf1-f17a-4144-8778-460d79d7bf19 Jul 22 03:34:04 devstack sudo[105217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:04 devstack sudo[105208]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:04 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-3bfa89b2-12d5-4a76-83c8-9dd8597b5fd3 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.326s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:04 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-3bfa89b2-12d5-4a76-83c8-9dd8597b5fd3 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:34:04 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-3bfa89b2-12d5-4a76-83c8-9dd8597b5fd3 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Deleted volume successfully. Jul 22 03:34:04 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-3bfa89b2-12d5-4a76-83c8-9dd8597b5fd3 tempest-CreateVolumesFromSourceVolumeTest-1724486344 None] Lock "cinder-a6d71831-ad84-45b3-a813-c2017dedf2c7-delete_volume" released by "delete_volume" :: held 1.643s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:34:04 devstack sudo[105216]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:04 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-eb14b006-8016-49fb-b87a-3de9ee5e3ad5 tempest-CreateVolumesFromSnapshotTest-653456616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-21ed6243-8afd-4780-9459-f14e1b8c85ba" returned: 0 in 0.285s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:04 devstack sudo[105217]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:04 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-3ab8aaee-5a61-4b96-8039-b8d21ea7d5d2 tempest-VolumeDependencyTests-1653473485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-beea5fb1-e4c7-4d97-bdfb-fb034d108c44.e62f5bf1-f17a-4144-8778-460d79d7bf19" returned: 0 in 0.280s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:04 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-eb14b006-8016-49fb-b87a-3de9ee5e3ad5 tempest-CreateVolumesFromSnapshotTest-653456616 None] Lock "cinder-quobyte-21ed6243-8afd-4780-9459-f14e1b8c85ba" released by "delete_volume" :: held 0.887s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:34:04 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-3ab8aaee-5a61-4b96-8039-b8d21ea7d5d2 tempest-VolumeDependencyTests-1653473485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-beea5fb1-e4c7-4d97-bdfb-fb034d108c44.info {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:04 devstack sudo[105223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-beea5fb1-e4c7-4d97-bdfb-fb034d108c44.info Jul 22 03:34:04 devstack sudo[105223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:04 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-eb14b006-8016-49fb-b87a-3de9ee5e3ad5 tempest-CreateVolumesFromSnapshotTest-653456616 None] Created reservations ['29bb4038-28f2-447c-b919-24929d8e20c4', '80ed2703-03f1-45d3-87bc-30ceb15d9c00', '3382f5b1-e45d-4179-bd39-baed2c100f50', '855815e7-41b5-47cc-8c8c-63852564b995'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:34:04 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-eb14b006-8016-49fb-b87a-3de9ee5e3ad5 tempest-CreateVolumesFromSnapshotTest-653456616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:34:04 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-eb14b006-8016-49fb-b87a-3de9ee5e3ad5 tempest-CreateVolumesFromSnapshotTest-653456616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:34:04 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-eb14b006-8016-49fb-b87a-3de9ee5e3ad5 tempest-CreateVolumesFromSnapshotTest-653456616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:34:04 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-eb14b006-8016-49fb-b87a-3de9ee5e3ad5 tempest-CreateVolumesFromSnapshotTest-653456616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:34:04 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-eb14b006-8016-49fb-b87a-3de9ee5e3ad5 tempest-CreateVolumesFromSnapshotTest-653456616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:34:04 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-eb14b006-8016-49fb-b87a-3de9ee5e3ad5 tempest-CreateVolumesFromSnapshotTest-653456616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:04 devstack sudo[105225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:34:04 devstack sudo[105225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:04 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-f01946d4-6f15-4bd9-807b-3410b101cfeb tempest-CreateVolumesFromSnapshotTest-653456616 None] Acquiring lock "cinder-804d4c1c-bd02-4cd2-9dfa-56c1a5c2b0e8-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:34:04 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-f01946d4-6f15-4bd9-807b-3410b101cfeb tempest-CreateVolumesFromSnapshotTest-653456616 None] Lock "cinder-804d4c1c-bd02-4cd2-9dfa-56c1a5c2b0e8-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:34:04 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-f01946d4-6f15-4bd9-807b-3410b101cfeb tempest-CreateVolumesFromSnapshotTest-653456616 None] Acquiring lock "cinder-quobyte-804d4c1c-bd02-4cd2-9dfa-56c1a5c2b0e8" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:34:04 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-f01946d4-6f15-4bd9-807b-3410b101cfeb tempest-CreateVolumesFromSnapshotTest-653456616 None] Lock "cinder-quobyte-804d4c1c-bd02-4cd2-9dfa-56c1a5c2b0e8" acquired by "delete_volume" :: waited 0.023s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:34:04 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5be1fe5-caa5-41d7-8e4a-944cc7d359c0]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:34:04 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f01946d4-6f15-4bd9-807b-3410b101cfeb tempest-CreateVolumesFromSnapshotTest-653456616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-804d4c1c-bd02-4cd2-9dfa-56c1a5c2b0e8 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:05 devstack sudo[105223]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:05 devstack sudo[105225]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:05 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-3ab8aaee-5a61-4b96-8039-b8d21ea7d5d2 tempest-VolumeDependencyTests-1653473485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-beea5fb1-e4c7-4d97-bdfb-fb034d108c44.info" returned: 0 in 0.468s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:05 devstack cinder-volume[87747]: WARNING cinder.volume.drivers.remotefs [None req-3ab8aaee-5a61-4b96-8039-b8d21ea7d5d2 tempest-VolumeDependencyTests-1653473485 None] /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-beea5fb1-e4c7-4d97-bdfb-fb034d108c44.info is being set with open permissions: ugo+rw Jul 22 03:34:05 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-3ab8aaee-5a61-4b96-8039-b8d21ea7d5d2 tempest-VolumeDependencyTests-1653473485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-beea5fb1-e4c7-4d97-bdfb-fb034d108c44.info {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:05 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-eb14b006-8016-49fb-b87a-3de9ee5e3ad5 tempest-CreateVolumesFromSnapshotTest-653456616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.325s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:05 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-eb14b006-8016-49fb-b87a-3de9ee5e3ad5 tempest-CreateVolumesFromSnapshotTest-653456616 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:34:05 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-eb14b006-8016-49fb-b87a-3de9ee5e3ad5 tempest-CreateVolumesFromSnapshotTest-653456616 None] Deleted volume successfully. Jul 22 03:34:05 devstack sudo[105230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-beea5fb1-e4c7-4d97-bdfb-fb034d108c44.info Jul 22 03:34:05 devstack sudo[105230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:05 devstack sudo[105228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-804d4c1c-bd02-4cd2-9dfa-56c1a5c2b0e8 Jul 22 03:34:05 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-eb14b006-8016-49fb-b87a-3de9ee5e3ad5 tempest-CreateVolumesFromSnapshotTest-653456616 None] Lock "cinder-21ed6243-8afd-4780-9459-f14e1b8c85ba-delete_volume" released by "delete_volume" :: held 1.604s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:34:05 devstack sudo[105228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:05 devstack sudo[105230]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:05 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-3ab8aaee-5a61-4b96-8039-b8d21ea7d5d2 tempest-VolumeDependencyTests-1653473485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-beea5fb1-e4c7-4d97-bdfb-fb034d108c44.info" returned: 0 in 0.331s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:05 devstack sudo[105228]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:05 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-3ab8aaee-5a61-4b96-8039-b8d21ea7d5d2 tempest-VolumeDependencyTests-1653473485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.690s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:34:05 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f01946d4-6f15-4bd9-807b-3410b101cfeb tempest-CreateVolumesFromSnapshotTest-653456616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-804d4c1c-bd02-4cd2-9dfa-56c1a5c2b0e8" returned: 0 in 0.447s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:05 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f01946d4-6f15-4bd9-807b-3410b101cfeb tempest-CreateVolumesFromSnapshotTest-653456616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-804d4c1c-bd02-4cd2-9dfa-56c1a5c2b0e8 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:05 devstack sudo[105237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-804d4c1c-bd02-4cd2-9dfa-56c1a5c2b0e8 Jul 22 03:34:05 devstack sudo[105237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:05 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-3ab8aaee-5a61-4b96-8039-b8d21ea7d5d2 tempest-VolumeDependencyTests-1653473485 None] Create snapshot completed successfully Jul 22 03:34:05 devstack sudo[105237]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:05 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f01946d4-6f15-4bd9-807b-3410b101cfeb tempest-CreateVolumesFromSnapshotTest-653456616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-804d4c1c-bd02-4cd2-9dfa-56c1a5c2b0e8" returned: 0 in 0.276s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:05 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-f01946d4-6f15-4bd9-807b-3410b101cfeb tempest-CreateVolumesFromSnapshotTest-653456616 None] Lock "cinder-quobyte-804d4c1c-bd02-4cd2-9dfa-56c1a5c2b0e8" released by "delete_volume" :: held 0.767s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:34:05 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-f01946d4-6f15-4bd9-807b-3410b101cfeb tempest-CreateVolumesFromSnapshotTest-653456616 None] Created reservations ['d74b2568-0dc0-4af4-bc22-5df74b565663', 'afecf8b0-d17b-4c8a-8ea4-faf486378d77', '5180f35f-9c01-4dc4-b08a-5a94d623f8fe', '4c26ac3b-0c0d-49b7-bb24-9692a535ef8f'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:34:05 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-f01946d4-6f15-4bd9-807b-3410b101cfeb tempest-CreateVolumesFromSnapshotTest-653456616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:34:05 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-f01946d4-6f15-4bd9-807b-3410b101cfeb tempest-CreateVolumesFromSnapshotTest-653456616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:34:05 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-f01946d4-6f15-4bd9-807b-3410b101cfeb tempest-CreateVolumesFromSnapshotTest-653456616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:34:05 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-f01946d4-6f15-4bd9-807b-3410b101cfeb tempest-CreateVolumesFromSnapshotTest-653456616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:34:05 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-f01946d4-6f15-4bd9-807b-3410b101cfeb tempest-CreateVolumesFromSnapshotTest-653456616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:34:05 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f01946d4-6f15-4bd9-807b-3410b101cfeb tempest-CreateVolumesFromSnapshotTest-653456616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:05 devstack sudo[105240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:34:05 devstack sudo[105240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:06 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-ba5619e9-006c-4ca4-b8a6-e68754d0c809 tempest-CreateVolumesFromSnapshotTest-653456616 None] Acquiring lock "cinder-2938bf03-f997-49bb-9b54-afe1fa27b976-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:34:06 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-ba5619e9-006c-4ca4-b8a6-e68754d0c809 tempest-CreateVolumesFromSnapshotTest-653456616 None] Lock "cinder-2938bf03-f997-49bb-9b54-afe1fa27b976-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:34:06 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-ba5619e9-006c-4ca4-b8a6-e68754d0c809 tempest-CreateVolumesFromSnapshotTest-653456616 None] Acquiring lock "cinder-quobyte-2938bf03-f997-49bb-9b54-afe1fa27b976" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:34:06 devstack sudo[105240]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:06 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f01946d4-6f15-4bd9-807b-3410b101cfeb tempest-CreateVolumesFromSnapshotTest-653456616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.321s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:06 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-f01946d4-6f15-4bd9-807b-3410b101cfeb tempest-CreateVolumesFromSnapshotTest-653456616 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:34:06 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-ba5619e9-006c-4ca4-b8a6-e68754d0c809 tempest-CreateVolumesFromSnapshotTest-653456616 None] Lock "cinder-quobyte-2938bf03-f997-49bb-9b54-afe1fa27b976" acquired by "delete_volume" :: waited 0.021s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:34:06 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-f01946d4-6f15-4bd9-807b-3410b101cfeb tempest-CreateVolumesFromSnapshotTest-653456616 None] Deleted volume successfully. Jul 22 03:34:06 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3cc54ce-4666-4665-a599-f8fc842eb1ea]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:34:06 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ba5619e9-006c-4ca4-b8a6-e68754d0c809 tempest-CreateVolumesFromSnapshotTest-653456616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2938bf03-f997-49bb-9b54-afe1fa27b976 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:06 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-f01946d4-6f15-4bd9-807b-3410b101cfeb tempest-CreateVolumesFromSnapshotTest-653456616 None] Lock "cinder-804d4c1c-bd02-4cd2-9dfa-56c1a5c2b0e8-delete_volume" released by "delete_volume" :: held 1.356s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:34:06 devstack sudo[105243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2938bf03-f997-49bb-9b54-afe1fa27b976 Jul 22 03:34:06 devstack sudo[105243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:06 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-b010080e-e50a-499f-b45b-8c37fc6213d4 tempest-VolumeDependencyTests-1653473485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:34:06 devstack sudo[105243]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:06 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ba5619e9-006c-4ca4-b8a6-e68754d0c809 tempest-CreateVolumesFromSnapshotTest-653456616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2938bf03-f997-49bb-9b54-afe1fa27b976" returned: 0 in 0.539s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:06 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ba5619e9-006c-4ca4-b8a6-e68754d0c809 tempest-CreateVolumesFromSnapshotTest-653456616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2938bf03-f997-49bb-9b54-afe1fa27b976 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:06 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b010080e-e50a-499f-b45b-8c37fc6213d4 tempest-VolumeDependencyTests-1653473485 None] Flow 'volume_create_manager' (14d8a406-c833-4e4c-9fdb-ac7f744f55a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:34:06 devstack sudo[105248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2938bf03-f997-49bb-9b54-afe1fa27b976 Jul 22 03:34:06 devstack sudo[105248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:06 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b010080e-e50a-499f-b45b-8c37fc6213d4 tempest-VolumeDependencyTests-1653473485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a38d26c-e642-48dc-9f5b-e752489a7084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:34:06 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b010080e-e50a-499f-b45b-8c37fc6213d4 tempest-VolumeDependencyTests-1653473485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a38d26c-e642-48dc-9f5b-e752489a7084) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:34:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1550654286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b3cfedb-d046-4b1b-840a-4aacdccc90f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af07ecf7688d46c09864159ed453318c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:34:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e62f5bf1-f17a-4144-8778-460d79d7bf19,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:34:07Z,use_quota=True,user_id='be53e3148be34bb8859d6e39306b974c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:34:06 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b010080e-e50a-499f-b45b-8c37fc6213d4 tempest-VolumeDependencyTests-1653473485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0335b86e-c3b7-48c5-8fd9-d968d7fb4263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:34:06 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b010080e-e50a-499f-b45b-8c37fc6213d4 tempest-VolumeDependencyTests-1653473485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0335b86e-c3b7-48c5-8fd9-d968d7fb4263) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:34:06 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b010080e-e50a-499f-b45b-8c37fc6213d4 tempest-VolumeDependencyTests-1653473485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daa85eb5-2c48-410f-a518-75deb1258fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:34:06 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b010080e-e50a-499f-b45b-8c37fc6213d4 tempest-VolumeDependencyTests-1653473485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daa85eb5-2c48-410f-a518-75deb1258fc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3b3cfedb-d046-4b1b-840a-4aacdccc90f8', 'volume_name': 'volume-3b3cfedb-d046-4b1b-840a-4aacdccc90f8', 'volume_size': 1, 'snapshot_id': 'e62f5bf1-f17a-4144-8778-460d79d7bf19'}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:34:06 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b010080e-e50a-499f-b45b-8c37fc6213d4 tempest-VolumeDependencyTests-1653473485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38b2532a-fe84-4dee-9cff-47aa9ae4c9f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:34:06 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b010080e-e50a-499f-b45b-8c37fc6213d4 tempest-VolumeDependencyTests-1653473485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38b2532a-fe84-4dee-9cff-47aa9ae4c9f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:34:06 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b010080e-e50a-499f-b45b-8c37fc6213d4 tempest-VolumeDependencyTests-1653473485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7800bb4-4f5e-4e62-be4f-cd54ddb4559c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:34:06 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-b010080e-e50a-499f-b45b-8c37fc6213d4 tempest-VolumeDependencyTests-1653473485 None] Volume 3b3cfedb-d046-4b1b-840a-4aacdccc90f8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3b3cfedb-d046-4b1b-840a-4aacdccc90f8', 'volume_size': 1, 'snapshot_id': 'e62f5bf1-f17a-4144-8778-460d79d7bf19'} Jul 22 03:34:06 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b010080e-e50a-499f-b45b-8c37fc6213d4 tempest-VolumeDependencyTests-1653473485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:34:06 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b010080e-e50a-499f-b45b-8c37fc6213d4 tempest-VolumeDependencyTests-1653473485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:34:06 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-b010080e-e50a-499f-b45b-8c37fc6213d4 tempest-VolumeDependencyTests-1653473485 None] Acquiring lock "cinder-quobyte-e62f5bf1-f17a-4144-8778-460d79d7bf19-3b3cfedb-d046-4b1b-840a-4aacdccc90f8" by "_create_volume_from_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:34:06 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-b010080e-e50a-499f-b45b-8c37fc6213d4 tempest-VolumeDependencyTests-1653473485 None] Lock "cinder-quobyte-e62f5bf1-f17a-4144-8778-460d79d7bf19-3b3cfedb-d046-4b1b-840a-4aacdccc90f8" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:34:06 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-b010080e-e50a-499f-b45b-8c37fc6213d4 tempest-VolumeDependencyTests-1653473485 None] Creating volume 3b3cfedb-d046-4b1b-840a-4aacdccc90f8 from snapshot e62f5bf1-f17a-4144-8778-460d79d7bf19 {{(pid=87747) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 22 03:34:06 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b010080e-e50a-499f-b45b-8c37fc6213d4 tempest-VolumeDependencyTests-1653473485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:34:06 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b010080e-e50a-499f-b45b-8c37fc6213d4 tempest-VolumeDependencyTests-1653473485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:34:06 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-b010080e-e50a-499f-b45b-8c37fc6213d4 tempest-VolumeDependencyTests-1653473485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:34:06 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-b010080e-e50a-499f-b45b-8c37fc6213d4 tempest-VolumeDependencyTests-1653473485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:34:06 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b010080e-e50a-499f-b45b-8c37fc6213d4 tempest-VolumeDependencyTests-1653473485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:34:06 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-b010080e-e50a-499f-b45b-8c37fc6213d4 tempest-VolumeDependencyTests-1653473485 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:34:06 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-b010080e-e50a-499f-b45b-8c37fc6213d4 tempest-VolumeDependencyTests-1653473485 None] Acquiring lock "cinder-quobyte-3b3cfedb-d046-4b1b-840a-4aacdccc90f8" by "_copy_volume_from_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:34:06 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-b010080e-e50a-499f-b45b-8c37fc6213d4 tempest-VolumeDependencyTests-1653473485 None] Lock "cinder-quobyte-3b3cfedb-d046-4b1b-840a-4aacdccc90f8" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:34:06 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-b010080e-e50a-499f-b45b-8c37fc6213d4 tempest-VolumeDependencyTests-1653473485 None] snapshot: e62f5bf1-f17a-4144-8778-460d79d7bf19, volume: 3b3cfedb-d046-4b1b-840a-4aacdccc90f8, {{(pid=87747) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 22 03:34:06 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b010080e-e50a-499f-b45b-8c37fc6213d4 tempest-VolumeDependencyTests-1653473485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:34:06 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b010080e-e50a-499f-b45b-8c37fc6213d4 tempest-VolumeDependencyTests-1653473485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:34:06 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-b010080e-e50a-499f-b45b-8c37fc6213d4 tempest-VolumeDependencyTests-1653473485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:34:06 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-b010080e-e50a-499f-b45b-8c37fc6213d4 tempest-VolumeDependencyTests-1653473485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:34:06 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b010080e-e50a-499f-b45b-8c37fc6213d4 tempest-VolumeDependencyTests-1653473485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:34:07 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[38eea9cb-301f-4c1f-ab0e-48e6519e883a]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:34:07 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b010080e-e50a-499f-b45b-8c37fc6213d4 tempest-VolumeDependencyTests-1653473485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-beea5fb1-e4c7-4d97-bdfb-fb034d108c44.e62f5bf1-f17a-4144-8778-460d79d7bf19 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:07 devstack sudo[105248]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:07 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ba5619e9-006c-4ca4-b8a6-e68754d0c809 tempest-CreateVolumesFromSnapshotTest-653456616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2938bf03-f997-49bb-9b54-afe1fa27b976" returned: 0 in 0.316s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:07 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-ba5619e9-006c-4ca4-b8a6-e68754d0c809 tempest-CreateVolumesFromSnapshotTest-653456616 None] Lock "cinder-quobyte-2938bf03-f997-49bb-9b54-afe1fa27b976" released by "delete_volume" :: held 0.923s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:34:07 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-ba5619e9-006c-4ca4-b8a6-e68754d0c809 tempest-CreateVolumesFromSnapshotTest-653456616 None] Created reservations ['37d872c3-f6c8-4f36-907b-58323d2678ae', 'e22207bd-b8d6-4e77-9064-26ec7d23eb8f', '5d51cca4-618c-43b1-8cb8-8b2f901abcb1', '294e779b-0835-4659-a94e-212a3ba08d5e'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:34:07 devstack sudo[105251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-beea5fb1-e4c7-4d97-bdfb-fb034d108c44.e62f5bf1-f17a-4144-8778-460d79d7bf19 Jul 22 03:34:07 devstack sudo[105251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:07 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-ba5619e9-006c-4ca4-b8a6-e68754d0c809 tempest-CreateVolumesFromSnapshotTest-653456616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:34:07 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-ba5619e9-006c-4ca4-b8a6-e68754d0c809 tempest-CreateVolumesFromSnapshotTest-653456616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:34:07 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-ba5619e9-006c-4ca4-b8a6-e68754d0c809 tempest-CreateVolumesFromSnapshotTest-653456616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:34:07 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-ba5619e9-006c-4ca4-b8a6-e68754d0c809 tempest-CreateVolumesFromSnapshotTest-653456616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:34:07 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-ba5619e9-006c-4ca4-b8a6-e68754d0c809 tempest-CreateVolumesFromSnapshotTest-653456616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:34:07 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ba5619e9-006c-4ca4-b8a6-e68754d0c809 tempest-CreateVolumesFromSnapshotTest-653456616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:07 devstack sudo[105253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:34:07 devstack sudo[105253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:07 devstack sudo[105251]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:07 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b010080e-e50a-499f-b45b-8c37fc6213d4 tempest-VolumeDependencyTests-1653473485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-beea5fb1-e4c7-4d97-bdfb-fb034d108c44.e62f5bf1-f17a-4144-8778-460d79d7bf19" returned: 0 in 0.484s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:07 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-b010080e-e50a-499f-b45b-8c37fc6213d4 tempest-VolumeDependencyTests-1653473485 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-beea5fb1-e4c7-4d97-bdfb-fb034d108c44(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87747) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 03:34:07 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-b010080e-e50a-499f-b45b-8c37fc6213d4 tempest-VolumeDependencyTests-1653473485 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-beea5fb1-e4c7-4d97-bdfb-fb034d108c44 {{(pid=87747) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 22 03:34:07 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-b010080e-e50a-499f-b45b-8c37fc6213d4 tempest-VolumeDependencyTests-1653473485 None] Creating direct copy from snapshot {{(pid=87747) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 22 03:34:07 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[54d32d71-84be-46f2-a7c9-b74bbc1efe45]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:34:07 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b010080e-e50a-499f-b45b-8c37fc6213d4 tempest-VolumeDependencyTests-1653473485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-beea5fb1-e4c7-4d97-bdfb-fb034d108c44 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:07 devstack sudo[105253]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:07 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ba5619e9-006c-4ca4-b8a6-e68754d0c809 tempest-CreateVolumesFromSnapshotTest-653456616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.370s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:07 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-ba5619e9-006c-4ca4-b8a6-e68754d0c809 tempest-CreateVolumesFromSnapshotTest-653456616 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:34:07 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-ba5619e9-006c-4ca4-b8a6-e68754d0c809 tempest-CreateVolumesFromSnapshotTest-653456616 None] Deleted volume successfully. Jul 22 03:34:07 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-ba5619e9-006c-4ca4-b8a6-e68754d0c809 tempest-CreateVolumesFromSnapshotTest-653456616 None] Lock "cinder-2938bf03-f997-49bb-9b54-afe1fa27b976-delete_volume" released by "delete_volume" :: held 1.627s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:34:07 devstack sudo[105260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-beea5fb1-e4c7-4d97-bdfb-fb034d108c44 Jul 22 03:34:07 devstack sudo[105260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:07 devstack sudo[105260]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:07 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b010080e-e50a-499f-b45b-8c37fc6213d4 tempest-VolumeDependencyTests-1653473485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-beea5fb1-e4c7-4d97-bdfb-fb034d108c44" returned: 0 in 0.460s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:07 devstack cinder-volume[87747]: DEBUG cinder.utils [None req-b010080e-e50a-499f-b45b-8c37fc6213d4 tempest-VolumeDependencyTests-1653473485 None] Path /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3b3cfedb-d046-4b1b-840a-4aacdccc90f8 not found in is_blk_device check {{(pid=87747) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 22 03:34:07 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b010080e-e50a-499f-b45b-8c37fc6213d4 tempest-VolumeDependencyTests-1653473485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-beea5fb1-e4c7-4d97-bdfb-fb034d108c44 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3b3cfedb-d046-4b1b-840a-4aacdccc90f8 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:08 devstack sudo[105265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-beea5fb1-e4c7-4d97-bdfb-fb034d108c44 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3b3cfedb-d046-4b1b-840a-4aacdccc90f8 Jul 22 03:34:08 devstack sudo[105265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:08 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-dd13f0b8-437a-493c-9ef5-545003d9fc14 tempest-CreateVolumesFromSnapshotTest-653456616 None] Acquiring lock "cinder-e792e9b3-f162-4b03-afd8-b27fc26145cf-delete_snapshot" by "delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:34:08 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-dd13f0b8-437a-493c-9ef5-545003d9fc14 tempest-CreateVolumesFromSnapshotTest-653456616 None] Lock "cinder-e792e9b3-f162-4b03-afd8-b27fc26145cf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:34:08 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-dd13f0b8-437a-493c-9ef5-545003d9fc14 tempest-CreateVolumesFromSnapshotTest-653456616 None] Acquiring lock "cinder-quobyte-942e7752-6415-40b2-aaae-fcb41088682f" by "delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:34:08 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-dd13f0b8-437a-493c-9ef5-545003d9fc14 tempest-CreateVolumesFromSnapshotTest-653456616 None] Lock "cinder-quobyte-942e7752-6415-40b2-aaae-fcb41088682f" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:34:08 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-dd13f0b8-437a-493c-9ef5-545003d9fc14 tempest-CreateVolumesFromSnapshotTest-653456616 None] Acquiring lock "cinder-quobyte-e792e9b3-f162-4b03-afd8-b27fc26145cf" by "_delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:34:08 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-dd13f0b8-437a-493c-9ef5-545003d9fc14 tempest-CreateVolumesFromSnapshotTest-653456616 None] Lock "cinder-quobyte-e792e9b3-f162-4b03-afd8-b27fc26145cf" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:34:08 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-dd13f0b8-437a-493c-9ef5-545003d9fc14 tempest-CreateVolumesFromSnapshotTest-653456616 None] Deleting offline snapshot e792e9b3-f162-4b03-afd8-b27fc26145cf of volume 942e7752-6415-40b2-aaae-fcb41088682f {{(pid=87747) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 03:34:08 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-dd13f0b8-437a-493c-9ef5-545003d9fc14 tempest-CreateVolumesFromSnapshotTest-653456616 None] snapshot_file for this snap is: volume-942e7752-6415-40b2-aaae-fcb41088682f.e792e9b3-f162-4b03-afd8-b27fc26145cf {{(pid=87747) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 03:34:08 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[68491254-9c6a-4f40-8ff3-045bd7a435f6]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:34:08 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-dd13f0b8-437a-493c-9ef5-545003d9fc14 tempest-CreateVolumesFromSnapshotTest-653456616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-942e7752-6415-40b2-aaae-fcb41088682f.e792e9b3-f162-4b03-afd8-b27fc26145cf {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:08 devstack sudo[105271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-942e7752-6415-40b2-aaae-fcb41088682f.e792e9b3-f162-4b03-afd8-b27fc26145cf Jul 22 03:34:08 devstack sudo[105271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:09 devstack sudo[105271]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:09 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-dd13f0b8-437a-493c-9ef5-545003d9fc14 tempest-CreateVolumesFromSnapshotTest-653456616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-942e7752-6415-40b2-aaae-fcb41088682f.e792e9b3-f162-4b03-afd8-b27fc26145cf" returned: 0 in 0.694s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:09 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-dd13f0b8-437a-493c-9ef5-545003d9fc14 tempest-CreateVolumesFromSnapshotTest-653456616 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-942e7752-6415-40b2-aaae-fcb41088682f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87747) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 03:34:09 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[b037633e-b836-48c5-bce0-57b20939ac0f]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:34:09 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-dd13f0b8-437a-493c-9ef5-545003d9fc14 tempest-CreateVolumesFromSnapshotTest-653456616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-942e7752-6415-40b2-aaae-fcb41088682f {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:09 devstack sudo[105282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-942e7752-6415-40b2-aaae-fcb41088682f Jul 22 03:34:09 devstack sudo[105282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:10 devstack sudo[105282]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:10 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-dd13f0b8-437a-493c-9ef5-545003d9fc14 tempest-CreateVolumesFromSnapshotTest-653456616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-942e7752-6415-40b2-aaae-fcb41088682f" returned: 0 in 1.289s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:10 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-dd13f0b8-437a-493c-9ef5-545003d9fc14 tempest-CreateVolumesFromSnapshotTest-653456616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-942e7752-6415-40b2-aaae-fcb41088682f.e792e9b3-f162-4b03-afd8-b27fc26145cf {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:10 devstack sudo[105288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-942e7752-6415-40b2-aaae-fcb41088682f.e792e9b3-f162-4b03-afd8-b27fc26145cf Jul 22 03:34:10 devstack sudo[105288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:11 devstack sudo[105288]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:11 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-dd13f0b8-437a-493c-9ef5-545003d9fc14 tempest-CreateVolumesFromSnapshotTest-653456616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-942e7752-6415-40b2-aaae-fcb41088682f.e792e9b3-f162-4b03-afd8-b27fc26145cf" returned: 0 in 0.824s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:11 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-dd13f0b8-437a-493c-9ef5-545003d9fc14 tempest-CreateVolumesFromSnapshotTest-653456616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-942e7752-6415-40b2-aaae-fcb41088682f.e792e9b3-f162-4b03-afd8-b27fc26145cf {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:11 devstack sudo[105293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-942e7752-6415-40b2-aaae-fcb41088682f.e792e9b3-f162-4b03-afd8-b27fc26145cf Jul 22 03:34:11 devstack sudo[105293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:12 devstack sudo[105293]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:12 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-dd13f0b8-437a-493c-9ef5-545003d9fc14 tempest-CreateVolumesFromSnapshotTest-653456616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-942e7752-6415-40b2-aaae-fcb41088682f.e792e9b3-f162-4b03-afd8-b27fc26145cf" returned: 0 in 1.045s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:12 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-86b3da79-ba99-40d5-ad10-78aeb1a2643d tempest-VolumeImageDependencyTests-1872904039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:34:12 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-86b3da79-ba99-40d5-ad10-78aeb1a2643d tempest-VolumeImageDependencyTests-1872904039 None] Flow 'volume_create_manager' (ae5a50d3-f6ab-4317-84da-a05a7ae5b8ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:34:12 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-86b3da79-ba99-40d5-ad10-78aeb1a2643d tempest-VolumeImageDependencyTests-1872904039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (872105d8-1f23-4c43-8d04-9ab986550861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:34:12 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-dd13f0b8-437a-493c-9ef5-545003d9fc14 tempest-CreateVolumesFromSnapshotTest-653456616 None] Lock "cinder-quobyte-e792e9b3-f162-4b03-afd8-b27fc26145cf" released by "_delete_snapshot" :: held 4.202s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:34:12 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-dd13f0b8-437a-493c-9ef5-545003d9fc14 tempest-CreateVolumesFromSnapshotTest-653456616 None] Lock "cinder-quobyte-942e7752-6415-40b2-aaae-fcb41088682f" released by "delete_snapshot" :: held 4.259s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:34:12 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-86b3da79-ba99-40d5-ad10-78aeb1a2643d tempest-VolumeImageDependencyTests-1872904039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (872105d8-1f23-4c43-8d04-9ab986550861) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:34:12Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a378b9b5-a55c-4d85-a1d6-c2e6fb7656da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3b05c76f0ea4e568978d4730297c646',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:34:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:34:12Z,use_quota=True,user_id='11644a6a0b4e4857b9e59828c05788ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:34:12 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-86b3da79-ba99-40d5-ad10-78aeb1a2643d tempest-VolumeImageDependencyTests-1872904039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7634a62-aa62-4519-9026-29e870790483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:34:12 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-86b3da79-ba99-40d5-ad10-78aeb1a2643d tempest-VolumeImageDependencyTests-1872904039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7634a62-aa62-4519-9026-29e870790483) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:34:12 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-86b3da79-ba99-40d5-ad10-78aeb1a2643d tempest-VolumeImageDependencyTests-1872904039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0eecec7e-6dcd-4708-bba9-8a9b3ffecdb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:34:12 devstack cinder-volume[87747]: DEBUG cinder.image.glance [None req-86b3da79-ba99-40d5-ad10-78aeb1a2643d tempest-VolumeImageDependencyTests-1872904039 None] Creating Keystone auth plugin from conf {{(pid=87747) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 22 03:34:12 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-dd13f0b8-437a-493c-9ef5-545003d9fc14 tempest-CreateVolumesFromSnapshotTest-653456616 None] Created reservations ['3564c230-54e3-4e8a-b6e3-6d4035c6cf19', 'ad57204c-61d1-4262-ab56-802424b1b8a9', '0c310a27-3dfc-48f3-a445-1998c0296739', '0ad20031-a167-4310-b25e-86a4738cecd4'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:34:13 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-dd13f0b8-437a-493c-9ef5-545003d9fc14 tempest-CreateVolumesFromSnapshotTest-653456616 None] Delete snapshot completed successfully. Jul 22 03:34:13 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-dd13f0b8-437a-493c-9ef5-545003d9fc14 tempest-CreateVolumesFromSnapshotTest-653456616 None] Lock "cinder-e792e9b3-f162-4b03-afd8-b27fc26145cf-delete_snapshot" released by "delete_snapshot" :: held 4.740s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:34:13 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-86b3da79-ba99-40d5-ad10-78aeb1a2643d tempest-VolumeImageDependencyTests-1872904039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0eecec7e-6dcd-4708-bba9-8a9b3ffecdb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a378b9b5-a55c-4d85-a1d6-c2e6fb7656da', 'volume_name': 'volume-a378b9b5-a55c-4d85-a1d6-c2e6fb7656da', 'volume_size': 1, 'image_id': '841df32c-8dbf-4be1-8de5-78ac4250b03d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/841df32c-8dbf-4be1-8de5-78ac4250b03d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8a2f0f2ff7e21c81c3eba38667346fca', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e3b05c76f0ea4e568978d4730297c646', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5e6d5003f89674c9645b5001bb41c43f4a0e60e0c4d418e1639476b821c33fa9635c7aab1cac5dd01b5bc6d4bc318ecc7144712668d50aa3de530c17ac8b44b3', 'id': '841df32c-8dbf-4be1-8de5-78ac4250b03d', 'created_at': datetime.datetime(2026, 7, 22, 1, 34, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 22, 1, 34, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/841df32c-8dbf-4be1-8de5-78ac4250b03d/file', 'properties': {}}, 'image_service': }' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:34:13 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-86b3da79-ba99-40d5-ad10-78aeb1a2643d tempest-VolumeImageDependencyTests-1872904039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69c70caf-f00f-4a2b-9a36-7168500400ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:34:13 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-86b3da79-ba99-40d5-ad10-78aeb1a2643d tempest-VolumeImageDependencyTests-1872904039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69c70caf-f00f-4a2b-9a36-7168500400ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:34:13 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-86b3da79-ba99-40d5-ad10-78aeb1a2643d tempest-VolumeImageDependencyTests-1872904039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cef70de4-794f-4e57-8435-e2dd1009b591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:34:13 devstack sudo[105265]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:13 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-86b3da79-ba99-40d5-ad10-78aeb1a2643d tempest-VolumeImageDependencyTests-1872904039 None] Volume a378b9b5-a55c-4d85-a1d6-c2e6fb7656da: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a378b9b5-a55c-4d85-a1d6-c2e6fb7656da', 'volume_size': 1, 'image_id': '841df32c-8dbf-4be1-8de5-78ac4250b03d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/841df32c-8dbf-4be1-8de5-78ac4250b03d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8a2f0f2ff7e21c81c3eba38667346fca', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e3b05c76f0ea4e568978d4730297c646', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5e6d5003f89674c9645b5001bb41c43f4a0e60e0c4d418e1639476b821c33fa9635c7aab1cac5dd01b5bc6d4bc318ecc7144712668d50aa3de530c17ac8b44b3', 'id': '841df32c-8dbf-4be1-8de5-78ac4250b03d', 'created_at': datetime.datetime(2026, 7, 22, 1, 34, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 22, 1, 34, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/841df32c-8dbf-4be1-8de5-78ac4250b03d/file', 'properties': {}}, 'image_service': } Jul 22 03:34:13 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-86b3da79-ba99-40d5-ad10-78aeb1a2643d tempest-VolumeImageDependencyTests-1872904039 None] Trying to clone a378b9b5-a55c-4d85-a1d6-c2e6fb7656da from image 841df32c-8dbf-4be1-8de5-78ac4250b03d at location (None, [{'url': 'file:///opt/stack/data/glance/images/841df32c-8dbf-4be1-8de5-78ac4250b03d', 'metadata': {}}]). {{(pid=87747) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 22 03:34:13 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-4b98d061-8dd9-4f93-be4a-938fae9cc781 tempest-CreateVolumesFromSnapshotTest-653456616 None] Acquiring lock "cinder-942e7752-6415-40b2-aaae-fcb41088682f-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:34:14 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b010080e-e50a-499f-b45b-8c37fc6213d4 tempest-VolumeDependencyTests-1653473485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-beea5fb1-e4c7-4d97-bdfb-fb034d108c44 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3b3cfedb-d046-4b1b-840a-4aacdccc90f8" returned: 0 in 6.013s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:14 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-4b98d061-8dd9-4f93-be4a-938fae9cc781 tempest-CreateVolumesFromSnapshotTest-653456616 None] Lock "cinder-942e7752-6415-40b2-aaae-fcb41088682f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:34:14 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[47313172-f1d9-4ddf-9d5c-b7f5f9eaf444]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:34:14 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b010080e-e50a-499f-b45b-8c37fc6213d4 tempest-VolumeDependencyTests-1653473485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-beea5fb1-e4c7-4d97-bdfb-fb034d108c44 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:14 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-4b98d061-8dd9-4f93-be4a-938fae9cc781 tempest-CreateVolumesFromSnapshotTest-653456616 None] Acquiring lock "cinder-quobyte-942e7752-6415-40b2-aaae-fcb41088682f" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:34:14 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-4b98d061-8dd9-4f93-be4a-938fae9cc781 tempest-CreateVolumesFromSnapshotTest-653456616 None] Lock "cinder-quobyte-942e7752-6415-40b2-aaae-fcb41088682f" acquired by "delete_volume" :: waited 0.015s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:34:14 devstack cinder-volume[87747]: DEBUG cinder.image.image_utils [None req-86b3da79-ba99-40d5-ad10-78aeb1a2643d tempest-VolumeImageDependencyTests-1872904039 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_841df32c-8dbf-4be1-8de5-78ac4250b03d__ltt6vz2devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87747) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 22 03:34:14 devstack cinder-volume[87747]: INFO cinder.image.image_utils [None req-86b3da79-ba99-40d5-ad10-78aeb1a2643d tempest-VolumeImageDependencyTests-1872904039 None] Image download 0.00 MB at 0.00 MB/s Jul 22 03:34:14 devstack sudo[105297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-beea5fb1-e4c7-4d97-bdfb-fb034d108c44 Jul 22 03:34:14 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[954b3b24-beff-4885-994b-8abc1d5b2e69]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:34:14 devstack sudo[105297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:14 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-4b98d061-8dd9-4f93-be4a-938fae9cc781 tempest-CreateVolumesFromSnapshotTest-653456616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-942e7752-6415-40b2-aaae-fcb41088682f {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:14 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c2f58cf-c72e-4fe6-914c-aa0f5f9e242b]: (4, 'raw') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:34:14 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-86b3da79-ba99-40d5-ad10-78aeb1a2643d tempest-VolumeImageDependencyTests-1872904039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_841df32c-8dbf-4be1-8de5-78ac4250b03d__ltt6vz2devstack@QuobyteHD {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:14 devstack sudo[105299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-942e7752-6415-40b2-aaae-fcb41088682f Jul 22 03:34:14 devstack sudo[105299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:14 devstack sudo[105300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_841df32c-8dbf-4be1-8de5-78ac4250b03d__ltt6vz2devstack@QuobyteHD Jul 22 03:34:14 devstack sudo[105300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:14 devstack sudo[105299]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:14 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-4b98d061-8dd9-4f93-be4a-938fae9cc781 tempest-CreateVolumesFromSnapshotTest-653456616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-942e7752-6415-40b2-aaae-fcb41088682f" returned: 0 in 0.445s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:14 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-4b98d061-8dd9-4f93-be4a-938fae9cc781 tempest-CreateVolumesFromSnapshotTest-653456616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-942e7752-6415-40b2-aaae-fcb41088682f {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:14 devstack sudo[105308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-942e7752-6415-40b2-aaae-fcb41088682f Jul 22 03:34:14 devstack sudo[105308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:14 devstack sudo[105300]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:14 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-86b3da79-ba99-40d5-ad10-78aeb1a2643d tempest-VolumeImageDependencyTests-1872904039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_841df32c-8dbf-4be1-8de5-78ac4250b03d__ltt6vz2devstack@QuobyteHD" returned: 0 in 0.467s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:14 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-86b3da79-ba99-40d5-ad10-78aeb1a2643d tempest-VolumeImageDependencyTests-1872904039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_841df32c-8dbf-4be1-8de5-78ac4250b03d__ltt6vz2devstack@QuobyteHD {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:14 devstack sudo[105297]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:14 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b010080e-e50a-499f-b45b-8c37fc6213d4 tempest-VolumeDependencyTests-1653473485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-beea5fb1-e4c7-4d97-bdfb-fb034d108c44" returned: 0 in 0.736s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:14 devstack cinder-volume[87747]: DEBUG cinder.image.image_utils [None req-b010080e-e50a-499f-b45b-8c37fc6213d4 tempest-VolumeDependencyTests-1653473485 None] Image conversion details: src /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-beea5fb1-e4c7-4d97-bdfb-fb034d108c44, size 1024.00 MB, duration 6.01 sec, destination /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3b3cfedb-d046-4b1b-840a-4aacdccc90f8 {{(pid=87747) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 22 03:34:14 devstack cinder-volume[87747]: INFO cinder.image.image_utils [None req-b010080e-e50a-499f-b45b-8c37fc6213d4 tempest-VolumeDependencyTests-1653473485 None] Converted 1024.00 MB image at 170.27 MB/s Jul 22 03:34:14 devstack cinder-volume[87747]: WARNING cinder.volume.drivers.remotefs [None req-b010080e-e50a-499f-b45b-8c37fc6213d4 tempest-VolumeDependencyTests-1653473485 None] /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3b3cfedb-d046-4b1b-840a-4aacdccc90f8 is being set with open permissions: ugo+rw Jul 22 03:34:14 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b010080e-e50a-499f-b45b-8c37fc6213d4 tempest-VolumeDependencyTests-1653473485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3b3cfedb-d046-4b1b-840a-4aacdccc90f8 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:14 devstack sudo[105315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3b3cfedb-d046-4b1b-840a-4aacdccc90f8 Jul 22 03:34:14 devstack sudo[105315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:14 devstack sudo[105312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_841df32c-8dbf-4be1-8de5-78ac4250b03d__ltt6vz2devstack@QuobyteHD Jul 22 03:34:14 devstack sudo[105312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:14 devstack sudo[105308]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:14 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-4b98d061-8dd9-4f93-be4a-938fae9cc781 tempest-CreateVolumesFromSnapshotTest-653456616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-942e7752-6415-40b2-aaae-fcb41088682f" returned: 0 in 0.288s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:14 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-4b98d061-8dd9-4f93-be4a-938fae9cc781 tempest-CreateVolumesFromSnapshotTest-653456616 None] Lock "cinder-quobyte-942e7752-6415-40b2-aaae-fcb41088682f" released by "delete_volume" :: held 0.823s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:34:14 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-4b98d061-8dd9-4f93-be4a-938fae9cc781 tempest-CreateVolumesFromSnapshotTest-653456616 None] Created reservations ['66595222-d72d-4cfc-902a-14c00e23c0c0', 'd57d267d-7d1d-4988-8d88-d4bc0ea4ef6f', 'd48cdfa8-f7b9-4cf3-985c-6365d57605c0', '931485ab-b999-4222-b5b7-9d7ff601350f'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:34:15 devstack sudo[105315]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:15 devstack sudo[105312]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:15 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-86b3da79-ba99-40d5-ad10-78aeb1a2643d tempest-VolumeImageDependencyTests-1872904039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_841df32c-8dbf-4be1-8de5-78ac4250b03d__ltt6vz2devstack@QuobyteHD" returned: 1 in 0.395s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:15 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-86b3da79-ba99-40d5-ad10-78aeb1a2643d tempest-VolumeImageDependencyTests-1872904039 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_841df32c-8dbf-4be1-8de5-78ac4250b03d__ltt6vz2devstack@QuobyteHD' failed. Not Retrying. {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 22 03:34:15 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b010080e-e50a-499f-b45b-8c37fc6213d4 tempest-VolumeDependencyTests-1653473485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3b3cfedb-d046-4b1b-840a-4aacdccc90f8" returned: 0 in 0.310s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:15 devstack cinder-volume[87747]: DEBUG cinder.image.image_utils [None req-86b3da79-ba99-40d5-ad10-78aeb1a2643d tempest-VolumeImageDependencyTests-1872904039 None] Temporary image 841df32c-8dbf-4be1-8de5-78ac4250b03d is fetched for user 11644a6a0b4e4857b9e59828c05788ba. {{(pid=87747) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 22 03:34:15 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-4b98d061-8dd9-4f93-be4a-938fae9cc781 tempest-CreateVolumesFromSnapshotTest-653456616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:34:15 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-4b98d061-8dd9-4f93-be4a-938fae9cc781 tempest-CreateVolumesFromSnapshotTest-653456616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:34:15 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-4b98d061-8dd9-4f93-be4a-938fae9cc781 tempest-CreateVolumesFromSnapshotTest-653456616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:34:15 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-4b98d061-8dd9-4f93-be4a-938fae9cc781 tempest-CreateVolumesFromSnapshotTest-653456616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:34:15 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-4b98d061-8dd9-4f93-be4a-938fae9cc781 tempest-CreateVolumesFromSnapshotTest-653456616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:34:15 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-4b98d061-8dd9-4f93-be4a-938fae9cc781 tempest-CreateVolumesFromSnapshotTest-653456616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:15 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-b010080e-e50a-499f-b45b-8c37fc6213d4 tempest-VolumeDependencyTests-1653473485 None] Lock "cinder-quobyte-3b3cfedb-d046-4b1b-840a-4aacdccc90f8" released by "_copy_volume_from_snapshot" :: held 8.171s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:34:15 devstack sudo[105323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:34:15 devstack sudo[105323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:15 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-b010080e-e50a-499f-b45b-8c37fc6213d4 tempest-VolumeDependencyTests-1653473485 None] Lock "cinder-quobyte-e62f5bf1-f17a-4144-8778-460d79d7bf19-3b3cfedb-d046-4b1b-840a-4aacdccc90f8" released by "_create_volume_from_snapshot" :: held 8.222s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:34:15 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b010080e-e50a-499f-b45b-8c37fc6213d4 tempest-VolumeDependencyTests-1653473485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.245s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:34:15 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b010080e-e50a-499f-b45b-8c37fc6213d4 tempest-VolumeDependencyTests-1653473485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7800bb4-4f5e-4e62-be4f-cd54ddb4559c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b3cfedb-d046-4b1b-840a-4aacdccc90f8', 'volume_size': 1, 'snapshot_id': 'e62f5bf1-f17a-4144-8778-460d79d7bf19'}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:34:15 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b010080e-e50a-499f-b45b-8c37fc6213d4 tempest-VolumeDependencyTests-1653473485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a87ef289-bd7d-4a54-bbdb-e2da49577af1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:34:15 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[62ff203b-357c-4bf7-938a-89bb599788a2]: (4, 'raw') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:34:15 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-86b3da79-ba99-40d5-ad10-78aeb1a2643d tempest-VolumeImageDependencyTests-1872904039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_841df32c-8dbf-4be1-8de5-78ac4250b03d__ltt6vz2devstack@QuobyteHD {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:15 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-b010080e-e50a-499f-b45b-8c37fc6213d4 tempest-VolumeDependencyTests-1653473485 None] Volume volume-3b3cfedb-d046-4b1b-840a-4aacdccc90f8 (3b3cfedb-d046-4b1b-840a-4aacdccc90f8): created successfully Jul 22 03:34:15 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b010080e-e50a-499f-b45b-8c37fc6213d4 tempest-VolumeDependencyTests-1653473485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a87ef289-bd7d-4a54-bbdb-e2da49577af1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:34:15 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b010080e-e50a-499f-b45b-8c37fc6213d4 tempest-VolumeDependencyTests-1653473485 None] Flow 'volume_create_manager' (14d8a406-c833-4e4c-9fdb-ac7f744f55a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:34:15 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-b010080e-e50a-499f-b45b-8c37fc6213d4 tempest-VolumeDependencyTests-1653473485 None] Created volume successfully. Jul 22 03:34:15 devstack sudo[105325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_841df32c-8dbf-4be1-8de5-78ac4250b03d__ltt6vz2devstack@QuobyteHD Jul 22 03:34:15 devstack sudo[105325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:15 devstack sudo[105323]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:15 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-4b98d061-8dd9-4f93-be4a-938fae9cc781 tempest-CreateVolumesFromSnapshotTest-653456616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.328s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:15 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-4b98d061-8dd9-4f93-be4a-938fae9cc781 tempest-CreateVolumesFromSnapshotTest-653456616 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:34:15 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-4b98d061-8dd9-4f93-be4a-938fae9cc781 tempest-CreateVolumesFromSnapshotTest-653456616 None] Deleted volume successfully. Jul 22 03:34:15 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-4b98d061-8dd9-4f93-be4a-938fae9cc781 tempest-CreateVolumesFromSnapshotTest-653456616 None] Lock "cinder-942e7752-6415-40b2-aaae-fcb41088682f-delete_volume" released by "delete_volume" :: held 1.447s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:34:15 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-aed87c3b-bd63-41b9-962f-0397ac009f3b tempest-VolumeDependencyTests-1653473485 None] Acquiring lock "cinder-e62f5bf1-f17a-4144-8778-460d79d7bf19-delete_snapshot" by "delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:34:15 devstack sudo[105325]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:15 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-86b3da79-ba99-40d5-ad10-78aeb1a2643d tempest-VolumeImageDependencyTests-1872904039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_841df32c-8dbf-4be1-8de5-78ac4250b03d__ltt6vz2devstack@QuobyteHD" returned: 0 in 0.437s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:15 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-86b3da79-ba99-40d5-ad10-78aeb1a2643d tempest-VolumeImageDependencyTests-1872904039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_841df32c-8dbf-4be1-8de5-78ac4250b03d__ltt6vz2devstack@QuobyteHD {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:15 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-aed87c3b-bd63-41b9-962f-0397ac009f3b tempest-VolumeDependencyTests-1653473485 None] Lock "cinder-e62f5bf1-f17a-4144-8778-460d79d7bf19-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:34:15 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-aed87c3b-bd63-41b9-962f-0397ac009f3b tempest-VolumeDependencyTests-1653473485 None] Acquiring lock "cinder-quobyte-beea5fb1-e4c7-4d97-bdfb-fb034d108c44" by "delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:34:15 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-aed87c3b-bd63-41b9-962f-0397ac009f3b tempest-VolumeDependencyTests-1653473485 None] Lock "cinder-quobyte-beea5fb1-e4c7-4d97-bdfb-fb034d108c44" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:34:15 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-aed87c3b-bd63-41b9-962f-0397ac009f3b tempest-VolumeDependencyTests-1653473485 None] Acquiring lock "cinder-quobyte-e62f5bf1-f17a-4144-8778-460d79d7bf19" by "_delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:34:15 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-aed87c3b-bd63-41b9-962f-0397ac009f3b tempest-VolumeDependencyTests-1653473485 None] Lock "cinder-quobyte-e62f5bf1-f17a-4144-8778-460d79d7bf19" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:34:15 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-aed87c3b-bd63-41b9-962f-0397ac009f3b tempest-VolumeDependencyTests-1653473485 None] Deleting offline snapshot e62f5bf1-f17a-4144-8778-460d79d7bf19 of volume beea5fb1-e4c7-4d97-bdfb-fb034d108c44 {{(pid=87747) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 03:34:15 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-aed87c3b-bd63-41b9-962f-0397ac009f3b tempest-VolumeDependencyTests-1653473485 None] snapshot_file for this snap is: volume-beea5fb1-e4c7-4d97-bdfb-fb034d108c44.e62f5bf1-f17a-4144-8778-460d79d7bf19 {{(pid=87747) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 03:34:15 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f18899d-54b4-41c5-a349-bdd397c15601]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:34:15 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-aed87c3b-bd63-41b9-962f-0397ac009f3b tempest-VolumeDependencyTests-1653473485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-beea5fb1-e4c7-4d97-bdfb-fb034d108c44.e62f5bf1-f17a-4144-8778-460d79d7bf19 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:15 devstack sudo[105330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_841df32c-8dbf-4be1-8de5-78ac4250b03d__ltt6vz2devstack@QuobyteHD Jul 22 03:34:15 devstack sudo[105330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:15 devstack sudo[105331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-beea5fb1-e4c7-4d97-bdfb-fb034d108c44.e62f5bf1-f17a-4144-8778-460d79d7bf19 Jul 22 03:34:15 devstack sudo[105331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:16 devstack sudo[105330]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:16 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-86b3da79-ba99-40d5-ad10-78aeb1a2643d tempest-VolumeImageDependencyTests-1872904039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_841df32c-8dbf-4be1-8de5-78ac4250b03d__ltt6vz2devstack@QuobyteHD" returned: 1 in 0.516s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:16 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-86b3da79-ba99-40d5-ad10-78aeb1a2643d tempest-VolumeImageDependencyTests-1872904039 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_841df32c-8dbf-4be1-8de5-78ac4250b03d__ltt6vz2devstack@QuobyteHD' failed. Not Retrying. {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 22 03:34:16 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-86b3da79-ba99-40d5-ad10-78aeb1a2643d tempest-VolumeImageDependencyTests-1872904039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:34:16 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-86b3da79-ba99-40d5-ad10-78aeb1a2643d tempest-VolumeImageDependencyTests-1872904039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:34:16 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-86b3da79-ba99-40d5-ad10-78aeb1a2643d tempest-VolumeImageDependencyTests-1872904039 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:34:12Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a378b9b5-a55c-4d85-a1d6-c2e6fb7656da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3b05c76f0ea4e568978d4730297c646',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:34:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:34:12Z,use_quota=True,user_id='11644a6a0b4e4857b9e59828c05788ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:34:16 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-86b3da79-ba99-40d5-ad10-78aeb1a2643d tempest-VolumeImageDependencyTests-1872904039 None] Creating volume a378b9b5-a55c-4d85-a1d6-c2e6fb7656da {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:34:16 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-86b3da79-ba99-40d5-ad10-78aeb1a2643d tempest-VolumeImageDependencyTests-1872904039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:34:16 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-86b3da79-ba99-40d5-ad10-78aeb1a2643d tempest-VolumeImageDependencyTests-1872904039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:34:16 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-86b3da79-ba99-40d5-ad10-78aeb1a2643d tempest-VolumeImageDependencyTests-1872904039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:34:16 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-86b3da79-ba99-40d5-ad10-78aeb1a2643d tempest-VolumeImageDependencyTests-1872904039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:34:16 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-86b3da79-ba99-40d5-ad10-78aeb1a2643d tempest-VolumeImageDependencyTests-1872904039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:34:16 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-86b3da79-ba99-40d5-ad10-78aeb1a2643d tempest-VolumeImageDependencyTests-1872904039 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:34:16 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-86b3da79-ba99-40d5-ad10-78aeb1a2643d tempest-VolumeImageDependencyTests-1872904039 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:34:16 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-86b3da79-ba99-40d5-ad10-78aeb1a2643d tempest-VolumeImageDependencyTests-1872904039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a378b9b5-a55c-4d85-a1d6-c2e6fb7656da 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:16 devstack sudo[105331]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:16 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-aed87c3b-bd63-41b9-962f-0397ac009f3b tempest-VolumeDependencyTests-1653473485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-beea5fb1-e4c7-4d97-bdfb-fb034d108c44.e62f5bf1-f17a-4144-8778-460d79d7bf19" returned: 0 in 0.457s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:16 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-aed87c3b-bd63-41b9-962f-0397ac009f3b tempest-VolumeDependencyTests-1653473485 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-beea5fb1-e4c7-4d97-bdfb-fb034d108c44(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87747) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 03:34:16 devstack sudo[105340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a378b9b5-a55c-4d85-a1d6-c2e6fb7656da 1073741824 Jul 22 03:34:16 devstack sudo[105340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:16 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[66d74476-fb96-4cc1-9409-52852891d3b1]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:34:16 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-aed87c3b-bd63-41b9-962f-0397ac009f3b tempest-VolumeDependencyTests-1653473485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-beea5fb1-e4c7-4d97-bdfb-fb034d108c44 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:16 devstack sudo[105342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-beea5fb1-e4c7-4d97-bdfb-fb034d108c44 Jul 22 03:34:16 devstack sudo[105342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:16 devstack sudo[105340]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:16 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-86b3da79-ba99-40d5-ad10-78aeb1a2643d tempest-VolumeImageDependencyTests-1872904039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a378b9b5-a55c-4d85-a1d6-c2e6fb7656da 1073741824" returned: 0 in 0.519s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:16 devstack sudo[105342]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:16 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-aed87c3b-bd63-41b9-962f-0397ac009f3b tempest-VolumeDependencyTests-1653473485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-beea5fb1-e4c7-4d97-bdfb-fb034d108c44" returned: 0 in 0.498s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:16 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-aed87c3b-bd63-41b9-962f-0397ac009f3b tempest-VolumeDependencyTests-1653473485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-beea5fb1-e4c7-4d97-bdfb-fb034d108c44.e62f5bf1-f17a-4144-8778-460d79d7bf19 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:16 devstack sudo[105351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-beea5fb1-e4c7-4d97-bdfb-fb034d108c44.e62f5bf1-f17a-4144-8778-460d79d7bf19 Jul 22 03:34:16 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-86b3da79-ba99-40d5-ad10-78aeb1a2643d tempest-VolumeImageDependencyTests-1872904039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a378b9b5-a55c-4d85-a1d6-c2e6fb7656da {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:16 devstack sudo[105351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:16 devstack sudo[105353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a378b9b5-a55c-4d85-a1d6-c2e6fb7656da Jul 22 03:34:16 devstack sudo[105353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:17 devstack sudo[105353]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:17 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-86b3da79-ba99-40d5-ad10-78aeb1a2643d tempest-VolumeImageDependencyTests-1872904039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a378b9b5-a55c-4d85-a1d6-c2e6fb7656da" returned: 0 in 0.274s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:17 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-86b3da79-ba99-40d5-ad10-78aeb1a2643d tempest-VolumeImageDependencyTests-1872904039 None] <== create_volume: return (879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:34:17 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-86b3da79-ba99-40d5-ad10-78aeb1a2643d tempest-VolumeImageDependencyTests-1872904039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:34:17 devstack cinder-volume[87747]: DEBUG cinder.volume.volume_utils [None req-86b3da79-ba99-40d5-ad10-78aeb1a2643d tempest-VolumeImageDependencyTests-1872904039 None] Attempting download of 841df32c-8dbf-4be1-8de5-78ac4250b03d ((None, [{'url': 'file:///opt/stack/data/glance/images/841df32c-8dbf-4be1-8de5-78ac4250b03d', 'metadata': {}}])) to volume a378b9b5-a55c-4d85-a1d6-c2e6fb7656da. {{(pid=87747) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 22 03:34:17 devstack sudo[105351]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:17 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-aed87c3b-bd63-41b9-962f-0397ac009f3b tempest-VolumeDependencyTests-1653473485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-beea5fb1-e4c7-4d97-bdfb-fb034d108c44.e62f5bf1-f17a-4144-8778-460d79d7bf19" returned: 0 in 0.388s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:17 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-aed87c3b-bd63-41b9-962f-0397ac009f3b tempest-VolumeDependencyTests-1653473485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-beea5fb1-e4c7-4d97-bdfb-fb034d108c44.e62f5bf1-f17a-4144-8778-460d79d7bf19 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:17 devstack sudo[105359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-beea5fb1-e4c7-4d97-bdfb-fb034d108c44.e62f5bf1-f17a-4144-8778-460d79d7bf19 Jul 22 03:34:17 devstack sudo[105359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:17 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0613842-7765-4291-9e19-b28586f12d6b]: (4, 'raw') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:34:17 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-86b3da79-ba99-40d5-ad10-78aeb1a2643d tempest-VolumeImageDependencyTests-1872904039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_841df32c-8dbf-4be1-8de5-78ac4250b03d_k3xkxyry {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:17 devstack sudo[105361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_841df32c-8dbf-4be1-8de5-78ac4250b03d_k3xkxyry Jul 22 03:34:17 devstack sudo[105361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:17 devstack sudo[105359]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:17 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-aed87c3b-bd63-41b9-962f-0397ac009f3b tempest-VolumeDependencyTests-1653473485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-beea5fb1-e4c7-4d97-bdfb-fb034d108c44.e62f5bf1-f17a-4144-8778-460d79d7bf19" returned: 0 in 0.283s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:17 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-aed87c3b-bd63-41b9-962f-0397ac009f3b tempest-VolumeDependencyTests-1653473485 None] Lock "cinder-quobyte-e62f5bf1-f17a-4144-8778-460d79d7bf19" released by "_delete_snapshot" :: held 1.751s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:34:17 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-aed87c3b-bd63-41b9-962f-0397ac009f3b tempest-VolumeDependencyTests-1653473485 None] Lock "cinder-quobyte-beea5fb1-e4c7-4d97-bdfb-fb034d108c44" released by "delete_snapshot" :: held 1.780s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:34:17 devstack sudo[105361]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:17 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-86b3da79-ba99-40d5-ad10-78aeb1a2643d tempest-VolumeImageDependencyTests-1872904039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_841df32c-8dbf-4be1-8de5-78ac4250b03d_k3xkxyry" returned: 0 in 0.389s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:17 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-86b3da79-ba99-40d5-ad10-78aeb1a2643d tempest-VolumeImageDependencyTests-1872904039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_841df32c-8dbf-4be1-8de5-78ac4250b03d_k3xkxyry {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:17 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-aed87c3b-bd63-41b9-962f-0397ac009f3b tempest-VolumeDependencyTests-1653473485 None] Created reservations ['b4b8bf1e-a694-4d4c-9778-c1ca47530728', '098e0307-5ae6-47dd-9f5c-ff44ca0489b0', '3646ef7c-d627-4383-b987-0c497b845b86', '287f3ad0-b1e5-4d93-b3b7-2b2dd7492b3b'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:34:17 devstack sudo[105366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_841df32c-8dbf-4be1-8de5-78ac4250b03d_k3xkxyry Jul 22 03:34:17 devstack sudo[105366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:17 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-aed87c3b-bd63-41b9-962f-0397ac009f3b tempest-VolumeDependencyTests-1653473485 None] Delete snapshot completed successfully. Jul 22 03:34:17 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-aed87c3b-bd63-41b9-962f-0397ac009f3b tempest-VolumeDependencyTests-1653473485 None] Lock "cinder-e62f5bf1-f17a-4144-8778-460d79d7bf19-delete_snapshot" released by "delete_snapshot" :: held 2.062s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:34:17 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-d2003754-3c2a-4a25-ac2e-8e84648e77ec tempest-VolumeDependencyTests-1653473485 None] Acquiring lock "cinder-beea5fb1-e4c7-4d97-bdfb-fb034d108c44-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:34:17 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-d2003754-3c2a-4a25-ac2e-8e84648e77ec tempest-VolumeDependencyTests-1653473485 None] Lock "cinder-beea5fb1-e4c7-4d97-bdfb-fb034d108c44-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:34:17 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-d2003754-3c2a-4a25-ac2e-8e84648e77ec tempest-VolumeDependencyTests-1653473485 None] Acquiring lock "cinder-quobyte-beea5fb1-e4c7-4d97-bdfb-fb034d108c44" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:34:17 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-d2003754-3c2a-4a25-ac2e-8e84648e77ec tempest-VolumeDependencyTests-1653473485 None] Lock "cinder-quobyte-beea5fb1-e4c7-4d97-bdfb-fb034d108c44" acquired by "delete_volume" :: waited 0.020s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:34:17 devstack sudo[105366]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:18 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-86b3da79-ba99-40d5-ad10-78aeb1a2643d tempest-VolumeImageDependencyTests-1872904039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_841df32c-8dbf-4be1-8de5-78ac4250b03d_k3xkxyry" returned: 1 in 0.442s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:18 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-86b3da79-ba99-40d5-ad10-78aeb1a2643d tempest-VolumeImageDependencyTests-1872904039 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_841df32c-8dbf-4be1-8de5-78ac4250b03d_k3xkxyry' failed. Not Retrying. {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 22 03:34:18 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[953fe9a7-52a0-4ac8-97d5-4a2c5180d592]: (4, 'raw') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:34:18 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-86b3da79-ba99-40d5-ad10-78aeb1a2643d tempest-VolumeImageDependencyTests-1872904039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_841df32c-8dbf-4be1-8de5-78ac4250b03d__ltt6vz2devstack@QuobyteHD {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:18 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[99012957-ed09-40c4-84c2-acff9ea6b11c]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:34:18 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d2003754-3c2a-4a25-ac2e-8e84648e77ec tempest-VolumeDependencyTests-1653473485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-beea5fb1-e4c7-4d97-bdfb-fb034d108c44 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:18 devstack sudo[105370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_841df32c-8dbf-4be1-8de5-78ac4250b03d__ltt6vz2devstack@QuobyteHD Jul 22 03:34:18 devstack sudo[105370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:18 devstack sudo[105371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-beea5fb1-e4c7-4d97-bdfb-fb034d108c44 Jul 22 03:34:18 devstack sudo[105371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:18 devstack sudo[105370]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:18 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-86b3da79-ba99-40d5-ad10-78aeb1a2643d tempest-VolumeImageDependencyTests-1872904039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_841df32c-8dbf-4be1-8de5-78ac4250b03d__ltt6vz2devstack@QuobyteHD" returned: 0 in 0.411s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:18 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-86b3da79-ba99-40d5-ad10-78aeb1a2643d tempest-VolumeImageDependencyTests-1872904039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_841df32c-8dbf-4be1-8de5-78ac4250b03d__ltt6vz2devstack@QuobyteHD {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:18 devstack sudo[105371]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:18 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d2003754-3c2a-4a25-ac2e-8e84648e77ec tempest-VolumeDependencyTests-1653473485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-beea5fb1-e4c7-4d97-bdfb-fb034d108c44" returned: 0 in 0.434s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:18 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d2003754-3c2a-4a25-ac2e-8e84648e77ec tempest-VolumeDependencyTests-1653473485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-beea5fb1-e4c7-4d97-bdfb-fb034d108c44 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:18 devstack sudo[105381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-beea5fb1-e4c7-4d97-bdfb-fb034d108c44 Jul 22 03:34:18 devstack sudo[105381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:18 devstack sudo[105380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_841df32c-8dbf-4be1-8de5-78ac4250b03d__ltt6vz2devstack@QuobyteHD Jul 22 03:34:18 devstack sudo[105380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:18 devstack sudo[105381]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:18 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d2003754-3c2a-4a25-ac2e-8e84648e77ec tempest-VolumeDependencyTests-1653473485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-beea5fb1-e4c7-4d97-bdfb-fb034d108c44" returned: 0 in 0.366s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:18 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-d2003754-3c2a-4a25-ac2e-8e84648e77ec tempest-VolumeDependencyTests-1653473485 None] Lock "cinder-quobyte-beea5fb1-e4c7-4d97-bdfb-fb034d108c44" released by "delete_volume" :: held 0.910s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:34:18 devstack sudo[105380]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:18 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-86b3da79-ba99-40d5-ad10-78aeb1a2643d tempest-VolumeImageDependencyTests-1872904039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_841df32c-8dbf-4be1-8de5-78ac4250b03d__ltt6vz2devstack@QuobyteHD" returned: 1 in 0.470s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:18 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-86b3da79-ba99-40d5-ad10-78aeb1a2643d tempest-VolumeImageDependencyTests-1872904039 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_841df32c-8dbf-4be1-8de5-78ac4250b03d__ltt6vz2devstack@QuobyteHD' failed. Not Retrying. {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 22 03:34:18 devstack cinder-volume[87747]: DEBUG cinder.image.image_utils [None req-86b3da79-ba99-40d5-ad10-78aeb1a2643d tempest-VolumeImageDependencyTests-1872904039 None] 841df32c-8dbf-4be1-8de5-78ac4250b03d was raw, converting to qcow2 {{(pid=87747) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 22 03:34:18 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-86b3da79-ba99-40d5-ad10-78aeb1a2643d tempest-VolumeImageDependencyTests-1872904039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_841df32c-8dbf-4be1-8de5-78ac4250b03d__ltt6vz2devstack@QuobyteHD /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a378b9b5-a55c-4d85-a1d6-c2e6fb7656da {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:18 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce96d63e-cf57-4aae-bb6e-89de8b21f709 tempest-CinderUnicodeTest-644920047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:34:18 devstack sudo[105388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_841df32c-8dbf-4be1-8de5-78ac4250b03d__ltt6vz2devstack@QuobyteHD /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a378b9b5-a55c-4d85-a1d6-c2e6fb7656da Jul 22 03:34:18 devstack sudo[105388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:18 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-ce96d63e-cf57-4aae-bb6e-89de8b21f709 tempest-CinderUnicodeTest-644920047 None] Flow 'volume_create_manager' (2b3468a7-f8f9-48be-912f-ecdc0d3e1695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:34:18 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-ce96d63e-cf57-4aae-bb6e-89de8b21f709 tempest-CinderUnicodeTest-644920047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b2b1b7e-32a8-4394-901a-d1ddf8746e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:34:18 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-ce96d63e-cf57-4aae-bb6e-89de8b21f709 tempest-CinderUnicodeTest-644920047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b2b1b7e-32a8-4394-901a-d1ddf8746e14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:34:18Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f593f44-d66d-4e38-8c03-e8ec6ac3e6ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d7514eedb354a16922de8823fc3ec81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:34:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:34:19Z,use_quota=True,user_id='045ed1f056f945a6a2894c91934036af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:34:18 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-ce96d63e-cf57-4aae-bb6e-89de8b21f709 tempest-CinderUnicodeTest-644920047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94740f18-9aed-45ee-93cb-5d5d8153eb0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:34:18 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-ce96d63e-cf57-4aae-bb6e-89de8b21f709 tempest-CinderUnicodeTest-644920047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94740f18-9aed-45ee-93cb-5d5d8153eb0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:34:18 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-ce96d63e-cf57-4aae-bb6e-89de8b21f709 tempest-CinderUnicodeTest-644920047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afadad16-0fe4-4f0f-9be7-709fd3774f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:34:19 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-ce96d63e-cf57-4aae-bb6e-89de8b21f709 tempest-CinderUnicodeTest-644920047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afadad16-0fe4-4f0f-9be7-709fd3774f0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f593f44-d66d-4e38-8c03-e8ec6ac3e6ea', 'volume_name': 'volume-4f593f44-d66d-4e38-8c03-e8ec6ac3e6ea', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:34:19 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-ce96d63e-cf57-4aae-bb6e-89de8b21f709 tempest-CinderUnicodeTest-644920047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a73f200e-eff5-4570-9ba2-bbe25036d14a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:34:19 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-ce96d63e-cf57-4aae-bb6e-89de8b21f709 tempest-CinderUnicodeTest-644920047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a73f200e-eff5-4570-9ba2-bbe25036d14a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:34:19 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-ce96d63e-cf57-4aae-bb6e-89de8b21f709 tempest-CinderUnicodeTest-644920047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26c8261c-707a-4605-844f-6eb4c609785b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:34:19 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-ce96d63e-cf57-4aae-bb6e-89de8b21f709 tempest-CinderUnicodeTest-644920047 None] Volume 4f593f44-d66d-4e38-8c03-e8ec6ac3e6ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f593f44-d66d-4e38-8c03-e8ec6ac3e6ea', 'volume_size': 1} Jul 22 03:34:19 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-ce96d63e-cf57-4aae-bb6e-89de8b21f709 tempest-CinderUnicodeTest-644920047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:34:19 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-ce96d63e-cf57-4aae-bb6e-89de8b21f709 tempest-CinderUnicodeTest-644920047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:34:19 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-ce96d63e-cf57-4aae-bb6e-89de8b21f709 tempest-CinderUnicodeTest-644920047 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:34:18Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f593f44-d66d-4e38-8c03-e8ec6ac3e6ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d7514eedb354a16922de8823fc3ec81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:34:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:34:19Z,use_quota=True,user_id='045ed1f056f945a6a2894c91934036af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:34:19 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-ce96d63e-cf57-4aae-bb6e-89de8b21f709 tempest-CinderUnicodeTest-644920047 None] Creating volume 4f593f44-d66d-4e38-8c03-e8ec6ac3e6ea {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:34:19 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-ce96d63e-cf57-4aae-bb6e-89de8b21f709 tempest-CinderUnicodeTest-644920047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:34:19 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-ce96d63e-cf57-4aae-bb6e-89de8b21f709 tempest-CinderUnicodeTest-644920047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:34:19 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-ce96d63e-cf57-4aae-bb6e-89de8b21f709 tempest-CinderUnicodeTest-644920047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:34:19 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-ce96d63e-cf57-4aae-bb6e-89de8b21f709 tempest-CinderUnicodeTest-644920047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:34:19 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-ce96d63e-cf57-4aae-bb6e-89de8b21f709 tempest-CinderUnicodeTest-644920047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:34:19 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-ce96d63e-cf57-4aae-bb6e-89de8b21f709 tempest-CinderUnicodeTest-644920047 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:34:19 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-ce96d63e-cf57-4aae-bb6e-89de8b21f709 tempest-CinderUnicodeTest-644920047 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:34:19 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ce96d63e-cf57-4aae-bb6e-89de8b21f709 tempest-CinderUnicodeTest-644920047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4f593f44-d66d-4e38-8c03-e8ec6ac3e6ea 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:19 devstack sudo[105390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4f593f44-d66d-4e38-8c03-e8ec6ac3e6ea 1073741824 Jul 22 03:34:19 devstack sudo[105390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:19 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-d2003754-3c2a-4a25-ac2e-8e84648e77ec tempest-VolumeDependencyTests-1653473485 None] Created reservations ['ab378f3b-5e3f-4b3e-9127-2602dc11321d', '4103e6dd-4e64-4b4e-9823-bc44ab88223b', '035b3309-d699-4bed-8a85-c127911fcb9c', 'd5be6c04-c969-4073-8ae7-b541afbc6def'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:34:19 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-d2003754-3c2a-4a25-ac2e-8e84648e77ec tempest-VolumeDependencyTests-1653473485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:34:19 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-d2003754-3c2a-4a25-ac2e-8e84648e77ec tempest-VolumeDependencyTests-1653473485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:34:19 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-d2003754-3c2a-4a25-ac2e-8e84648e77ec tempest-VolumeDependencyTests-1653473485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:34:19 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-d2003754-3c2a-4a25-ac2e-8e84648e77ec tempest-VolumeDependencyTests-1653473485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:34:19 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-d2003754-3c2a-4a25-ac2e-8e84648e77ec tempest-VolumeDependencyTests-1653473485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:34:19 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d2003754-3c2a-4a25-ac2e-8e84648e77ec tempest-VolumeDependencyTests-1653473485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:19 devstack sudo[105394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:34:19 devstack sudo[105394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:19 devstack sudo[105394]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:19 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d2003754-3c2a-4a25-ac2e-8e84648e77ec tempest-VolumeDependencyTests-1653473485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.288s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:19 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-d2003754-3c2a-4a25-ac2e-8e84648e77ec tempest-VolumeDependencyTests-1653473485 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:34:19 devstack sudo[105388]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:19 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-86b3da79-ba99-40d5-ad10-78aeb1a2643d tempest-VolumeImageDependencyTests-1872904039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_841df32c-8dbf-4be1-8de5-78ac4250b03d__ltt6vz2devstack@QuobyteHD /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a378b9b5-a55c-4d85-a1d6-c2e6fb7656da" returned: 0 in 0.578s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:19 devstack cinder-volume[87747]: DEBUG cinder.image.image_utils [None req-86b3da79-ba99-40d5-ad10-78aeb1a2643d tempest-VolumeImageDependencyTests-1872904039 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_841df32c-8dbf-4be1-8de5-78ac4250b03d__ltt6vz2devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a378b9b5-a55c-4d85-a1d6-c2e6fb7656da {{(pid=87747) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 22 03:34:19 devstack cinder-volume[87747]: INFO cinder.image.image_utils [None req-86b3da79-ba99-40d5-ad10-78aeb1a2643d tempest-VolumeImageDependencyTests-1872904039 None] Converted 0.00 MB image at 0.00 MB/s Jul 22 03:34:19 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-86b3da79-ba99-40d5-ad10-78aeb1a2643d tempest-VolumeImageDependencyTests-1872904039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a378b9b5-a55c-4d85-a1d6-c2e6fb7656da 1G {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:19 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-d2003754-3c2a-4a25-ac2e-8e84648e77ec tempest-VolumeDependencyTests-1653473485 None] Deleted volume successfully. Jul 22 03:34:19 devstack sudo[105402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a378b9b5-a55c-4d85-a1d6-c2e6fb7656da 1G Jul 22 03:34:19 devstack sudo[105402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:19 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-d2003754-3c2a-4a25-ac2e-8e84648e77ec tempest-VolumeDependencyTests-1653473485 None] Lock "cinder-beea5fb1-e4c7-4d97-bdfb-fb034d108c44-delete_volume" released by "delete_volume" :: held 1.651s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:34:19 devstack sudo[105390]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:19 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ce96d63e-cf57-4aae-bb6e-89de8b21f709 tempest-CinderUnicodeTest-644920047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4f593f44-d66d-4e38-8c03-e8ec6ac3e6ea 1073741824" returned: 0 in 0.571s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:19 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ce96d63e-cf57-4aae-bb6e-89de8b21f709 tempest-CinderUnicodeTest-644920047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4f593f44-d66d-4e38-8c03-e8ec6ac3e6ea {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:19 devstack sudo[105405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4f593f44-d66d-4e38-8c03-e8ec6ac3e6ea Jul 22 03:34:19 devstack sudo[105405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:19 devstack sudo[105402]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:19 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-86b3da79-ba99-40d5-ad10-78aeb1a2643d tempest-VolumeImageDependencyTests-1872904039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a378b9b5-a55c-4d85-a1d6-c2e6fb7656da 1G" returned: 0 in 0.377s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:19 devstack cinder-volume[87747]: DEBUG cinder.volume.volume_utils [None req-86b3da79-ba99-40d5-ad10-78aeb1a2643d tempest-VolumeImageDependencyTests-1872904039 None] Downloaded image 841df32c-8dbf-4be1-8de5-78ac4250b03d ((None, [{'url': 'file:///opt/stack/data/glance/images/841df32c-8dbf-4be1-8de5-78ac4250b03d', 'metadata': {}}])) to volume a378b9b5-a55c-4d85-a1d6-c2e6fb7656da successfully. {{(pid=87747) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 22 03:34:19 devstack cinder-volume[87747]: DEBUG cinder.image.image_utils [None req-86b3da79-ba99-40d5-ad10-78aeb1a2643d tempest-VolumeImageDependencyTests-1872904039 None] Temporary image 841df32c-8dbf-4be1-8de5-78ac4250b03d for user 11644a6a0b4e4857b9e59828c05788ba is deleted. {{(pid=87747) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 22 03:34:19 devstack cinder-volume[87747]: DEBUG cinder.volume.volume_utils [None req-86b3da79-ba99-40d5-ad10-78aeb1a2643d tempest-VolumeImageDependencyTests-1872904039 None] Marking volume a378b9b5-a55c-4d85-a1d6-c2e6fb7656da as bootable. {{(pid=87747) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 22 03:34:19 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-86b3da79-ba99-40d5-ad10-78aeb1a2643d tempest-VolumeImageDependencyTests-1872904039 None] Copying metadata from image 841df32c-8dbf-4be1-8de5-78ac4250b03d to a378b9b5-a55c-4d85-a1d6-c2e6fb7656da. {{(pid=87747) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 22 03:34:19 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-86b3da79-ba99-40d5-ad10-78aeb1a2643d tempest-VolumeImageDependencyTests-1872904039 None] Creating volume glance metadata for volume a378b9b5-a55c-4d85-a1d6-c2e6fb7656da backed by image 841df32c-8dbf-4be1-8de5-78ac4250b03d with: {'image_id': '841df32c-8dbf-4be1-8de5-78ac4250b03d', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '8a2f0f2ff7e21c81c3eba38667346fca', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87747) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 22 03:34:19 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-86b3da79-ba99-40d5-ad10-78aeb1a2643d tempest-VolumeImageDependencyTests-1872904039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cef70de4-794f-4e57-8435-e2dd1009b591) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a378b9b5-a55c-4d85-a1d6-c2e6fb7656da', 'volume_size': 1, 'image_id': '841df32c-8dbf-4be1-8de5-78ac4250b03d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/841df32c-8dbf-4be1-8de5-78ac4250b03d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8a2f0f2ff7e21c81c3eba38667346fca', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e3b05c76f0ea4e568978d4730297c646', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5e6d5003f89674c9645b5001bb41c43f4a0e60e0c4d418e1639476b821c33fa9635c7aab1cac5dd01b5bc6d4bc318ecc7144712668d50aa3de530c17ac8b44b3', 'id': '841df32c-8dbf-4be1-8de5-78ac4250b03d', 'created_at': datetime.datetime(2026, 7, 22, 1, 34, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 22, 1, 34, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/841df32c-8dbf-4be1-8de5-78ac4250b03d/file', 'properties': {}}, 'image_service': }' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:34:19 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-86b3da79-ba99-40d5-ad10-78aeb1a2643d tempest-VolumeImageDependencyTests-1872904039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55d41f40-f7b0-4824-a3ed-e405a667536c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:34:19 devstack sudo[105405]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:19 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ce96d63e-cf57-4aae-bb6e-89de8b21f709 tempest-CinderUnicodeTest-644920047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4f593f44-d66d-4e38-8c03-e8ec6ac3e6ea" returned: 0 in 0.333s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:19 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-ce96d63e-cf57-4aae-bb6e-89de8b21f709 tempest-CinderUnicodeTest-644920047 None] <== create_volume: return (947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:34:19 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-ce96d63e-cf57-4aae-bb6e-89de8b21f709 tempest-CinderUnicodeTest-644920047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.950s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:34:19 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-ce96d63e-cf57-4aae-bb6e-89de8b21f709 tempest-CinderUnicodeTest-644920047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26c8261c-707a-4605-844f-6eb4c609785b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f593f44-d66d-4e38-8c03-e8ec6ac3e6ea', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:34:19 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-ce96d63e-cf57-4aae-bb6e-89de8b21f709 tempest-CinderUnicodeTest-644920047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f51077a-0619-4662-8edd-b9487276135d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:34:19 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-86b3da79-ba99-40d5-ad10-78aeb1a2643d tempest-VolumeImageDependencyTests-1872904039 None] Volume volume-a378b9b5-a55c-4d85-a1d6-c2e6fb7656da (a378b9b5-a55c-4d85-a1d6-c2e6fb7656da): created successfully Jul 22 03:34:19 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-86b3da79-ba99-40d5-ad10-78aeb1a2643d tempest-VolumeImageDependencyTests-1872904039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55d41f40-f7b0-4824-a3ed-e405a667536c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:34:20 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-86b3da79-ba99-40d5-ad10-78aeb1a2643d tempest-VolumeImageDependencyTests-1872904039 None] Flow 'volume_create_manager' (ae5a50d3-f6ab-4317-84da-a05a7ae5b8ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:34:20 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-ce96d63e-cf57-4aae-bb6e-89de8b21f709 tempest-CinderUnicodeTest-644920047 None] Volume volume-4f593f44-d66d-4e38-8c03-e8ec6ac3e6ea (4f593f44-d66d-4e38-8c03-e8ec6ac3e6ea): created successfully Jul 22 03:34:20 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-ce96d63e-cf57-4aae-bb6e-89de8b21f709 tempest-CinderUnicodeTest-644920047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f51077a-0619-4662-8edd-b9487276135d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:34:20 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-ce96d63e-cf57-4aae-bb6e-89de8b21f709 tempest-CinderUnicodeTest-644920047 None] Flow 'volume_create_manager' (2b3468a7-f8f9-48be-912f-ecdc0d3e1695) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:34:20 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-86b3da79-ba99-40d5-ad10-78aeb1a2643d tempest-VolumeImageDependencyTests-1872904039 None] Created volume successfully. Jul 22 03:34:20 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-ce96d63e-cf57-4aae-bb6e-89de8b21f709 tempest-CinderUnicodeTest-644920047 None] Created volume successfully. Jul 22 03:34:20 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-f86612f6-bce4-4354-9a25-1e6e9a06df65 tempest-VolumeDependencyTests-1653473485 None] Acquiring lock "cinder-3b3cfedb-d046-4b1b-840a-4aacdccc90f8-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:34:20 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-f86612f6-bce4-4354-9a25-1e6e9a06df65 tempest-VolumeDependencyTests-1653473485 None] Lock "cinder-3b3cfedb-d046-4b1b-840a-4aacdccc90f8-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:34:20 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-f86612f6-bce4-4354-9a25-1e6e9a06df65 tempest-VolumeDependencyTests-1653473485 None] Acquiring lock "cinder-quobyte-3b3cfedb-d046-4b1b-840a-4aacdccc90f8" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:34:20 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-f86612f6-bce4-4354-9a25-1e6e9a06df65 tempest-VolumeDependencyTests-1653473485 None] Lock "cinder-quobyte-3b3cfedb-d046-4b1b-840a-4aacdccc90f8" acquired by "delete_volume" :: waited 0.014s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:34:20 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[54b2a76e-599e-4072-afc3-e1e8518ea672]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:34:20 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f86612f6-bce4-4354-9a25-1e6e9a06df65 tempest-VolumeDependencyTests-1653473485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3b3cfedb-d046-4b1b-840a-4aacdccc90f8 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:20 devstack sudo[105412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3b3cfedb-d046-4b1b-840a-4aacdccc90f8 Jul 22 03:34:20 devstack sudo[105412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:20 devstack sudo[105412]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:20 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f86612f6-bce4-4354-9a25-1e6e9a06df65 tempest-VolumeDependencyTests-1653473485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3b3cfedb-d046-4b1b-840a-4aacdccc90f8" returned: 0 in 0.398s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:20 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f86612f6-bce4-4354-9a25-1e6e9a06df65 tempest-VolumeDependencyTests-1653473485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3b3cfedb-d046-4b1b-840a-4aacdccc90f8 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:20 devstack sudo[105417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3b3cfedb-d046-4b1b-840a-4aacdccc90f8 Jul 22 03:34:20 devstack sudo[105417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:20 devstack sudo[105417]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:20 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f86612f6-bce4-4354-9a25-1e6e9a06df65 tempest-VolumeDependencyTests-1653473485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3b3cfedb-d046-4b1b-840a-4aacdccc90f8" returned: 0 in 0.282s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:20 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-fa0ae87f-40eb-4211-acab-207657f408a3 tempest-VolumeImageDependencyTests-1872904039 None] Acquiring lock "cinder-a378b9b5-a55c-4d85-a1d6-c2e6fb7656da-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:34:20 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-f86612f6-bce4-4354-9a25-1e6e9a06df65 tempest-VolumeDependencyTests-1653473485 None] Lock "cinder-quobyte-3b3cfedb-d046-4b1b-840a-4aacdccc90f8" released by "delete_volume" :: held 0.748s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:34:20 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-fa0ae87f-40eb-4211-acab-207657f408a3 tempest-VolumeImageDependencyTests-1872904039 None] Lock "cinder-a378b9b5-a55c-4d85-a1d6-c2e6fb7656da-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:34:21 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-fa0ae87f-40eb-4211-acab-207657f408a3 tempest-VolumeImageDependencyTests-1872904039 None] Acquiring lock "cinder-quobyte-a378b9b5-a55c-4d85-a1d6-c2e6fb7656da" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:34:21 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-fa0ae87f-40eb-4211-acab-207657f408a3 tempest-VolumeImageDependencyTests-1872904039 None] Lock "cinder-quobyte-a378b9b5-a55c-4d85-a1d6-c2e6fb7656da" acquired by "delete_volume" :: waited 0.028s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:34:21 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-f86612f6-bce4-4354-9a25-1e6e9a06df65 tempest-VolumeDependencyTests-1653473485 None] Created reservations ['280c8c75-558d-4b5f-9c94-da2c57044262', '0238a918-32c2-4d01-a092-e4fdafc462bf', 'f71a3b55-9432-416d-98eb-36f1f3fb0db3', '09557104-27db-4c76-be96-3e8c98a00224'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:34:21 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b980e1-5286-4c20-8fa3-c9bd3bb936b4]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:34:21 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-fa0ae87f-40eb-4211-acab-207657f408a3 tempest-VolumeImageDependencyTests-1872904039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a378b9b5-a55c-4d85-a1d6-c2e6fb7656da {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:21 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-f86612f6-bce4-4354-9a25-1e6e9a06df65 tempest-VolumeDependencyTests-1653473485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:34:21 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-f86612f6-bce4-4354-9a25-1e6e9a06df65 tempest-VolumeDependencyTests-1653473485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:34:21 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-f86612f6-bce4-4354-9a25-1e6e9a06df65 tempest-VolumeDependencyTests-1653473485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:34:21 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-f86612f6-bce4-4354-9a25-1e6e9a06df65 tempest-VolumeDependencyTests-1653473485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:34:21 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-f86612f6-bce4-4354-9a25-1e6e9a06df65 tempest-VolumeDependencyTests-1653473485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:34:21 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f86612f6-bce4-4354-9a25-1e6e9a06df65 tempest-VolumeDependencyTests-1653473485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:21 devstack sudo[105420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a378b9b5-a55c-4d85-a1d6-c2e6fb7656da Jul 22 03:34:21 devstack sudo[105420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:21 devstack sudo[105421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:34:21 devstack sudo[105421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:21 devstack sudo[105421]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:21 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f86612f6-bce4-4354-9a25-1e6e9a06df65 tempest-VolumeDependencyTests-1653473485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.368s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:21 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-f86612f6-bce4-4354-9a25-1e6e9a06df65 tempest-VolumeDependencyTests-1653473485 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:34:21 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-f86612f6-bce4-4354-9a25-1e6e9a06df65 tempest-VolumeDependencyTests-1653473485 None] Deleted volume successfully. Jul 22 03:34:21 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-f86612f6-bce4-4354-9a25-1e6e9a06df65 tempest-VolumeDependencyTests-1653473485 None] Lock "cinder-3b3cfedb-d046-4b1b-840a-4aacdccc90f8-delete_volume" released by "delete_volume" :: held 1.510s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:34:21 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8e3bdb2-273f-464e-bb88-9c83464b9e31 tempest-CinderUnicodeTest-644920047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:34:21 devstack sudo[105420]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:21 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-a8e3bdb2-273f-464e-bb88-9c83464b9e31 tempest-CinderUnicodeTest-644920047 None] Flow 'volume_create_manager' (c581f63f-243d-47c8-8e8b-730ab90f2212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:34:21 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-a8e3bdb2-273f-464e-bb88-9c83464b9e31 tempest-CinderUnicodeTest-644920047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0bac29b-c243-4595-bdcb-92ab8d099d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:34:21 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-fa0ae87f-40eb-4211-acab-207657f408a3 tempest-VolumeImageDependencyTests-1872904039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a378b9b5-a55c-4d85-a1d6-c2e6fb7656da" returned: 0 in 0.694s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:21 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-fa0ae87f-40eb-4211-acab-207657f408a3 tempest-VolumeImageDependencyTests-1872904039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a378b9b5-a55c-4d85-a1d6-c2e6fb7656da {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:21 devstack sudo[105428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a378b9b5-a55c-4d85-a1d6-c2e6fb7656da Jul 22 03:34:21 devstack sudo[105428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:21 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-a8e3bdb2-273f-464e-bb88-9c83464b9e31 tempest-CinderUnicodeTest-644920047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0bac29b-c243-4595-bdcb-92ab8d099d14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:34:21Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1059964309',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64a53429-45d6-409c-a4eb-2a5241b1d20b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d7514eedb354a16922de8823fc3ec81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:34:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:34:22Z,use_quota=True,user_id='045ed1f056f945a6a2894c91934036af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:34:21 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-a8e3bdb2-273f-464e-bb88-9c83464b9e31 tempest-CinderUnicodeTest-644920047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efc86790-931b-44f9-b764-dc4d22db55a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:34:21 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-a8e3bdb2-273f-464e-bb88-9c83464b9e31 tempest-CinderUnicodeTest-644920047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efc86790-931b-44f9-b764-dc4d22db55a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:34:21 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-a8e3bdb2-273f-464e-bb88-9c83464b9e31 tempest-CinderUnicodeTest-644920047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3038dfb4-7ae7-41fb-900b-cac45e4a22cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:34:21 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-a8e3bdb2-273f-464e-bb88-9c83464b9e31 tempest-CinderUnicodeTest-644920047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3038dfb4-7ae7-41fb-900b-cac45e4a22cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64a53429-45d6-409c-a4eb-2a5241b1d20b', 'volume_name': 'volume-64a53429-45d6-409c-a4eb-2a5241b1d20b', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:34:21 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-a8e3bdb2-273f-464e-bb88-9c83464b9e31 tempest-CinderUnicodeTest-644920047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9a28f38-ab17-47fe-8469-e83ff2a3eac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:34:21 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-a8e3bdb2-273f-464e-bb88-9c83464b9e31 tempest-CinderUnicodeTest-644920047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9a28f38-ab17-47fe-8469-e83ff2a3eac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:34:21 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-a8e3bdb2-273f-464e-bb88-9c83464b9e31 tempest-CinderUnicodeTest-644920047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35857c66-1e77-4b9b-bef2-0db44ac43ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:34:21 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-a8e3bdb2-273f-464e-bb88-9c83464b9e31 tempest-CinderUnicodeTest-644920047 None] Volume 64a53429-45d6-409c-a4eb-2a5241b1d20b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64a53429-45d6-409c-a4eb-2a5241b1d20b', 'volume_size': 1} Jul 22 03:34:21 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-a8e3bdb2-273f-464e-bb88-9c83464b9e31 tempest-CinderUnicodeTest-644920047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:34:21 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-a8e3bdb2-273f-464e-bb88-9c83464b9e31 tempest-CinderUnicodeTest-644920047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:34:21 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-a8e3bdb2-273f-464e-bb88-9c83464b9e31 tempest-CinderUnicodeTest-644920047 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:34:21Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1059964309',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64a53429-45d6-409c-a4eb-2a5241b1d20b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d7514eedb354a16922de8823fc3ec81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:34:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:34:22Z,use_quota=True,user_id='045ed1f056f945a6a2894c91934036af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:34:21 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-a8e3bdb2-273f-464e-bb88-9c83464b9e31 tempest-CinderUnicodeTest-644920047 None] Creating volume 64a53429-45d6-409c-a4eb-2a5241b1d20b {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:34:21 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-a8e3bdb2-273f-464e-bb88-9c83464b9e31 tempest-CinderUnicodeTest-644920047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:34:21 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-a8e3bdb2-273f-464e-bb88-9c83464b9e31 tempest-CinderUnicodeTest-644920047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:34:21 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-a8e3bdb2-273f-464e-bb88-9c83464b9e31 tempest-CinderUnicodeTest-644920047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:34:21 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-a8e3bdb2-273f-464e-bb88-9c83464b9e31 tempest-CinderUnicodeTest-644920047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:34:21 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-a8e3bdb2-273f-464e-bb88-9c83464b9e31 tempest-CinderUnicodeTest-644920047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:34:21 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-a8e3bdb2-273f-464e-bb88-9c83464b9e31 tempest-CinderUnicodeTest-644920047 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:34:21 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-a8e3bdb2-273f-464e-bb88-9c83464b9e31 tempest-CinderUnicodeTest-644920047 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:34:21 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-a8e3bdb2-273f-464e-bb88-9c83464b9e31 tempest-CinderUnicodeTest-644920047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-64a53429-45d6-409c-a4eb-2a5241b1d20b 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:21 devstack sudo[105430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-64a53429-45d6-409c-a4eb-2a5241b1d20b 1073741824 Jul 22 03:34:21 devstack sudo[105430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:22 devstack sudo[105428]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-fa0ae87f-40eb-4211-acab-207657f408a3 tempest-VolumeImageDependencyTests-1872904039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a378b9b5-a55c-4d85-a1d6-c2e6fb7656da" returned: 0 in 0.330s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:22 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-fa0ae87f-40eb-4211-acab-207657f408a3 tempest-VolumeImageDependencyTests-1872904039 None] Lock "cinder-quobyte-a378b9b5-a55c-4d85-a1d6-c2e6fb7656da" released by "delete_volume" :: held 1.081s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:34:22 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-fa0ae87f-40eb-4211-acab-207657f408a3 tempest-VolumeImageDependencyTests-1872904039 None] Created reservations ['f7cf2404-80ec-4097-a4b7-b67738de492c', 'ad9af7eb-e3df-4a7a-830c-a8ebe52b3668', 'c8343e1e-99d8-44f7-a189-8be03ce0d731', '4ddcc2f5-ae8f-454b-af87-30fe9b028972'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:34:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-fa0ae87f-40eb-4211-acab-207657f408a3 tempest-VolumeImageDependencyTests-1872904039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:34:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-fa0ae87f-40eb-4211-acab-207657f408a3 tempest-VolumeImageDependencyTests-1872904039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:34:22 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-fa0ae87f-40eb-4211-acab-207657f408a3 tempest-VolumeImageDependencyTests-1872904039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:34:22 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-fa0ae87f-40eb-4211-acab-207657f408a3 tempest-VolumeImageDependencyTests-1872904039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:34:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-fa0ae87f-40eb-4211-acab-207657f408a3 tempest-VolumeImageDependencyTests-1872904039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:34:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-fa0ae87f-40eb-4211-acab-207657f408a3 tempest-VolumeImageDependencyTests-1872904039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:22 devstack sudo[105436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:34:22 devstack sudo[105436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:22 devstack cinder-volume[87747]: DEBUG oslo_service.periodic_task [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87747) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 03:34:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:34:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:34:22 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:34:22 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:34:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:34:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:22 devstack sudo[105430]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-a8e3bdb2-273f-464e-bb88-9c83464b9e31 tempest-CinderUnicodeTest-644920047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-64a53429-45d6-409c-a4eb-2a5241b1d20b 1073741824" returned: 0 in 0.626s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:22 devstack sudo[105438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:34:22 devstack sudo[105438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-a8e3bdb2-273f-464e-bb88-9c83464b9e31 tempest-CinderUnicodeTest-644920047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-64a53429-45d6-409c-a4eb-2a5241b1d20b {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:22 devstack sudo[105441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-64a53429-45d6-409c-a4eb-2a5241b1d20b Jul 22 03:34:22 devstack sudo[105441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:22 devstack sudo[105436]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-fa0ae87f-40eb-4211-acab-207657f408a3 tempest-VolumeImageDependencyTests-1872904039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.418s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:22 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-fa0ae87f-40eb-4211-acab-207657f408a3 tempest-VolumeImageDependencyTests-1872904039 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:34:22 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-fa0ae87f-40eb-4211-acab-207657f408a3 tempest-VolumeImageDependencyTests-1872904039 None] Deleted volume successfully. Jul 22 03:34:22 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-fa0ae87f-40eb-4211-acab-207657f408a3 tempest-VolumeImageDependencyTests-1872904039 None] Lock "cinder-a378b9b5-a55c-4d85-a1d6-c2e6fb7656da-delete_volume" released by "delete_volume" :: held 1.788s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:34:22 devstack sudo[105438]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.369s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:22 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:34:22 devstack cinder-volume[87747]: DEBUG oslo_service.periodic_task [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Running periodic task VolumeManager._thread_info {{(pid=87747) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 03:34:22 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] thread count: 28 {{(pid=87747) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 22 03:34:22 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] thread info: [<_MainThread(MainThread, started 132775275860096)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87747) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 22 03:34:22 devstack sudo[105441]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-a8e3bdb2-273f-464e-bb88-9c83464b9e31 tempest-CinderUnicodeTest-644920047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-64a53429-45d6-409c-a4eb-2a5241b1d20b" returned: 0 in 0.346s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:22 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-a8e3bdb2-273f-464e-bb88-9c83464b9e31 tempest-CinderUnicodeTest-644920047 None] <== create_volume: return (1067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:34:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-a8e3bdb2-273f-464e-bb88-9c83464b9e31 tempest-CinderUnicodeTest-644920047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:34:22 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-a8e3bdb2-273f-464e-bb88-9c83464b9e31 tempest-CinderUnicodeTest-644920047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35857c66-1e77-4b9b-bef2-0db44ac43ce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64a53429-45d6-409c-a4eb-2a5241b1d20b', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:34:22 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-a8e3bdb2-273f-464e-bb88-9c83464b9e31 tempest-CinderUnicodeTest-644920047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58b91dd0-b75c-4f24-800a-af11009ece96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:34:22 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-a8e3bdb2-273f-464e-bb88-9c83464b9e31 tempest-CinderUnicodeTest-644920047 None] Volume volume-64a53429-45d6-409c-a4eb-2a5241b1d20b (64a53429-45d6-409c-a4eb-2a5241b1d20b): created successfully Jul 22 03:34:22 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-a8e3bdb2-273f-464e-bb88-9c83464b9e31 tempest-CinderUnicodeTest-644920047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58b91dd0-b75c-4f24-800a-af11009ece96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:34:22 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-a8e3bdb2-273f-464e-bb88-9c83464b9e31 tempest-CinderUnicodeTest-644920047 None] Flow 'volume_create_manager' (c581f63f-243d-47c8-8e8b-730ab90f2212) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:34:23 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-a8e3bdb2-273f-464e-bb88-9c83464b9e31 tempest-CinderUnicodeTest-644920047 None] Created volume successfully. Jul 22 03:34:24 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-63669ff9-80c4-498f-a25d-5e7714978a49 tempest-CinderUnicodeTest-644920047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:34:24 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-63669ff9-80c4-498f-a25d-5e7714978a49 tempest-CinderUnicodeTest-644920047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:34:24 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-63669ff9-80c4-498f-a25d-5e7714978a49 tempest-CinderUnicodeTest-644920047 None] Creating offline snapshot d4b476c6-ad25-4cc1-9339-1fd6c6fcf25f of volume 64a53429-45d6-409c-a4eb-2a5241b1d20b {{(pid=87747) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 03:34:24 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[04c4a2d4-3f31-496b-8387-5ca4144bf4ec]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:34:24 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-63669ff9-80c4-498f-a25d-5e7714978a49 tempest-CinderUnicodeTest-644920047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-64a53429-45d6-409c-a4eb-2a5241b1d20b {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:24 devstack sudo[105446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-64a53429-45d6-409c-a4eb-2a5241b1d20b Jul 22 03:34:24 devstack sudo[105446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:24 devstack sudo[105446]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:24 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-63669ff9-80c4-498f-a25d-5e7714978a49 tempest-CinderUnicodeTest-644920047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-64a53429-45d6-409c-a4eb-2a5241b1d20b" returned: 0 in 0.473s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:24 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-63669ff9-80c4-498f-a25d-5e7714978a49 tempest-CinderUnicodeTest-644920047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-64a53429-45d6-409c-a4eb-2a5241b1d20b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-64a53429-45d6-409c-a4eb-2a5241b1d20b.d4b476c6-ad25-4cc1-9339-1fd6c6fcf25f 1G {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:24 devstack sudo[105452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-64a53429-45d6-409c-a4eb-2a5241b1d20b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-64a53429-45d6-409c-a4eb-2a5241b1d20b.d4b476c6-ad25-4cc1-9339-1fd6c6fcf25f 1G Jul 22 03:34:24 devstack sudo[105452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:25 devstack sudo[105452]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:25 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-63669ff9-80c4-498f-a25d-5e7714978a49 tempest-CinderUnicodeTest-644920047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-64a53429-45d6-409c-a4eb-2a5241b1d20b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-64a53429-45d6-409c-a4eb-2a5241b1d20b.d4b476c6-ad25-4cc1-9339-1fd6c6fcf25f 1G" returned: 0 in 0.508s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:25 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-63669ff9-80c4-498f-a25d-5e7714978a49 tempest-CinderUnicodeTest-644920047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64a53429-45d6-409c-a4eb-2a5241b1d20b -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-64a53429-45d6-409c-a4eb-2a5241b1d20b.d4b476c6-ad25-4cc1-9339-1fd6c6fcf25f {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:25 devstack sudo[105458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64a53429-45d6-409c-a4eb-2a5241b1d20b -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-64a53429-45d6-409c-a4eb-2a5241b1d20b.d4b476c6-ad25-4cc1-9339-1fd6c6fcf25f Jul 22 03:34:25 devstack sudo[105458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:25 devstack sudo[105458]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:25 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-63669ff9-80c4-498f-a25d-5e7714978a49 tempest-CinderUnicodeTest-644920047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64a53429-45d6-409c-a4eb-2a5241b1d20b -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-64a53429-45d6-409c-a4eb-2a5241b1d20b.d4b476c6-ad25-4cc1-9339-1fd6c6fcf25f" returned: 0 in 0.394s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:25 devstack cinder-volume[87747]: WARNING cinder.volume.drivers.remotefs [None req-63669ff9-80c4-498f-a25d-5e7714978a49 tempest-CinderUnicodeTest-644920047 None] /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-64a53429-45d6-409c-a4eb-2a5241b1d20b.d4b476c6-ad25-4cc1-9339-1fd6c6fcf25f is being set with open permissions: ugo+rw Jul 22 03:34:25 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-63669ff9-80c4-498f-a25d-5e7714978a49 tempest-CinderUnicodeTest-644920047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-64a53429-45d6-409c-a4eb-2a5241b1d20b.d4b476c6-ad25-4cc1-9339-1fd6c6fcf25f {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:25 devstack sudo[105463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-64a53429-45d6-409c-a4eb-2a5241b1d20b.d4b476c6-ad25-4cc1-9339-1fd6c6fcf25f Jul 22 03:34:25 devstack sudo[105463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:25 devstack sudo[105463]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:25 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-63669ff9-80c4-498f-a25d-5e7714978a49 tempest-CinderUnicodeTest-644920047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-64a53429-45d6-409c-a4eb-2a5241b1d20b.d4b476c6-ad25-4cc1-9339-1fd6c6fcf25f" returned: 0 in 0.357s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:26 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-63669ff9-80c4-498f-a25d-5e7714978a49 tempest-CinderUnicodeTest-644920047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-64a53429-45d6-409c-a4eb-2a5241b1d20b.info {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:26 devstack sudo[105466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-64a53429-45d6-409c-a4eb-2a5241b1d20b.info Jul 22 03:34:26 devstack sudo[105466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:26 devstack sudo[105466]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:26 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-63669ff9-80c4-498f-a25d-5e7714978a49 tempest-CinderUnicodeTest-644920047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-64a53429-45d6-409c-a4eb-2a5241b1d20b.info" returned: 0 in 0.319s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:26 devstack cinder-volume[87747]: WARNING cinder.volume.drivers.remotefs [None req-63669ff9-80c4-498f-a25d-5e7714978a49 tempest-CinderUnicodeTest-644920047 None] /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-64a53429-45d6-409c-a4eb-2a5241b1d20b.info is being set with open permissions: ugo+rw Jul 22 03:34:26 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-63669ff9-80c4-498f-a25d-5e7714978a49 tempest-CinderUnicodeTest-644920047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-64a53429-45d6-409c-a4eb-2a5241b1d20b.info {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:26 devstack sudo[105469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-64a53429-45d6-409c-a4eb-2a5241b1d20b.info Jul 22 03:34:26 devstack sudo[105469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:26 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c8437c6-8321-47db-a462-445e1e74f316 tempest-ProjectMemberTests-64253088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:34:26 devstack sudo[105469]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:26 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-6c8437c6-8321-47db-a462-445e1e74f316 tempest-ProjectMemberTests-64253088 None] Flow 'volume_create_manager' (3dc8d5c9-e432-4763-9002-6ad7367c48fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:34:26 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-6c8437c6-8321-47db-a462-445e1e74f316 tempest-ProjectMemberTests-64253088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a74d41a-2b36-4783-99be-c4d85b6b94d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:34:26 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-63669ff9-80c4-498f-a25d-5e7714978a49 tempest-CinderUnicodeTest-644920047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-64a53429-45d6-409c-a4eb-2a5241b1d20b.info" returned: 0 in 0.334s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:26 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-63669ff9-80c4-498f-a25d-5e7714978a49 tempest-CinderUnicodeTest-644920047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.525s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:34:26 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-6c8437c6-8321-47db-a462-445e1e74f316 tempest-ProjectMemberTests-64253088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a74d41a-2b36-4783-99be-c4d85b6b94d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:34:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1147257307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8a0e33a-ca5d-4291-81c4-87883aaccf7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05eb3b4eac3e4ffe97247852227f9ffa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:34:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:34:27Z,use_quota=True,user_id='ecf77e3a2be443e28cffe6ba02afc5e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:34:26 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-6c8437c6-8321-47db-a462-445e1e74f316 tempest-ProjectMemberTests-64253088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3455b3aa-c6f4-48dd-94a5-44d66aaeb71c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:34:26 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-6c8437c6-8321-47db-a462-445e1e74f316 tempest-ProjectMemberTests-64253088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3455b3aa-c6f4-48dd-94a5-44d66aaeb71c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:34:26 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-6c8437c6-8321-47db-a462-445e1e74f316 tempest-ProjectMemberTests-64253088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6eee251a-d3be-41fb-82e1-5ebe6694b396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:34:26 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-6c8437c6-8321-47db-a462-445e1e74f316 tempest-ProjectMemberTests-64253088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6eee251a-d3be-41fb-82e1-5ebe6694b396) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8a0e33a-ca5d-4291-81c4-87883aaccf7f', 'volume_name': 'volume-a8a0e33a-ca5d-4291-81c4-87883aaccf7f', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:34:26 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-6c8437c6-8321-47db-a462-445e1e74f316 tempest-ProjectMemberTests-64253088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2807a647-3e42-4ca9-a45d-d1f376d065df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:34:26 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-6c8437c6-8321-47db-a462-445e1e74f316 tempest-ProjectMemberTests-64253088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2807a647-3e42-4ca9-a45d-d1f376d065df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:34:26 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-6c8437c6-8321-47db-a462-445e1e74f316 tempest-ProjectMemberTests-64253088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63645dad-d91e-4b85-a803-bd9a5e8b83d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:34:26 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-6c8437c6-8321-47db-a462-445e1e74f316 tempest-ProjectMemberTests-64253088 None] Volume a8a0e33a-ca5d-4291-81c4-87883aaccf7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8a0e33a-ca5d-4291-81c4-87883aaccf7f', 'volume_size': 1} Jul 22 03:34:26 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-6c8437c6-8321-47db-a462-445e1e74f316 tempest-ProjectMemberTests-64253088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:34:26 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-6c8437c6-8321-47db-a462-445e1e74f316 tempest-ProjectMemberTests-64253088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:34:26 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-6c8437c6-8321-47db-a462-445e1e74f316 tempest-ProjectMemberTests-64253088 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:34:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1147257307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8a0e33a-ca5d-4291-81c4-87883aaccf7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05eb3b4eac3e4ffe97247852227f9ffa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:34:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:34:27Z,use_quota=True,user_id='ecf77e3a2be443e28cffe6ba02afc5e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:34:26 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-6c8437c6-8321-47db-a462-445e1e74f316 tempest-ProjectMemberTests-64253088 None] Creating volume a8a0e33a-ca5d-4291-81c4-87883aaccf7f {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:34:26 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-6c8437c6-8321-47db-a462-445e1e74f316 tempest-ProjectMemberTests-64253088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:34:26 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-6c8437c6-8321-47db-a462-445e1e74f316 tempest-ProjectMemberTests-64253088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:34:26 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-6c8437c6-8321-47db-a462-445e1e74f316 tempest-ProjectMemberTests-64253088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:34:26 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-6c8437c6-8321-47db-a462-445e1e74f316 tempest-ProjectMemberTests-64253088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:34:26 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-6c8437c6-8321-47db-a462-445e1e74f316 tempest-ProjectMemberTests-64253088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:34:26 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-6c8437c6-8321-47db-a462-445e1e74f316 tempest-ProjectMemberTests-64253088 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:34:26 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-6c8437c6-8321-47db-a462-445e1e74f316 tempest-ProjectMemberTests-64253088 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:34:26 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-6c8437c6-8321-47db-a462-445e1e74f316 tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a8a0e33a-ca5d-4291-81c4-87883aaccf7f 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:26 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-63669ff9-80c4-498f-a25d-5e7714978a49 tempest-CinderUnicodeTest-644920047 None] Create snapshot completed successfully Jul 22 03:34:26 devstack sudo[105472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a8a0e33a-ca5d-4291-81c4-87883aaccf7f 1073741824 Jul 22 03:34:26 devstack sudo[105472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:27 devstack sudo[105472]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:27 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-6c8437c6-8321-47db-a462-445e1e74f316 tempest-ProjectMemberTests-64253088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a8a0e33a-ca5d-4291-81c4-87883aaccf7f 1073741824" returned: 0 in 0.433s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:27 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-6c8437c6-8321-47db-a462-445e1e74f316 tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a8a0e33a-ca5d-4291-81c4-87883aaccf7f {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:27 devstack sudo[105477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a8a0e33a-ca5d-4291-81c4-87883aaccf7f Jul 22 03:34:27 devstack sudo[105477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:27 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-3a5b33d9-7ed5-4b04-b402-6bdd088ec818 tempest-CinderUnicodeTest-644920047 None] Acquiring lock "cinder-d4b476c6-ad25-4cc1-9339-1fd6c6fcf25f-delete_snapshot" by "delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:34:27 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-3a5b33d9-7ed5-4b04-b402-6bdd088ec818 tempest-CinderUnicodeTest-644920047 None] Lock "cinder-d4b476c6-ad25-4cc1-9339-1fd6c6fcf25f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:34:27 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-3a5b33d9-7ed5-4b04-b402-6bdd088ec818 tempest-CinderUnicodeTest-644920047 None] Acquiring lock "cinder-quobyte-64a53429-45d6-409c-a4eb-2a5241b1d20b" by "delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:34:27 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-3a5b33d9-7ed5-4b04-b402-6bdd088ec818 tempest-CinderUnicodeTest-644920047 None] Lock "cinder-quobyte-64a53429-45d6-409c-a4eb-2a5241b1d20b" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:34:27 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-3a5b33d9-7ed5-4b04-b402-6bdd088ec818 tempest-CinderUnicodeTest-644920047 None] Acquiring lock "cinder-quobyte-d4b476c6-ad25-4cc1-9339-1fd6c6fcf25f" by "_delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:34:27 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-3a5b33d9-7ed5-4b04-b402-6bdd088ec818 tempest-CinderUnicodeTest-644920047 None] Lock "cinder-quobyte-d4b476c6-ad25-4cc1-9339-1fd6c6fcf25f" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:34:27 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-3a5b33d9-7ed5-4b04-b402-6bdd088ec818 tempest-CinderUnicodeTest-644920047 None] Deleting offline snapshot d4b476c6-ad25-4cc1-9339-1fd6c6fcf25f of volume 64a53429-45d6-409c-a4eb-2a5241b1d20b {{(pid=87747) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 03:34:27 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-3a5b33d9-7ed5-4b04-b402-6bdd088ec818 tempest-CinderUnicodeTest-644920047 None] snapshot_file for this snap is: volume-64a53429-45d6-409c-a4eb-2a5241b1d20b.d4b476c6-ad25-4cc1-9339-1fd6c6fcf25f {{(pid=87747) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 03:34:27 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[c143fd22-1539-407d-bf5f-48a874c9a2e5]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:34:27 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-3a5b33d9-7ed5-4b04-b402-6bdd088ec818 tempest-CinderUnicodeTest-644920047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-64a53429-45d6-409c-a4eb-2a5241b1d20b.d4b476c6-ad25-4cc1-9339-1fd6c6fcf25f {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:27 devstack sudo[105477]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:27 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-6c8437c6-8321-47db-a462-445e1e74f316 tempest-ProjectMemberTests-64253088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a8a0e33a-ca5d-4291-81c4-87883aaccf7f" returned: 0 in 0.310s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:27 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-6c8437c6-8321-47db-a462-445e1e74f316 tempest-ProjectMemberTests-64253088 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:34:27 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-6c8437c6-8321-47db-a462-445e1e74f316 tempest-ProjectMemberTests-64253088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.791s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:34:27 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-6c8437c6-8321-47db-a462-445e1e74f316 tempest-ProjectMemberTests-64253088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63645dad-d91e-4b85-a803-bd9a5e8b83d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8a0e33a-ca5d-4291-81c4-87883aaccf7f', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:34:27 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-6c8437c6-8321-47db-a462-445e1e74f316 tempest-ProjectMemberTests-64253088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9db76702-ed4e-48f4-9fbf-5b7b24eca546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:34:27 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-6c8437c6-8321-47db-a462-445e1e74f316 tempest-ProjectMemberTests-64253088 None] Volume volume-a8a0e33a-ca5d-4291-81c4-87883aaccf7f (a8a0e33a-ca5d-4291-81c4-87883aaccf7f): created successfully Jul 22 03:34:27 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-6c8437c6-8321-47db-a462-445e1e74f316 tempest-ProjectMemberTests-64253088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9db76702-ed4e-48f4-9fbf-5b7b24eca546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:34:27 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-6c8437c6-8321-47db-a462-445e1e74f316 tempest-ProjectMemberTests-64253088 None] Flow 'volume_create_manager' (3dc8d5c9-e432-4763-9002-6ad7367c48fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:34:27 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-6c8437c6-8321-47db-a462-445e1e74f316 tempest-ProjectMemberTests-64253088 None] Created volume successfully. Jul 22 03:34:27 devstack sudo[105480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-64a53429-45d6-409c-a4eb-2a5241b1d20b.d4b476c6-ad25-4cc1-9339-1fd6c6fcf25f Jul 22 03:34:27 devstack sudo[105480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:28 devstack sudo[105480]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:28 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-3a5b33d9-7ed5-4b04-b402-6bdd088ec818 tempest-CinderUnicodeTest-644920047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-64a53429-45d6-409c-a4eb-2a5241b1d20b.d4b476c6-ad25-4cc1-9339-1fd6c6fcf25f" returned: 0 in 0.504s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:28 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-3a5b33d9-7ed5-4b04-b402-6bdd088ec818 tempest-CinderUnicodeTest-644920047 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-64a53429-45d6-409c-a4eb-2a5241b1d20b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87747) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 03:34:28 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e08e436-f678-4490-9965-fded34257cac]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:34:28 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-3a5b33d9-7ed5-4b04-b402-6bdd088ec818 tempest-CinderUnicodeTest-644920047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-64a53429-45d6-409c-a4eb-2a5241b1d20b {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:28 devstack sudo[105486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-64a53429-45d6-409c-a4eb-2a5241b1d20b Jul 22 03:34:28 devstack sudo[105486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:28 devstack sudo[105486]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:28 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-3a5b33d9-7ed5-4b04-b402-6bdd088ec818 tempest-CinderUnicodeTest-644920047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-64a53429-45d6-409c-a4eb-2a5241b1d20b" returned: 0 in 0.461s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:28 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-3a5b33d9-7ed5-4b04-b402-6bdd088ec818 tempest-CinderUnicodeTest-644920047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-64a53429-45d6-409c-a4eb-2a5241b1d20b.d4b476c6-ad25-4cc1-9339-1fd6c6fcf25f {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:28 devstack sudo[105491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-64a53429-45d6-409c-a4eb-2a5241b1d20b.d4b476c6-ad25-4cc1-9339-1fd6c6fcf25f Jul 22 03:34:28 devstack sudo[105491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:29 devstack sudo[105491]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:29 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-3a5b33d9-7ed5-4b04-b402-6bdd088ec818 tempest-CinderUnicodeTest-644920047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-64a53429-45d6-409c-a4eb-2a5241b1d20b.d4b476c6-ad25-4cc1-9339-1fd6c6fcf25f" returned: 0 in 0.491s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:29 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-3a5b33d9-7ed5-4b04-b402-6bdd088ec818 tempest-CinderUnicodeTest-644920047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-64a53429-45d6-409c-a4eb-2a5241b1d20b.d4b476c6-ad25-4cc1-9339-1fd6c6fcf25f {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:29 devstack sudo[105497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-64a53429-45d6-409c-a4eb-2a5241b1d20b.d4b476c6-ad25-4cc1-9339-1fd6c6fcf25f Jul 22 03:34:29 devstack sudo[105497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:29 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-dcb6de84-8df6-400c-83d2-c7848a5157d3 tempest-ProjectMemberTests-64253088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:34:29 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-dcb6de84-8df6-400c-83d2-c7848a5157d3 tempest-ProjectMemberTests-64253088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:34:29 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-dcb6de84-8df6-400c-83d2-c7848a5157d3 tempest-ProjectMemberTests-64253088 None] Creating offline snapshot 0607283c-c514-4d0f-803d-199cc1d926cf of volume a8a0e33a-ca5d-4291-81c4-87883aaccf7f {{(pid=87747) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 03:34:29 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[08725b2d-73cb-489e-b3f4-3f1306fad60e]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:34:29 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-dcb6de84-8df6-400c-83d2-c7848a5157d3 tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a8a0e33a-ca5d-4291-81c4-87883aaccf7f {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:29 devstack sudo[105497]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:29 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-3a5b33d9-7ed5-4b04-b402-6bdd088ec818 tempest-CinderUnicodeTest-644920047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-64a53429-45d6-409c-a4eb-2a5241b1d20b.d4b476c6-ad25-4cc1-9339-1fd6c6fcf25f" returned: 0 in 0.347s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:29 devstack sudo[105499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a8a0e33a-ca5d-4291-81c4-87883aaccf7f Jul 22 03:34:29 devstack sudo[105499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:29 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-3a5b33d9-7ed5-4b04-b402-6bdd088ec818 tempest-CinderUnicodeTest-644920047 None] Lock "cinder-quobyte-d4b476c6-ad25-4cc1-9339-1fd6c6fcf25f" released by "_delete_snapshot" :: held 2.024s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:34:29 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-3a5b33d9-7ed5-4b04-b402-6bdd088ec818 tempest-CinderUnicodeTest-644920047 None] Lock "cinder-quobyte-64a53429-45d6-409c-a4eb-2a5241b1d20b" released by "delete_snapshot" :: held 2.069s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:34:29 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-3a5b33d9-7ed5-4b04-b402-6bdd088ec818 tempest-CinderUnicodeTest-644920047 None] Created reservations ['6b0b65c6-dee8-42c0-b0d2-79c8ea712a1d', 'd614c73e-7dcf-4c1f-8b3e-69f3ae741b84', '9f9ce9af-8c79-4db7-913d-e8e37b605a96', 'b1546b94-6c24-42c2-abe8-dae377592320'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:34:29 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-3a5b33d9-7ed5-4b04-b402-6bdd088ec818 tempest-CinderUnicodeTest-644920047 None] Delete snapshot completed successfully. Jul 22 03:34:29 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-3a5b33d9-7ed5-4b04-b402-6bdd088ec818 tempest-CinderUnicodeTest-644920047 None] Lock "cinder-d4b476c6-ad25-4cc1-9339-1fd6c6fcf25f-delete_snapshot" released by "delete_snapshot" :: held 2.309s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:34:29 devstack sudo[105499]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:29 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-dcb6de84-8df6-400c-83d2-c7848a5157d3 tempest-ProjectMemberTests-64253088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a8a0e33a-ca5d-4291-81c4-87883aaccf7f" returned: 0 in 0.532s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:29 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-dcb6de84-8df6-400c-83d2-c7848a5157d3 tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a8a0e33a-ca5d-4291-81c4-87883aaccf7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a8a0e33a-ca5d-4291-81c4-87883aaccf7f.0607283c-c514-4d0f-803d-199cc1d926cf 1G {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:29 devstack sudo[105505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a8a0e33a-ca5d-4291-81c4-87883aaccf7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a8a0e33a-ca5d-4291-81c4-87883aaccf7f.0607283c-c514-4d0f-803d-199cc1d926cf 1G Jul 22 03:34:29 devstack sudo[105505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:30 devstack sudo[105505]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:30 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-dcb6de84-8df6-400c-83d2-c7848a5157d3 tempest-ProjectMemberTests-64253088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a8a0e33a-ca5d-4291-81c4-87883aaccf7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a8a0e33a-ca5d-4291-81c4-87883aaccf7f.0607283c-c514-4d0f-803d-199cc1d926cf 1G" returned: 0 in 0.478s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:30 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-dcb6de84-8df6-400c-83d2-c7848a5157d3 tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8a0e33a-ca5d-4291-81c4-87883aaccf7f -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a8a0e33a-ca5d-4291-81c4-87883aaccf7f.0607283c-c514-4d0f-803d-199cc1d926cf {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:30 devstack sudo[105511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8a0e33a-ca5d-4291-81c4-87883aaccf7f -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a8a0e33a-ca5d-4291-81c4-87883aaccf7f.0607283c-c514-4d0f-803d-199cc1d926cf Jul 22 03:34:30 devstack sudo[105511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:30 devstack sudo[105511]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:30 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-dcb6de84-8df6-400c-83d2-c7848a5157d3 tempest-ProjectMemberTests-64253088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8a0e33a-ca5d-4291-81c4-87883aaccf7f -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a8a0e33a-ca5d-4291-81c4-87883aaccf7f.0607283c-c514-4d0f-803d-199cc1d926cf" returned: 0 in 0.341s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:30 devstack cinder-volume[87747]: WARNING cinder.volume.drivers.remotefs [None req-dcb6de84-8df6-400c-83d2-c7848a5157d3 tempest-ProjectMemberTests-64253088 None] /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a8a0e33a-ca5d-4291-81c4-87883aaccf7f.0607283c-c514-4d0f-803d-199cc1d926cf is being set with open permissions: ugo+rw Jul 22 03:34:30 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-dcb6de84-8df6-400c-83d2-c7848a5157d3 tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a8a0e33a-ca5d-4291-81c4-87883aaccf7f.0607283c-c514-4d0f-803d-199cc1d926cf {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:30 devstack sudo[105516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a8a0e33a-ca5d-4291-81c4-87883aaccf7f.0607283c-c514-4d0f-803d-199cc1d926cf Jul 22 03:34:30 devstack sudo[105516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:30 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-1063dda7-94fd-42d5-a90d-a2e769a1cb26 tempest-CinderUnicodeTest-644920047 None] Acquiring lock "cinder-64a53429-45d6-409c-a4eb-2a5241b1d20b-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:34:30 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-1063dda7-94fd-42d5-a90d-a2e769a1cb26 tempest-CinderUnicodeTest-644920047 None] Lock "cinder-64a53429-45d6-409c-a4eb-2a5241b1d20b-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:34:30 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-1063dda7-94fd-42d5-a90d-a2e769a1cb26 tempest-CinderUnicodeTest-644920047 None] Acquiring lock "cinder-quobyte-64a53429-45d6-409c-a4eb-2a5241b1d20b" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:34:30 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-1063dda7-94fd-42d5-a90d-a2e769a1cb26 tempest-CinderUnicodeTest-644920047 None] Lock "cinder-quobyte-64a53429-45d6-409c-a4eb-2a5241b1d20b" acquired by "delete_volume" :: waited 0.021s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:34:30 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1cee6ef-c2c0-4387-b6fa-ce821ad25a9a]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:34:30 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-1063dda7-94fd-42d5-a90d-a2e769a1cb26 tempest-CinderUnicodeTest-644920047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-64a53429-45d6-409c-a4eb-2a5241b1d20b {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:30 devstack sudo[105516]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:30 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-dcb6de84-8df6-400c-83d2-c7848a5157d3 tempest-ProjectMemberTests-64253088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a8a0e33a-ca5d-4291-81c4-87883aaccf7f.0607283c-c514-4d0f-803d-199cc1d926cf" returned: 0 in 0.362s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:31 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-dcb6de84-8df6-400c-83d2-c7848a5157d3 tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a8a0e33a-ca5d-4291-81c4-87883aaccf7f.info {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:31 devstack sudo[105518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-64a53429-45d6-409c-a4eb-2a5241b1d20b Jul 22 03:34:31 devstack sudo[105518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:31 devstack sudo[105521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a8a0e33a-ca5d-4291-81c4-87883aaccf7f.info Jul 22 03:34:31 devstack sudo[105521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:31 devstack sudo[105521]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:31 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-dcb6de84-8df6-400c-83d2-c7848a5157d3 tempest-ProjectMemberTests-64253088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a8a0e33a-ca5d-4291-81c4-87883aaccf7f.info" returned: 0 in 0.337s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:31 devstack cinder-volume[87747]: WARNING cinder.volume.drivers.remotefs [None req-dcb6de84-8df6-400c-83d2-c7848a5157d3 tempest-ProjectMemberTests-64253088 None] /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a8a0e33a-ca5d-4291-81c4-87883aaccf7f.info is being set with open permissions: ugo+rw Jul 22 03:34:31 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-dcb6de84-8df6-400c-83d2-c7848a5157d3 tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a8a0e33a-ca5d-4291-81c4-87883aaccf7f.info {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:31 devstack sudo[105518]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:31 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-1063dda7-94fd-42d5-a90d-a2e769a1cb26 tempest-CinderUnicodeTest-644920047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-64a53429-45d6-409c-a4eb-2a5241b1d20b" returned: 0 in 0.519s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:31 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-1063dda7-94fd-42d5-a90d-a2e769a1cb26 tempest-CinderUnicodeTest-644920047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-64a53429-45d6-409c-a4eb-2a5241b1d20b {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:31 devstack sudo[105529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-64a53429-45d6-409c-a4eb-2a5241b1d20b Jul 22 03:34:31 devstack sudo[105528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a8a0e33a-ca5d-4291-81c4-87883aaccf7f.info Jul 22 03:34:31 devstack sudo[105528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:31 devstack sudo[105529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:31 devstack sudo[105528]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:31 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-dcb6de84-8df6-400c-83d2-c7848a5157d3 tempest-ProjectMemberTests-64253088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a8a0e33a-ca5d-4291-81c4-87883aaccf7f.info" returned: 0 in 0.355s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:31 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-dcb6de84-8df6-400c-83d2-c7848a5157d3 tempest-ProjectMemberTests-64253088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.577s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:34:31 devstack sudo[105529]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:31 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-1063dda7-94fd-42d5-a90d-a2e769a1cb26 tempest-CinderUnicodeTest-644920047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-64a53429-45d6-409c-a4eb-2a5241b1d20b" returned: 0 in 0.380s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:31 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-1063dda7-94fd-42d5-a90d-a2e769a1cb26 tempest-CinderUnicodeTest-644920047 None] Lock "cinder-quobyte-64a53429-45d6-409c-a4eb-2a5241b1d20b" released by "delete_volume" :: held 0.988s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:34:31 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-dcb6de84-8df6-400c-83d2-c7848a5157d3 tempest-ProjectMemberTests-64253088 None] Create snapshot completed successfully Jul 22 03:34:31 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-1063dda7-94fd-42d5-a90d-a2e769a1cb26 tempest-CinderUnicodeTest-644920047 None] Created reservations ['eb2f66c0-a5e8-434e-98b6-4e89ada90276', 'e7c96fbf-5618-43b0-8754-dc2822aa48c7', 'db6a968b-c1d2-4b44-ab3e-b49427a12751', '6f75914e-ea40-4ac1-aa6f-98f51b2f0624'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:34:31 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-1063dda7-94fd-42d5-a90d-a2e769a1cb26 tempest-CinderUnicodeTest-644920047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:34:31 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-1063dda7-94fd-42d5-a90d-a2e769a1cb26 tempest-CinderUnicodeTest-644920047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:34:31 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-1063dda7-94fd-42d5-a90d-a2e769a1cb26 tempest-CinderUnicodeTest-644920047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:34:31 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-1063dda7-94fd-42d5-a90d-a2e769a1cb26 tempest-CinderUnicodeTest-644920047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:34:31 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-1063dda7-94fd-42d5-a90d-a2e769a1cb26 tempest-CinderUnicodeTest-644920047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:34:31 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-1063dda7-94fd-42d5-a90d-a2e769a1cb26 tempest-CinderUnicodeTest-644920047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:32 devstack sudo[105534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:34:32 devstack sudo[105534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:32 devstack sudo[105534]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:32 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-1063dda7-94fd-42d5-a90d-a2e769a1cb26 tempest-CinderUnicodeTest-644920047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.280s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:32 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-1063dda7-94fd-42d5-a90d-a2e769a1cb26 tempest-CinderUnicodeTest-644920047 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:34:32 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-1063dda7-94fd-42d5-a90d-a2e769a1cb26 tempest-CinderUnicodeTest-644920047 None] Deleted volume successfully. Jul 22 03:34:32 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-1063dda7-94fd-42d5-a90d-a2e769a1cb26 tempest-CinderUnicodeTest-644920047 None] Lock "cinder-64a53429-45d6-409c-a4eb-2a5241b1d20b-delete_volume" released by "delete_volume" :: held 1.577s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:34:32 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-d63d6947-d8d5-4c34-aba2-e005bce5acb5 tempest-ProjectMemberTests-64253088 None] Acquiring lock "cinder-0607283c-c514-4d0f-803d-199cc1d926cf-delete_snapshot" by "delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:34:32 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-d63d6947-d8d5-4c34-aba2-e005bce5acb5 tempest-ProjectMemberTests-64253088 None] Lock "cinder-0607283c-c514-4d0f-803d-199cc1d926cf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:34:32 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-d63d6947-d8d5-4c34-aba2-e005bce5acb5 tempest-ProjectMemberTests-64253088 None] Acquiring lock "cinder-quobyte-a8a0e33a-ca5d-4291-81c4-87883aaccf7f" by "delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:34:32 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-d63d6947-d8d5-4c34-aba2-e005bce5acb5 tempest-ProjectMemberTests-64253088 None] Lock "cinder-quobyte-a8a0e33a-ca5d-4291-81c4-87883aaccf7f" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:34:32 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-d63d6947-d8d5-4c34-aba2-e005bce5acb5 tempest-ProjectMemberTests-64253088 None] Acquiring lock "cinder-quobyte-0607283c-c514-4d0f-803d-199cc1d926cf" by "_delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:34:32 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-d63d6947-d8d5-4c34-aba2-e005bce5acb5 tempest-ProjectMemberTests-64253088 None] Lock "cinder-quobyte-0607283c-c514-4d0f-803d-199cc1d926cf" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:34:32 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-d63d6947-d8d5-4c34-aba2-e005bce5acb5 tempest-ProjectMemberTests-64253088 None] Deleting offline snapshot 0607283c-c514-4d0f-803d-199cc1d926cf of volume a8a0e33a-ca5d-4291-81c4-87883aaccf7f {{(pid=87747) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 03:34:32 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-d63d6947-d8d5-4c34-aba2-e005bce5acb5 tempest-ProjectMemberTests-64253088 None] snapshot_file for this snap is: volume-a8a0e33a-ca5d-4291-81c4-87883aaccf7f.0607283c-c514-4d0f-803d-199cc1d926cf {{(pid=87747) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 03:34:32 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd58989-3ea5-4a5a-a54d-fd70bbb329a5]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:34:32 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d63d6947-d8d5-4c34-aba2-e005bce5acb5 tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a8a0e33a-ca5d-4291-81c4-87883aaccf7f.0607283c-c514-4d0f-803d-199cc1d926cf {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:32 devstack sudo[105537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a8a0e33a-ca5d-4291-81c4-87883aaccf7f.0607283c-c514-4d0f-803d-199cc1d926cf Jul 22 03:34:32 devstack sudo[105537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:32 devstack sudo[105537]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:32 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d63d6947-d8d5-4c34-aba2-e005bce5acb5 tempest-ProjectMemberTests-64253088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a8a0e33a-ca5d-4291-81c4-87883aaccf7f.0607283c-c514-4d0f-803d-199cc1d926cf" returned: 0 in 0.409s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:32 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-d63d6947-d8d5-4c34-aba2-e005bce5acb5 tempest-ProjectMemberTests-64253088 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a8a0e33a-ca5d-4291-81c4-87883aaccf7f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87747) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 03:34:32 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[da65b946-042b-4d30-ab3f-bfaf90831575]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:34:32 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d63d6947-d8d5-4c34-aba2-e005bce5acb5 tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a8a0e33a-ca5d-4291-81c4-87883aaccf7f {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:33 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-80aefa4f-da9e-431d-998f-955228306206 tempest-CinderUnicodeTest-644920047 None] Acquiring lock "cinder-4f593f44-d66d-4e38-8c03-e8ec6ac3e6ea-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:34:33 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-80aefa4f-da9e-431d-998f-955228306206 tempest-CinderUnicodeTest-644920047 None] Lock "cinder-4f593f44-d66d-4e38-8c03-e8ec6ac3e6ea-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:34:33 devstack sudo[105543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a8a0e33a-ca5d-4291-81c4-87883aaccf7f Jul 22 03:34:33 devstack sudo[105543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:33 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-80aefa4f-da9e-431d-998f-955228306206 tempest-CinderUnicodeTest-644920047 None] Acquiring lock "cinder-quobyte-4f593f44-d66d-4e38-8c03-e8ec6ac3e6ea" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:34:33 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-80aefa4f-da9e-431d-998f-955228306206 tempest-CinderUnicodeTest-644920047 None] Lock "cinder-quobyte-4f593f44-d66d-4e38-8c03-e8ec6ac3e6ea" acquired by "delete_volume" :: waited 0.033s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:34:33 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[032c171d-4878-478b-8ef5-6b2dee637a59]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:34:33 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-80aefa4f-da9e-431d-998f-955228306206 tempest-CinderUnicodeTest-644920047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4f593f44-d66d-4e38-8c03-e8ec6ac3e6ea {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:33 devstack sudo[105545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4f593f44-d66d-4e38-8c03-e8ec6ac3e6ea Jul 22 03:34:33 devstack sudo[105545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:33 devstack sudo[105543]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:33 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d63d6947-d8d5-4c34-aba2-e005bce5acb5 tempest-ProjectMemberTests-64253088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a8a0e33a-ca5d-4291-81c4-87883aaccf7f" returned: 0 in 0.615s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:33 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d63d6947-d8d5-4c34-aba2-e005bce5acb5 tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a8a0e33a-ca5d-4291-81c4-87883aaccf7f.0607283c-c514-4d0f-803d-199cc1d926cf {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:33 devstack sudo[105552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a8a0e33a-ca5d-4291-81c4-87883aaccf7f.0607283c-c514-4d0f-803d-199cc1d926cf Jul 22 03:34:33 devstack sudo[105552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:33 devstack sudo[105545]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:33 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-80aefa4f-da9e-431d-998f-955228306206 tempest-CinderUnicodeTest-644920047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4f593f44-d66d-4e38-8c03-e8ec6ac3e6ea" returned: 0 in 0.522s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:33 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-80aefa4f-da9e-431d-998f-955228306206 tempest-CinderUnicodeTest-644920047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4f593f44-d66d-4e38-8c03-e8ec6ac3e6ea {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:33 devstack sudo[105557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4f593f44-d66d-4e38-8c03-e8ec6ac3e6ea Jul 22 03:34:33 devstack sudo[105557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:34 devstack sudo[105552]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:34 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d63d6947-d8d5-4c34-aba2-e005bce5acb5 tempest-ProjectMemberTests-64253088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a8a0e33a-ca5d-4291-81c4-87883aaccf7f.0607283c-c514-4d0f-803d-199cc1d926cf" returned: 0 in 0.470s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:34 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d63d6947-d8d5-4c34-aba2-e005bce5acb5 tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a8a0e33a-ca5d-4291-81c4-87883aaccf7f.0607283c-c514-4d0f-803d-199cc1d926cf {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:34 devstack sudo[105563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a8a0e33a-ca5d-4291-81c4-87883aaccf7f.0607283c-c514-4d0f-803d-199cc1d926cf Jul 22 03:34:34 devstack sudo[105563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:34 devstack sudo[105557]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:34 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-80aefa4f-da9e-431d-998f-955228306206 tempest-CinderUnicodeTest-644920047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-4f593f44-d66d-4e38-8c03-e8ec6ac3e6ea" returned: 0 in 0.320s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:34 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-80aefa4f-da9e-431d-998f-955228306206 tempest-CinderUnicodeTest-644920047 None] Lock "cinder-quobyte-4f593f44-d66d-4e38-8c03-e8ec6ac3e6ea" released by "delete_volume" :: held 0.946s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:34:34 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-80aefa4f-da9e-431d-998f-955228306206 tempest-CinderUnicodeTest-644920047 None] Created reservations ['ca2408b4-ed2b-4b30-87a0-1544f478e2d2', '667087fc-f637-4c6e-8ca3-133a1d7ba912', 'c16f48aa-762c-4d3d-bc57-33fbadd90e44', '0304c322-611b-437d-bf7c-bf6f05be2f71'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:34:34 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-80aefa4f-da9e-431d-998f-955228306206 tempest-CinderUnicodeTest-644920047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:34:34 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-80aefa4f-da9e-431d-998f-955228306206 tempest-CinderUnicodeTest-644920047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:34:34 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-80aefa4f-da9e-431d-998f-955228306206 tempest-CinderUnicodeTest-644920047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:34:34 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-80aefa4f-da9e-431d-998f-955228306206 tempest-CinderUnicodeTest-644920047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:34:34 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-80aefa4f-da9e-431d-998f-955228306206 tempest-CinderUnicodeTest-644920047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:34:34 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-80aefa4f-da9e-431d-998f-955228306206 tempest-CinderUnicodeTest-644920047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:34 devstack sudo[105563]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:34 devstack sudo[105566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:34:34 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-d63d6947-d8d5-4c34-aba2-e005bce5acb5 tempest-ProjectMemberTests-64253088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a8a0e33a-ca5d-4291-81c4-87883aaccf7f.0607283c-c514-4d0f-803d-199cc1d926cf" returned: 0 in 0.328s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:34 devstack sudo[105566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:34 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-d63d6947-d8d5-4c34-aba2-e005bce5acb5 tempest-ProjectMemberTests-64253088 None] Lock "cinder-quobyte-0607283c-c514-4d0f-803d-199cc1d926cf" released by "_delete_snapshot" :: held 1.964s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:34:34 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-d63d6947-d8d5-4c34-aba2-e005bce5acb5 tempest-ProjectMemberTests-64253088 None] Lock "cinder-quobyte-a8a0e33a-ca5d-4291-81c4-87883aaccf7f" released by "delete_snapshot" :: held 2.000s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:34:34 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-d63d6947-d8d5-4c34-aba2-e005bce5acb5 tempest-ProjectMemberTests-64253088 None] Created reservations ['e638176a-8549-465a-8496-dee49634b1f0', '00509252-ef56-4133-ac36-2a8d3c11c7ab', '5e6e43ce-ddb7-4bc9-9ea5-cf43318763f1', '803968d4-f4ef-4ceb-a86c-db9a80a8509f'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:34:34 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-d63d6947-d8d5-4c34-aba2-e005bce5acb5 tempest-ProjectMemberTests-64253088 None] Delete snapshot completed successfully. Jul 22 03:34:34 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-d63d6947-d8d5-4c34-aba2-e005bce5acb5 tempest-ProjectMemberTests-64253088 None] Lock "cinder-0607283c-c514-4d0f-803d-199cc1d926cf-delete_snapshot" released by "delete_snapshot" :: held 2.206s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:34:34 devstack sudo[105566]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:34 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-80aefa4f-da9e-431d-998f-955228306206 tempest-CinderUnicodeTest-644920047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.315s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:34 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-80aefa4f-da9e-431d-998f-955228306206 tempest-CinderUnicodeTest-644920047 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:34:34 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-80aefa4f-da9e-431d-998f-955228306206 tempest-CinderUnicodeTest-644920047 None] Deleted volume successfully. Jul 22 03:34:34 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-80aefa4f-da9e-431d-998f-955228306206 tempest-CinderUnicodeTest-644920047 None] Lock "cinder-4f593f44-d66d-4e38-8c03-e8ec6ac3e6ea-delete_volume" released by "delete_volume" :: held 1.605s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:34:35 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-8d9fe734-03ec-432a-a9a3-6e6dd96d73a5 tempest-ProjectMemberTests-64253088 None] Acquiring lock "cinder-a8a0e33a-ca5d-4291-81c4-87883aaccf7f-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:34:35 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-8d9fe734-03ec-432a-a9a3-6e6dd96d73a5 tempest-ProjectMemberTests-64253088 None] Lock "cinder-a8a0e33a-ca5d-4291-81c4-87883aaccf7f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:34:35 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-8d9fe734-03ec-432a-a9a3-6e6dd96d73a5 tempest-ProjectMemberTests-64253088 None] Acquiring lock "cinder-quobyte-a8a0e33a-ca5d-4291-81c4-87883aaccf7f" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:34:35 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-8d9fe734-03ec-432a-a9a3-6e6dd96d73a5 tempest-ProjectMemberTests-64253088 None] Lock "cinder-quobyte-a8a0e33a-ca5d-4291-81c4-87883aaccf7f" acquired by "delete_volume" :: waited 0.032s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:34:35 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdeea45e-baa7-4f97-bf91-52e548202c9e]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:34:35 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-8d9fe734-03ec-432a-a9a3-6e6dd96d73a5 tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a8a0e33a-ca5d-4291-81c4-87883aaccf7f {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:35 devstack sudo[105569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a8a0e33a-ca5d-4291-81c4-87883aaccf7f Jul 22 03:34:35 devstack sudo[105569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:36 devstack sudo[105569]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:36 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-8d9fe734-03ec-432a-a9a3-6e6dd96d73a5 tempest-ProjectMemberTests-64253088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a8a0e33a-ca5d-4291-81c4-87883aaccf7f" returned: 0 in 0.474s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:36 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-8d9fe734-03ec-432a-a9a3-6e6dd96d73a5 tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a8a0e33a-ca5d-4291-81c4-87883aaccf7f {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:36 devstack sudo[105574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a8a0e33a-ca5d-4291-81c4-87883aaccf7f Jul 22 03:34:36 devstack sudo[105574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:36 devstack sudo[105574]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:36 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-8d9fe734-03ec-432a-a9a3-6e6dd96d73a5 tempest-ProjectMemberTests-64253088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-a8a0e33a-ca5d-4291-81c4-87883aaccf7f" returned: 0 in 0.333s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:36 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-8d9fe734-03ec-432a-a9a3-6e6dd96d73a5 tempest-ProjectMemberTests-64253088 None] Lock "cinder-quobyte-a8a0e33a-ca5d-4291-81c4-87883aaccf7f" released by "delete_volume" :: held 0.890s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:34:36 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-8d9fe734-03ec-432a-a9a3-6e6dd96d73a5 tempest-ProjectMemberTests-64253088 None] Created reservations ['3b620705-cb9e-467d-96ee-6f10fbfaa73a', '19e1f85d-a50a-434b-80fb-9bd76e60c36f', '7a10feed-667c-4dcc-9de3-155e92f2a765', 'bee10d4f-965b-487b-adaf-a8a4f4470804'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:34:36 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-8d9fe734-03ec-432a-a9a3-6e6dd96d73a5 tempest-ProjectMemberTests-64253088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:34:36 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-8d9fe734-03ec-432a-a9a3-6e6dd96d73a5 tempest-ProjectMemberTests-64253088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:34:36 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-8d9fe734-03ec-432a-a9a3-6e6dd96d73a5 tempest-ProjectMemberTests-64253088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:34:36 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-8d9fe734-03ec-432a-a9a3-6e6dd96d73a5 tempest-ProjectMemberTests-64253088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:34:36 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-8d9fe734-03ec-432a-a9a3-6e6dd96d73a5 tempest-ProjectMemberTests-64253088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:34:36 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-8d9fe734-03ec-432a-a9a3-6e6dd96d73a5 tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:36 devstack sudo[105577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:34:36 devstack sudo[105577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:37 devstack sudo[105577]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:37 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-8d9fe734-03ec-432a-a9a3-6e6dd96d73a5 tempest-ProjectMemberTests-64253088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.506s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:37 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-8d9fe734-03ec-432a-a9a3-6e6dd96d73a5 tempest-ProjectMemberTests-64253088 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:34:37 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-8d9fe734-03ec-432a-a9a3-6e6dd96d73a5 tempest-ProjectMemberTests-64253088 None] Deleted volume successfully. Jul 22 03:34:37 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-8d9fe734-03ec-432a-a9a3-6e6dd96d73a5 tempest-ProjectMemberTests-64253088 None] Lock "cinder-a8a0e33a-ca5d-4291-81c4-87883aaccf7f-delete_volume" released by "delete_volume" :: held 1.709s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:34:37 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bbc9d8b-a26b-45e4-8f52-0648b3a57d60 tempest-ProjectMemberTests-64253088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:34:37 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2bbc9d8b-a26b-45e4-8f52-0648b3a57d60 tempest-ProjectMemberTests-64253088 None] Flow 'volume_create_manager' (564a258f-b7a7-4a7e-9049-6f35340e867b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:34:37 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2bbc9d8b-a26b-45e4-8f52-0648b3a57d60 tempest-ProjectMemberTests-64253088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8df5cc30-6de7-4e69-8a69-264837357837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:34:37 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2bbc9d8b-a26b-45e4-8f52-0648b3a57d60 tempest-ProjectMemberTests-64253088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8df5cc30-6de7-4e69-8a69-264837357837) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:34:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-588730689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64da64c1-7eec-407a-8b85-af6e3242c3d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05eb3b4eac3e4ffe97247852227f9ffa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:34:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:34:38Z,use_quota=True,user_id='ecf77e3a2be443e28cffe6ba02afc5e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:34:37 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2bbc9d8b-a26b-45e4-8f52-0648b3a57d60 tempest-ProjectMemberTests-64253088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (691380a0-f626-411b-bbf2-6ab4d003b014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:34:37 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2bbc9d8b-a26b-45e4-8f52-0648b3a57d60 tempest-ProjectMemberTests-64253088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (691380a0-f626-411b-bbf2-6ab4d003b014) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:34:37 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2bbc9d8b-a26b-45e4-8f52-0648b3a57d60 tempest-ProjectMemberTests-64253088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9cf9a75-ce08-4c6a-9623-28ab1664ae73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:34:37 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2bbc9d8b-a26b-45e4-8f52-0648b3a57d60 tempest-ProjectMemberTests-64253088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9cf9a75-ce08-4c6a-9623-28ab1664ae73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64da64c1-7eec-407a-8b85-af6e3242c3d4', 'volume_name': 'volume-64da64c1-7eec-407a-8b85-af6e3242c3d4', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:34:37 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2bbc9d8b-a26b-45e4-8f52-0648b3a57d60 tempest-ProjectMemberTests-64253088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d582fe4-6183-4c8d-ae63-7c76414ad6e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:34:37 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2bbc9d8b-a26b-45e4-8f52-0648b3a57d60 tempest-ProjectMemberTests-64253088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d582fe4-6183-4c8d-ae63-7c76414ad6e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:34:37 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2bbc9d8b-a26b-45e4-8f52-0648b3a57d60 tempest-ProjectMemberTests-64253088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5c25f0d-8985-4066-8848-12a42e2e3dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:34:37 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-2bbc9d8b-a26b-45e4-8f52-0648b3a57d60 tempest-ProjectMemberTests-64253088 None] Volume 64da64c1-7eec-407a-8b85-af6e3242c3d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64da64c1-7eec-407a-8b85-af6e3242c3d4', 'volume_size': 1} Jul 22 03:34:37 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-2bbc9d8b-a26b-45e4-8f52-0648b3a57d60 tempest-ProjectMemberTests-64253088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:34:37 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-2bbc9d8b-a26b-45e4-8f52-0648b3a57d60 tempest-ProjectMemberTests-64253088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:34:37 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-2bbc9d8b-a26b-45e4-8f52-0648b3a57d60 tempest-ProjectMemberTests-64253088 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:34:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-588730689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64da64c1-7eec-407a-8b85-af6e3242c3d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05eb3b4eac3e4ffe97247852227f9ffa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:34:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:34:38Z,use_quota=True,user_id='ecf77e3a2be443e28cffe6ba02afc5e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:34:37 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-2bbc9d8b-a26b-45e4-8f52-0648b3a57d60 tempest-ProjectMemberTests-64253088 None] Creating volume 64da64c1-7eec-407a-8b85-af6e3242c3d4 {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:34:37 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-2bbc9d8b-a26b-45e4-8f52-0648b3a57d60 tempest-ProjectMemberTests-64253088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:34:37 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-2bbc9d8b-a26b-45e4-8f52-0648b3a57d60 tempest-ProjectMemberTests-64253088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:34:37 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-2bbc9d8b-a26b-45e4-8f52-0648b3a57d60 tempest-ProjectMemberTests-64253088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:34:37 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-2bbc9d8b-a26b-45e4-8f52-0648b3a57d60 tempest-ProjectMemberTests-64253088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:34:37 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-2bbc9d8b-a26b-45e4-8f52-0648b3a57d60 tempest-ProjectMemberTests-64253088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:34:37 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-2bbc9d8b-a26b-45e4-8f52-0648b3a57d60 tempest-ProjectMemberTests-64253088 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:34:37 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-2bbc9d8b-a26b-45e4-8f52-0648b3a57d60 tempest-ProjectMemberTests-64253088 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:34:37 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2bbc9d8b-a26b-45e4-8f52-0648b3a57d60 tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-64da64c1-7eec-407a-8b85-af6e3242c3d4 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:37 devstack sudo[105580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-64da64c1-7eec-407a-8b85-af6e3242c3d4 1073741824 Jul 22 03:34:37 devstack sudo[105580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:38 devstack sudo[105580]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:38 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2bbc9d8b-a26b-45e4-8f52-0648b3a57d60 tempest-ProjectMemberTests-64253088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-64da64c1-7eec-407a-8b85-af6e3242c3d4 1073741824" returned: 0 in 0.591s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:38 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2bbc9d8b-a26b-45e4-8f52-0648b3a57d60 tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-64da64c1-7eec-407a-8b85-af6e3242c3d4 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:38 devstack sudo[105586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-64da64c1-7eec-407a-8b85-af6e3242c3d4 Jul 22 03:34:38 devstack sudo[105586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:38 devstack sudo[105586]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:38 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2bbc9d8b-a26b-45e4-8f52-0648b3a57d60 tempest-ProjectMemberTests-64253088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-64da64c1-7eec-407a-8b85-af6e3242c3d4" returned: 0 in 0.349s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:38 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-2bbc9d8b-a26b-45e4-8f52-0648b3a57d60 tempest-ProjectMemberTests-64253088 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:34:38 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-2bbc9d8b-a26b-45e4-8f52-0648b3a57d60 tempest-ProjectMemberTests-64253088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.022s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:34:38 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2bbc9d8b-a26b-45e4-8f52-0648b3a57d60 tempest-ProjectMemberTests-64253088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5c25f0d-8985-4066-8848-12a42e2e3dbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64da64c1-7eec-407a-8b85-af6e3242c3d4', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:34:38 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2bbc9d8b-a26b-45e4-8f52-0648b3a57d60 tempest-ProjectMemberTests-64253088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee5d18fd-fdd6-45ed-b42a-9ceb507fe197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:34:38 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-2bbc9d8b-a26b-45e4-8f52-0648b3a57d60 tempest-ProjectMemberTests-64253088 None] Volume volume-64da64c1-7eec-407a-8b85-af6e3242c3d4 (64da64c1-7eec-407a-8b85-af6e3242c3d4): created successfully Jul 22 03:34:39 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2bbc9d8b-a26b-45e4-8f52-0648b3a57d60 tempest-ProjectMemberTests-64253088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee5d18fd-fdd6-45ed-b42a-9ceb507fe197) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:34:39 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2bbc9d8b-a26b-45e4-8f52-0648b3a57d60 tempest-ProjectMemberTests-64253088 None] Flow 'volume_create_manager' (564a258f-b7a7-4a7e-9049-6f35340e867b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:34:39 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-2bbc9d8b-a26b-45e4-8f52-0648b3a57d60 tempest-ProjectMemberTests-64253088 None] Created volume successfully. Jul 22 03:34:40 devstack cinder-volume[87747]: DEBUG dbcounter [-] [87747] Writing DB stats cinder:SELECT=215,cinder:UPDATE=309,cinder:INSERT=81,cinder:DELETE=32 {{(pid=87747) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 03:34:40 devstack cinder-volume[87747]: DEBUG dbcounter [-] [87747] Writing DB stats cinder:UPDATE=286,cinder:SELECT=222,cinder:DELETE=21,cinder:INSERT=78 {{(pid=87747) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 03:34:40 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-adcef1a8-5c0b-4d9b-a355-9e65e8f47d6d tempest-ProjectMemberTests-64253088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:34:40 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-adcef1a8-5c0b-4d9b-a355-9e65e8f47d6d tempest-ProjectMemberTests-64253088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:34:40 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-adcef1a8-5c0b-4d9b-a355-9e65e8f47d6d tempest-ProjectMemberTests-64253088 None] Creating offline snapshot 942d1287-ccf8-42ae-8fd0-217c88256343 of volume 64da64c1-7eec-407a-8b85-af6e3242c3d4 {{(pid=87747) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 03:34:40 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[99f2cbd2-2ece-4114-b2aa-ff87733bf377]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:34:40 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-adcef1a8-5c0b-4d9b-a355-9e65e8f47d6d tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-64da64c1-7eec-407a-8b85-af6e3242c3d4 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:40 devstack sudo[105625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-64da64c1-7eec-407a-8b85-af6e3242c3d4 Jul 22 03:34:40 devstack sudo[105625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:40 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-a80d4acc-fadd-4526-99db-60b8ce6650b5 tempest-ProjectAdminTests-710494744 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757713317871, 'free_capacity_gb': 1775.757713317871, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87747) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 22 03:34:40 devstack sudo[105625]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:40 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-adcef1a8-5c0b-4d9b-a355-9e65e8f47d6d tempest-ProjectMemberTests-64253088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-64da64c1-7eec-407a-8b85-af6e3242c3d4" returned: 0 in 0.463s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:40 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-adcef1a8-5c0b-4d9b-a355-9e65e8f47d6d tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-64da64c1-7eec-407a-8b85-af6e3242c3d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-64da64c1-7eec-407a-8b85-af6e3242c3d4.942d1287-ccf8-42ae-8fd0-217c88256343 1G {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:40 devstack sudo[105630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-64da64c1-7eec-407a-8b85-af6e3242c3d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-64da64c1-7eec-407a-8b85-af6e3242c3d4.942d1287-ccf8-42ae-8fd0-217c88256343 1G Jul 22 03:34:40 devstack sudo[105630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:41 devstack sudo[105630]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:41 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-adcef1a8-5c0b-4d9b-a355-9e65e8f47d6d tempest-ProjectMemberTests-64253088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-64da64c1-7eec-407a-8b85-af6e3242c3d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-64da64c1-7eec-407a-8b85-af6e3242c3d4.942d1287-ccf8-42ae-8fd0-217c88256343 1G" returned: 0 in 0.483s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:41 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-adcef1a8-5c0b-4d9b-a355-9e65e8f47d6d tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64da64c1-7eec-407a-8b85-af6e3242c3d4 -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-64da64c1-7eec-407a-8b85-af6e3242c3d4.942d1287-ccf8-42ae-8fd0-217c88256343 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:41 devstack sudo[105636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64da64c1-7eec-407a-8b85-af6e3242c3d4 -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-64da64c1-7eec-407a-8b85-af6e3242c3d4.942d1287-ccf8-42ae-8fd0-217c88256343 Jul 22 03:34:41 devstack sudo[105636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:41 devstack sudo[105636]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:41 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-adcef1a8-5c0b-4d9b-a355-9e65e8f47d6d tempest-ProjectMemberTests-64253088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64da64c1-7eec-407a-8b85-af6e3242c3d4 -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-64da64c1-7eec-407a-8b85-af6e3242c3d4.942d1287-ccf8-42ae-8fd0-217c88256343" returned: 0 in 0.389s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:41 devstack cinder-volume[87747]: WARNING cinder.volume.drivers.remotefs [None req-adcef1a8-5c0b-4d9b-a355-9e65e8f47d6d tempest-ProjectMemberTests-64253088 None] /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-64da64c1-7eec-407a-8b85-af6e3242c3d4.942d1287-ccf8-42ae-8fd0-217c88256343 is being set with open permissions: ugo+rw Jul 22 03:34:41 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-adcef1a8-5c0b-4d9b-a355-9e65e8f47d6d tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-64da64c1-7eec-407a-8b85-af6e3242c3d4.942d1287-ccf8-42ae-8fd0-217c88256343 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:41 devstack sudo[105642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-64da64c1-7eec-407a-8b85-af6e3242c3d4.942d1287-ccf8-42ae-8fd0-217c88256343 Jul 22 03:34:41 devstack sudo[105642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:41 devstack sudo[105642]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:41 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-adcef1a8-5c0b-4d9b-a355-9e65e8f47d6d tempest-ProjectMemberTests-64253088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-64da64c1-7eec-407a-8b85-af6e3242c3d4.942d1287-ccf8-42ae-8fd0-217c88256343" returned: 0 in 0.364s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:41 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-adcef1a8-5c0b-4d9b-a355-9e65e8f47d6d tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-64da64c1-7eec-407a-8b85-af6e3242c3d4.info {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:41 devstack sudo[105645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-64da64c1-7eec-407a-8b85-af6e3242c3d4.info Jul 22 03:34:41 devstack sudo[105645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:42 devstack sudo[105645]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:42 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-adcef1a8-5c0b-4d9b-a355-9e65e8f47d6d tempest-ProjectMemberTests-64253088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-64da64c1-7eec-407a-8b85-af6e3242c3d4.info" returned: 0 in 0.341s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:42 devstack cinder-volume[87747]: WARNING cinder.volume.drivers.remotefs [None req-adcef1a8-5c0b-4d9b-a355-9e65e8f47d6d tempest-ProjectMemberTests-64253088 None] /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-64da64c1-7eec-407a-8b85-af6e3242c3d4.info is being set with open permissions: ugo+rw Jul 22 03:34:42 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-adcef1a8-5c0b-4d9b-a355-9e65e8f47d6d tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-64da64c1-7eec-407a-8b85-af6e3242c3d4.info {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:42 devstack sudo[105648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-64da64c1-7eec-407a-8b85-af6e3242c3d4.info Jul 22 03:34:42 devstack sudo[105648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:42 devstack sudo[105648]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:42 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-adcef1a8-5c0b-4d9b-a355-9e65e8f47d6d tempest-ProjectMemberTests-64253088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-64da64c1-7eec-407a-8b85-af6e3242c3d4.info" returned: 0 in 0.334s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:42 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-adcef1a8-5c0b-4d9b-a355-9e65e8f47d6d tempest-ProjectMemberTests-64253088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.483s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:34:42 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-adcef1a8-5c0b-4d9b-a355-9e65e8f47d6d tempest-ProjectMemberTests-64253088 None] Create snapshot completed successfully Jul 22 03:34:43 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-23092dba-d8f7-4233-b3e8-e4982bc86930 tempest-ProjectMemberTests-64253088 None] Acquiring lock "cinder-942d1287-ccf8-42ae-8fd0-217c88256343-delete_snapshot" by "delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:34:43 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-23092dba-d8f7-4233-b3e8-e4982bc86930 tempest-ProjectMemberTests-64253088 None] Lock "cinder-942d1287-ccf8-42ae-8fd0-217c88256343-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:34:43 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-23092dba-d8f7-4233-b3e8-e4982bc86930 tempest-ProjectMemberTests-64253088 None] Acquiring lock "cinder-quobyte-64da64c1-7eec-407a-8b85-af6e3242c3d4" by "delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:34:43 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-23092dba-d8f7-4233-b3e8-e4982bc86930 tempest-ProjectMemberTests-64253088 None] Lock "cinder-quobyte-64da64c1-7eec-407a-8b85-af6e3242c3d4" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:34:43 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-23092dba-d8f7-4233-b3e8-e4982bc86930 tempest-ProjectMemberTests-64253088 None] Acquiring lock "cinder-quobyte-942d1287-ccf8-42ae-8fd0-217c88256343" by "_delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:34:43 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-23092dba-d8f7-4233-b3e8-e4982bc86930 tempest-ProjectMemberTests-64253088 None] Lock "cinder-quobyte-942d1287-ccf8-42ae-8fd0-217c88256343" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:34:43 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-23092dba-d8f7-4233-b3e8-e4982bc86930 tempest-ProjectMemberTests-64253088 None] Deleting offline snapshot 942d1287-ccf8-42ae-8fd0-217c88256343 of volume 64da64c1-7eec-407a-8b85-af6e3242c3d4 {{(pid=87747) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 03:34:43 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-23092dba-d8f7-4233-b3e8-e4982bc86930 tempest-ProjectMemberTests-64253088 None] snapshot_file for this snap is: volume-64da64c1-7eec-407a-8b85-af6e3242c3d4.942d1287-ccf8-42ae-8fd0-217c88256343 {{(pid=87747) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 03:34:43 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[06587ec6-1483-4b76-94cf-3525731e86af]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:34:43 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-23092dba-d8f7-4233-b3e8-e4982bc86930 tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-64da64c1-7eec-407a-8b85-af6e3242c3d4.942d1287-ccf8-42ae-8fd0-217c88256343 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:44 devstack sudo[105652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-64da64c1-7eec-407a-8b85-af6e3242c3d4.942d1287-ccf8-42ae-8fd0-217c88256343 Jul 22 03:34:44 devstack sudo[105652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:44 devstack sudo[105652]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:44 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-23092dba-d8f7-4233-b3e8-e4982bc86930 tempest-ProjectMemberTests-64253088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-64da64c1-7eec-407a-8b85-af6e3242c3d4.942d1287-ccf8-42ae-8fd0-217c88256343" returned: 0 in 0.516s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:44 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-23092dba-d8f7-4233-b3e8-e4982bc86930 tempest-ProjectMemberTests-64253088 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-64da64c1-7eec-407a-8b85-af6e3242c3d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87747) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 03:34:44 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[64006a65-b60b-4ea7-883b-22d68bc980d4]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:34:44 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-23092dba-d8f7-4233-b3e8-e4982bc86930 tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-64da64c1-7eec-407a-8b85-af6e3242c3d4 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:44 devstack sudo[105657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-64da64c1-7eec-407a-8b85-af6e3242c3d4 Jul 22 03:34:44 devstack sudo[105657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:44 devstack sudo[105657]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:44 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-23092dba-d8f7-4233-b3e8-e4982bc86930 tempest-ProjectMemberTests-64253088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-64da64c1-7eec-407a-8b85-af6e3242c3d4" returned: 0 in 0.480s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:44 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-23092dba-d8f7-4233-b3e8-e4982bc86930 tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-64da64c1-7eec-407a-8b85-af6e3242c3d4.942d1287-ccf8-42ae-8fd0-217c88256343 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:45 devstack sudo[105662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-64da64c1-7eec-407a-8b85-af6e3242c3d4.942d1287-ccf8-42ae-8fd0-217c88256343 Jul 22 03:34:45 devstack sudo[105662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:45 devstack sudo[105662]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:45 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-23092dba-d8f7-4233-b3e8-e4982bc86930 tempest-ProjectMemberTests-64253088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-64da64c1-7eec-407a-8b85-af6e3242c3d4.942d1287-ccf8-42ae-8fd0-217c88256343" returned: 0 in 0.543s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:45 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-23092dba-d8f7-4233-b3e8-e4982bc86930 tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-64da64c1-7eec-407a-8b85-af6e3242c3d4.942d1287-ccf8-42ae-8fd0-217c88256343 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:45 devstack sudo[105673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-64da64c1-7eec-407a-8b85-af6e3242c3d4.942d1287-ccf8-42ae-8fd0-217c88256343 Jul 22 03:34:45 devstack sudo[105673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:45 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ddbf4ac-b58f-4c93-ac38-45195d2cda2e tempest-ProjectReaderTests-483930896 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:34:45 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-1ddbf4ac-b58f-4c93-ac38-45195d2cda2e tempest-ProjectReaderTests-483930896 None] Flow 'volume_create_manager' (46c8f35d-b371-46ba-bbfc-e3edbcd4a72a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:34:45 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-1ddbf4ac-b58f-4c93-ac38-45195d2cda2e tempest-ProjectReaderTests-483930896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75a4bca6-f234-4707-9601-4f264843aeca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:34:45 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-1ddbf4ac-b58f-4c93-ac38-45195d2cda2e tempest-ProjectReaderTests-483930896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75a4bca6-f234-4707-9601-4f264843aeca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:34:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-292569214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1559b4a5-d8d6-4149-8c92-0533550d65bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd45f1aa7e184c4599e74792f6f4b497',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:34:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:34:46Z,use_quota=True,user_id='222bb0de5f274a1db76ea74beb58d4b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:34:45 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-1ddbf4ac-b58f-4c93-ac38-45195d2cda2e tempest-ProjectReaderTests-483930896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f50e12b1-a892-4fb3-a2c6-0c80d68f4830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:34:45 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-1ddbf4ac-b58f-4c93-ac38-45195d2cda2e tempest-ProjectReaderTests-483930896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f50e12b1-a892-4fb3-a2c6-0c80d68f4830) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:34:45 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-1ddbf4ac-b58f-4c93-ac38-45195d2cda2e tempest-ProjectReaderTests-483930896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0e87b9d-969e-419c-8866-4b81bc6ecb01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:34:45 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-1ddbf4ac-b58f-4c93-ac38-45195d2cda2e tempest-ProjectReaderTests-483930896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0e87b9d-969e-419c-8866-4b81bc6ecb01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1559b4a5-d8d6-4149-8c92-0533550d65bb', 'volume_name': 'volume-1559b4a5-d8d6-4149-8c92-0533550d65bb', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:34:45 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-1ddbf4ac-b58f-4c93-ac38-45195d2cda2e tempest-ProjectReaderTests-483930896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de2095b0-5f74-4336-b9e8-f64363602510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:34:45 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-1ddbf4ac-b58f-4c93-ac38-45195d2cda2e tempest-ProjectReaderTests-483930896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de2095b0-5f74-4336-b9e8-f64363602510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:34:45 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-1ddbf4ac-b58f-4c93-ac38-45195d2cda2e tempest-ProjectReaderTests-483930896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (498ad9ac-0ab4-4d68-8ad3-576a8f0567ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:34:45 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-1ddbf4ac-b58f-4c93-ac38-45195d2cda2e tempest-ProjectReaderTests-483930896 None] Volume 1559b4a5-d8d6-4149-8c92-0533550d65bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1559b4a5-d8d6-4149-8c92-0533550d65bb', 'volume_size': 1} Jul 22 03:34:45 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-1ddbf4ac-b58f-4c93-ac38-45195d2cda2e tempest-ProjectReaderTests-483930896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:34:45 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-1ddbf4ac-b58f-4c93-ac38-45195d2cda2e tempest-ProjectReaderTests-483930896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:34:45 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-1ddbf4ac-b58f-4c93-ac38-45195d2cda2e tempest-ProjectReaderTests-483930896 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:34:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-292569214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1559b4a5-d8d6-4149-8c92-0533550d65bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd45f1aa7e184c4599e74792f6f4b497',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:34:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:34:46Z,use_quota=True,user_id='222bb0de5f274a1db76ea74beb58d4b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:34:45 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-1ddbf4ac-b58f-4c93-ac38-45195d2cda2e tempest-ProjectReaderTests-483930896 None] Creating volume 1559b4a5-d8d6-4149-8c92-0533550d65bb {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:34:45 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-1ddbf4ac-b58f-4c93-ac38-45195d2cda2e tempest-ProjectReaderTests-483930896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:34:45 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-1ddbf4ac-b58f-4c93-ac38-45195d2cda2e tempest-ProjectReaderTests-483930896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:34:45 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-1ddbf4ac-b58f-4c93-ac38-45195d2cda2e tempest-ProjectReaderTests-483930896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:34:45 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-1ddbf4ac-b58f-4c93-ac38-45195d2cda2e tempest-ProjectReaderTests-483930896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:34:45 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-1ddbf4ac-b58f-4c93-ac38-45195d2cda2e tempest-ProjectReaderTests-483930896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:34:45 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-1ddbf4ac-b58f-4c93-ac38-45195d2cda2e tempest-ProjectReaderTests-483930896 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:34:45 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-1ddbf4ac-b58f-4c93-ac38-45195d2cda2e tempest-ProjectReaderTests-483930896 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:34:45 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-1ddbf4ac-b58f-4c93-ac38-45195d2cda2e tempest-ProjectReaderTests-483930896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1559b4a5-d8d6-4149-8c92-0533550d65bb 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:45 devstack sudo[105676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1559b4a5-d8d6-4149-8c92-0533550d65bb 1073741824 Jul 22 03:34:45 devstack sudo[105676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:45 devstack sudo[105673]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:45 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-23092dba-d8f7-4233-b3e8-e4982bc86930 tempest-ProjectMemberTests-64253088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-64da64c1-7eec-407a-8b85-af6e3242c3d4.942d1287-ccf8-42ae-8fd0-217c88256343" returned: 0 in 0.432s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:46 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-23092dba-d8f7-4233-b3e8-e4982bc86930 tempest-ProjectMemberTests-64253088 None] Lock "cinder-quobyte-942d1287-ccf8-42ae-8fd0-217c88256343" released by "_delete_snapshot" :: held 2.123s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:34:46 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-23092dba-d8f7-4233-b3e8-e4982bc86930 tempest-ProjectMemberTests-64253088 None] Lock "cinder-quobyte-64da64c1-7eec-407a-8b85-af6e3242c3d4" released by "delete_snapshot" :: held 2.163s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:34:46 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-23092dba-d8f7-4233-b3e8-e4982bc86930 tempest-ProjectMemberTests-64253088 None] Created reservations ['ee3c325c-5a54-46c7-9911-dfdddca8b95a', '722ef400-6a6a-4a79-8055-61c8063aeb1b', '9875cb49-6306-41ce-af0b-a973d352eb4d', '9242df71-db57-426b-818b-5b19bf50c9ac'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:34:46 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-23092dba-d8f7-4233-b3e8-e4982bc86930 tempest-ProjectMemberTests-64253088 None] Delete snapshot completed successfully. Jul 22 03:34:46 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-23092dba-d8f7-4233-b3e8-e4982bc86930 tempest-ProjectMemberTests-64253088 None] Lock "cinder-942d1287-ccf8-42ae-8fd0-217c88256343-delete_snapshot" released by "delete_snapshot" :: held 2.411s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:34:46 devstack sudo[105676]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:46 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-1ddbf4ac-b58f-4c93-ac38-45195d2cda2e tempest-ProjectReaderTests-483930896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1559b4a5-d8d6-4149-8c92-0533550d65bb 1073741824" returned: 0 in 0.609s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:46 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-1ddbf4ac-b58f-4c93-ac38-45195d2cda2e tempest-ProjectReaderTests-483930896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1559b4a5-d8d6-4149-8c92-0533550d65bb {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:46 devstack sudo[105682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1559b4a5-d8d6-4149-8c92-0533550d65bb Jul 22 03:34:46 devstack sudo[105682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:46 devstack sudo[105682]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:46 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-1ddbf4ac-b58f-4c93-ac38-45195d2cda2e tempest-ProjectReaderTests-483930896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1559b4a5-d8d6-4149-8c92-0533550d65bb" returned: 0 in 0.282s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:46 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-1ddbf4ac-b58f-4c93-ac38-45195d2cda2e tempest-ProjectReaderTests-483930896 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:34:46 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-1ddbf4ac-b58f-4c93-ac38-45195d2cda2e tempest-ProjectReaderTests-483930896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:34:46 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-1ddbf4ac-b58f-4c93-ac38-45195d2cda2e tempest-ProjectReaderTests-483930896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (498ad9ac-0ab4-4d68-8ad3-576a8f0567ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1559b4a5-d8d6-4149-8c92-0533550d65bb', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:34:46 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-1ddbf4ac-b58f-4c93-ac38-45195d2cda2e tempest-ProjectReaderTests-483930896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50ebdb25-16b7-4e56-8f2f-fbe7b85cb2a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:34:46 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-1ddbf4ac-b58f-4c93-ac38-45195d2cda2e tempest-ProjectReaderTests-483930896 None] Volume volume-1559b4a5-d8d6-4149-8c92-0533550d65bb (1559b4a5-d8d6-4149-8c92-0533550d65bb): created successfully Jul 22 03:34:46 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-1ddbf4ac-b58f-4c93-ac38-45195d2cda2e tempest-ProjectReaderTests-483930896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50ebdb25-16b7-4e56-8f2f-fbe7b85cb2a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:34:46 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-1ddbf4ac-b58f-4c93-ac38-45195d2cda2e tempest-ProjectReaderTests-483930896 None] Flow 'volume_create_manager' (46c8f35d-b371-46ba-bbfc-e3edbcd4a72a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:34:46 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-1ddbf4ac-b58f-4c93-ac38-45195d2cda2e tempest-ProjectReaderTests-483930896 None] Created volume successfully. Jul 22 03:34:47 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-36aeadc0-b865-43f0-8eee-b2bda4e576d6 tempest-ProjectMemberTests-64253088 None] Acquiring lock "cinder-64da64c1-7eec-407a-8b85-af6e3242c3d4-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:34:47 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-36aeadc0-b865-43f0-8eee-b2bda4e576d6 tempest-ProjectMemberTests-64253088 None] Lock "cinder-64da64c1-7eec-407a-8b85-af6e3242c3d4-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:34:47 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-36aeadc0-b865-43f0-8eee-b2bda4e576d6 tempest-ProjectMemberTests-64253088 None] Acquiring lock "cinder-quobyte-64da64c1-7eec-407a-8b85-af6e3242c3d4" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:34:47 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-36aeadc0-b865-43f0-8eee-b2bda4e576d6 tempest-ProjectMemberTests-64253088 None] Lock "cinder-quobyte-64da64c1-7eec-407a-8b85-af6e3242c3d4" acquired by "delete_volume" :: waited 0.020s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:34:47 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[76bd169e-ca60-4091-b93a-ce6236b38993]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:34:47 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-36aeadc0-b865-43f0-8eee-b2bda4e576d6 tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-64da64c1-7eec-407a-8b85-af6e3242c3d4 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:47 devstack sudo[105685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-64da64c1-7eec-407a-8b85-af6e3242c3d4 Jul 22 03:34:47 devstack sudo[105685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:47 devstack sudo[105685]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:47 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-36aeadc0-b865-43f0-8eee-b2bda4e576d6 tempest-ProjectMemberTests-64253088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-64da64c1-7eec-407a-8b85-af6e3242c3d4" returned: 0 in 0.488s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:47 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-36aeadc0-b865-43f0-8eee-b2bda4e576d6 tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-64da64c1-7eec-407a-8b85-af6e3242c3d4 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:47 devstack sudo[105690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-64da64c1-7eec-407a-8b85-af6e3242c3d4 Jul 22 03:34:47 devstack sudo[105690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:47 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-19166db2-29b9-424d-8ccb-035748f920a0 tempest-ProjectReaderTests-483930896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:34:47 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-19166db2-29b9-424d-8ccb-035748f920a0 tempest-ProjectReaderTests-483930896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:34:47 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-19166db2-29b9-424d-8ccb-035748f920a0 tempest-ProjectReaderTests-483930896 None] Creating offline snapshot d26871b8-4d21-46a0-8cf1-2552d6fe1b04 of volume 1559b4a5-d8d6-4149-8c92-0533550d65bb {{(pid=87747) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 03:34:47 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd775e3d-fdc2-4cef-9937-4d522e3c0eec]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:34:47 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-19166db2-29b9-424d-8ccb-035748f920a0 tempest-ProjectReaderTests-483930896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1559b4a5-d8d6-4149-8c92-0533550d65bb {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:48 devstack sudo[105692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1559b4a5-d8d6-4149-8c92-0533550d65bb Jul 22 03:34:48 devstack sudo[105690]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:48 devstack sudo[105692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:48 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-36aeadc0-b865-43f0-8eee-b2bda4e576d6 tempest-ProjectMemberTests-64253088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-64da64c1-7eec-407a-8b85-af6e3242c3d4" returned: 0 in 0.360s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:48 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-36aeadc0-b865-43f0-8eee-b2bda4e576d6 tempest-ProjectMemberTests-64253088 None] Lock "cinder-quobyte-64da64c1-7eec-407a-8b85-af6e3242c3d4" released by "delete_volume" :: held 0.940s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:34:48 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-36aeadc0-b865-43f0-8eee-b2bda4e576d6 tempest-ProjectMemberTests-64253088 None] Created reservations ['c79a7b81-38ff-48c8-b343-a6f707f5fbe1', 'a4439cc9-b79d-4bd2-ae24-8087ad95db9e', '57c00125-3fb5-4d1f-8eac-16bfc51fb42a', '3f3778ff-ce0f-4090-aca6-e6b1de2923b1'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:34:48 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-36aeadc0-b865-43f0-8eee-b2bda4e576d6 tempest-ProjectMemberTests-64253088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:34:48 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-36aeadc0-b865-43f0-8eee-b2bda4e576d6 tempest-ProjectMemberTests-64253088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:34:48 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-36aeadc0-b865-43f0-8eee-b2bda4e576d6 tempest-ProjectMemberTests-64253088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:34:48 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-36aeadc0-b865-43f0-8eee-b2bda4e576d6 tempest-ProjectMemberTests-64253088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:34:48 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-36aeadc0-b865-43f0-8eee-b2bda4e576d6 tempest-ProjectMemberTests-64253088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:34:48 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-36aeadc0-b865-43f0-8eee-b2bda4e576d6 tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:48 devstack sudo[105697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:34:48 devstack sudo[105697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:48 devstack sudo[105692]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:48 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-19166db2-29b9-424d-8ccb-035748f920a0 tempest-ProjectReaderTests-483930896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1559b4a5-d8d6-4149-8c92-0533550d65bb" returned: 0 in 0.484s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:48 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-19166db2-29b9-424d-8ccb-035748f920a0 tempest-ProjectReaderTests-483930896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1559b4a5-d8d6-4149-8c92-0533550d65bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1559b4a5-d8d6-4149-8c92-0533550d65bb.d26871b8-4d21-46a0-8cf1-2552d6fe1b04 1G {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:48 devstack sudo[105700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1559b4a5-d8d6-4149-8c92-0533550d65bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1559b4a5-d8d6-4149-8c92-0533550d65bb.d26871b8-4d21-46a0-8cf1-2552d6fe1b04 1G Jul 22 03:34:48 devstack sudo[105700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:48 devstack sudo[105697]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:48 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-36aeadc0-b865-43f0-8eee-b2bda4e576d6 tempest-ProjectMemberTests-64253088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.445s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:48 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-36aeadc0-b865-43f0-8eee-b2bda4e576d6 tempest-ProjectMemberTests-64253088 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:34:48 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-36aeadc0-b865-43f0-8eee-b2bda4e576d6 tempest-ProjectMemberTests-64253088 None] Deleted volume successfully. Jul 22 03:34:48 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-36aeadc0-b865-43f0-8eee-b2bda4e576d6 tempest-ProjectMemberTests-64253088 None] Lock "cinder-64da64c1-7eec-407a-8b85-af6e3242c3d4-delete_volume" released by "delete_volume" :: held 1.738s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:34:49 devstack sudo[105700]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:49 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-19166db2-29b9-424d-8ccb-035748f920a0 tempest-ProjectReaderTests-483930896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1559b4a5-d8d6-4149-8c92-0533550d65bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1559b4a5-d8d6-4149-8c92-0533550d65bb.d26871b8-4d21-46a0-8cf1-2552d6fe1b04 1G" returned: 0 in 0.630s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:49 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-19166db2-29b9-424d-8ccb-035748f920a0 tempest-ProjectReaderTests-483930896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1559b4a5-d8d6-4149-8c92-0533550d65bb -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1559b4a5-d8d6-4149-8c92-0533550d65bb.d26871b8-4d21-46a0-8cf1-2552d6fe1b04 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:49 devstack sudo[105707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1559b4a5-d8d6-4149-8c92-0533550d65bb -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1559b4a5-d8d6-4149-8c92-0533550d65bb.d26871b8-4d21-46a0-8cf1-2552d6fe1b04 Jul 22 03:34:49 devstack sudo[105707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:49 devstack sudo[105707]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:49 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-19166db2-29b9-424d-8ccb-035748f920a0 tempest-ProjectReaderTests-483930896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1559b4a5-d8d6-4149-8c92-0533550d65bb -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1559b4a5-d8d6-4149-8c92-0533550d65bb.d26871b8-4d21-46a0-8cf1-2552d6fe1b04" returned: 0 in 0.417s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:49 devstack cinder-volume[87747]: WARNING cinder.volume.drivers.remotefs [None req-19166db2-29b9-424d-8ccb-035748f920a0 tempest-ProjectReaderTests-483930896 None] /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1559b4a5-d8d6-4149-8c92-0533550d65bb.d26871b8-4d21-46a0-8cf1-2552d6fe1b04 is being set with open permissions: ugo+rw Jul 22 03:34:49 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-19166db2-29b9-424d-8ccb-035748f920a0 tempest-ProjectReaderTests-483930896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1559b4a5-d8d6-4149-8c92-0533550d65bb.d26871b8-4d21-46a0-8cf1-2552d6fe1b04 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:49 devstack sudo[105712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1559b4a5-d8d6-4149-8c92-0533550d65bb.d26871b8-4d21-46a0-8cf1-2552d6fe1b04 Jul 22 03:34:49 devstack sudo[105712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:49 devstack sudo[105712]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:49 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-19166db2-29b9-424d-8ccb-035748f920a0 tempest-ProjectReaderTests-483930896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1559b4a5-d8d6-4149-8c92-0533550d65bb.d26871b8-4d21-46a0-8cf1-2552d6fe1b04" returned: 0 in 0.371s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:49 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-19166db2-29b9-424d-8ccb-035748f920a0 tempest-ProjectReaderTests-483930896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1559b4a5-d8d6-4149-8c92-0533550d65bb.info {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:49 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-73c18acd-eba6-4282-ad22-ec88593621b1 tempest-ProjectMemberTests-64253088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:34:49 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-73c18acd-eba6-4282-ad22-ec88593621b1 tempest-ProjectMemberTests-64253088 None] Flow 'volume_create_manager' (95be6116-8a02-4aa7-b26c-151bc5039a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:34:49 devstack sudo[105715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1559b4a5-d8d6-4149-8c92-0533550d65bb.info Jul 22 03:34:49 devstack sudo[105715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:49 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-73c18acd-eba6-4282-ad22-ec88593621b1 tempest-ProjectMemberTests-64253088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6580d8a1-3c67-4d3e-87e4-75c4af6878e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:34:50 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-73c18acd-eba6-4282-ad22-ec88593621b1 tempest-ProjectMemberTests-64253088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6580d8a1-3c67-4d3e-87e4-75c4af6878e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:34:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1808692426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d7a1e96-3874-4be8-838a-11b92a2a5913,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05eb3b4eac3e4ffe97247852227f9ffa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:34:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:34:50Z,use_quota=True,user_id='ecf77e3a2be443e28cffe6ba02afc5e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:34:50 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-73c18acd-eba6-4282-ad22-ec88593621b1 tempest-ProjectMemberTests-64253088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db5060d3-4560-472c-805c-c3109b5a4a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:34:50 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-73c18acd-eba6-4282-ad22-ec88593621b1 tempest-ProjectMemberTests-64253088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db5060d3-4560-472c-805c-c3109b5a4a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:34:50 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-73c18acd-eba6-4282-ad22-ec88593621b1 tempest-ProjectMemberTests-64253088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96adbb72-01e2-4931-bb71-aa2edfc6ef3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:34:50 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-73c18acd-eba6-4282-ad22-ec88593621b1 tempest-ProjectMemberTests-64253088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96adbb72-01e2-4931-bb71-aa2edfc6ef3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d7a1e96-3874-4be8-838a-11b92a2a5913', 'volume_name': 'volume-7d7a1e96-3874-4be8-838a-11b92a2a5913', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:34:50 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-73c18acd-eba6-4282-ad22-ec88593621b1 tempest-ProjectMemberTests-64253088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f116a12-6e83-4d75-8d94-70522419b8be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:34:50 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-73c18acd-eba6-4282-ad22-ec88593621b1 tempest-ProjectMemberTests-64253088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f116a12-6e83-4d75-8d94-70522419b8be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:34:50 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-73c18acd-eba6-4282-ad22-ec88593621b1 tempest-ProjectMemberTests-64253088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90e3bb07-b174-41aa-be70-95398766f479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:34:50 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-73c18acd-eba6-4282-ad22-ec88593621b1 tempest-ProjectMemberTests-64253088 None] Volume 7d7a1e96-3874-4be8-838a-11b92a2a5913: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d7a1e96-3874-4be8-838a-11b92a2a5913', 'volume_size': 1} Jul 22 03:34:50 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-73c18acd-eba6-4282-ad22-ec88593621b1 tempest-ProjectMemberTests-64253088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:34:50 devstack sudo[105715]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:50 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-19166db2-29b9-424d-8ccb-035748f920a0 tempest-ProjectReaderTests-483930896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1559b4a5-d8d6-4149-8c92-0533550d65bb.info" returned: 0 in 0.344s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:50 devstack cinder-volume[87747]: WARNING cinder.volume.drivers.remotefs [None req-19166db2-29b9-424d-8ccb-035748f920a0 tempest-ProjectReaderTests-483930896 None] /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1559b4a5-d8d6-4149-8c92-0533550d65bb.info is being set with open permissions: ugo+rw Jul 22 03:34:50 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-19166db2-29b9-424d-8ccb-035748f920a0 tempest-ProjectReaderTests-483930896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1559b4a5-d8d6-4149-8c92-0533550d65bb.info {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:50 devstack sudo[105718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1559b4a5-d8d6-4149-8c92-0533550d65bb.info Jul 22 03:34:50 devstack sudo[105718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:50 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-006da056-d95d-41fd-8919-28d8f1c78dc2 tempest-SnapshotDependencyTests-1942573504 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:34:50 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-006da056-d95d-41fd-8919-28d8f1c78dc2 tempest-SnapshotDependencyTests-1942573504 None] Flow 'volume_create_manager' (82ec5c72-052f-4cc8-8596-deb98ea62a3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:34:50 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-006da056-d95d-41fd-8919-28d8f1c78dc2 tempest-SnapshotDependencyTests-1942573504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a46353b-69c4-4bb0-8cec-a3331ed3ad36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:34:50 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-006da056-d95d-41fd-8919-28d8f1c78dc2 tempest-SnapshotDependencyTests-1942573504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a46353b-69c4-4bb0-8cec-a3331ed3ad36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:34:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1575359227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0dd02463-e194-4d32-8a1b-cdaaaedd01d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fb34e8b09974906bafc5d1ce97e5c78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:34:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:34:50Z,use_quota=True,user_id='452741dd22a14b74ba7626c593145253',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:34:50 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-006da056-d95d-41fd-8919-28d8f1c78dc2 tempest-SnapshotDependencyTests-1942573504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdd0deb7-7986-4ba3-b180-76d8f371c942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:34:50 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-006da056-d95d-41fd-8919-28d8f1c78dc2 tempest-SnapshotDependencyTests-1942573504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdd0deb7-7986-4ba3-b180-76d8f371c942) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:34:50 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-006da056-d95d-41fd-8919-28d8f1c78dc2 tempest-SnapshotDependencyTests-1942573504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64becf8b-e580-44d0-afaa-7f364f064cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:34:50 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-006da056-d95d-41fd-8919-28d8f1c78dc2 tempest-SnapshotDependencyTests-1942573504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64becf8b-e580-44d0-afaa-7f364f064cf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0dd02463-e194-4d32-8a1b-cdaaaedd01d1', 'volume_name': 'volume-0dd02463-e194-4d32-8a1b-cdaaaedd01d1', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:34:50 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-006da056-d95d-41fd-8919-28d8f1c78dc2 tempest-SnapshotDependencyTests-1942573504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2da267e9-cd23-475d-beba-d4508958ca97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:34:50 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-006da056-d95d-41fd-8919-28d8f1c78dc2 tempest-SnapshotDependencyTests-1942573504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2da267e9-cd23-475d-beba-d4508958ca97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:34:50 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-006da056-d95d-41fd-8919-28d8f1c78dc2 tempest-SnapshotDependencyTests-1942573504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8846e72-824f-4be4-8e62-85ef132b1ca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:34:50 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-006da056-d95d-41fd-8919-28d8f1c78dc2 tempest-SnapshotDependencyTests-1942573504 None] Volume 0dd02463-e194-4d32-8a1b-cdaaaedd01d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0dd02463-e194-4d32-8a1b-cdaaaedd01d1', 'volume_size': 1} Jul 22 03:34:50 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-006da056-d95d-41fd-8919-28d8f1c78dc2 tempest-SnapshotDependencyTests-1942573504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:34:50 devstack sudo[105718]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:50 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-19166db2-29b9-424d-8ccb-035748f920a0 tempest-ProjectReaderTests-483930896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1559b4a5-d8d6-4149-8c92-0533550d65bb.info" returned: 0 in 0.258s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:50 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-19166db2-29b9-424d-8ccb-035748f920a0 tempest-ProjectReaderTests-483930896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.624s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:34:50 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-73c18acd-eba6-4282-ad22-ec88593621b1 tempest-ProjectMemberTests-64253088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.469s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:34:50 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-73c18acd-eba6-4282-ad22-ec88593621b1 tempest-ProjectMemberTests-64253088 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:34:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1808692426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d7a1e96-3874-4be8-838a-11b92a2a5913,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05eb3b4eac3e4ffe97247852227f9ffa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:34:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:34:50Z,use_quota=True,user_id='ecf77e3a2be443e28cffe6ba02afc5e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:34:50 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-73c18acd-eba6-4282-ad22-ec88593621b1 tempest-ProjectMemberTests-64253088 None] Creating volume 7d7a1e96-3874-4be8-838a-11b92a2a5913 {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:34:50 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-73c18acd-eba6-4282-ad22-ec88593621b1 tempest-ProjectMemberTests-64253088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:34:50 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-73c18acd-eba6-4282-ad22-ec88593621b1 tempest-ProjectMemberTests-64253088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:34:50 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-73c18acd-eba6-4282-ad22-ec88593621b1 tempest-ProjectMemberTests-64253088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:34:50 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-73c18acd-eba6-4282-ad22-ec88593621b1 tempest-ProjectMemberTests-64253088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:34:50 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-73c18acd-eba6-4282-ad22-ec88593621b1 tempest-ProjectMemberTests-64253088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:34:50 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-73c18acd-eba6-4282-ad22-ec88593621b1 tempest-ProjectMemberTests-64253088 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:34:50 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-73c18acd-eba6-4282-ad22-ec88593621b1 tempest-ProjectMemberTests-64253088 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:34:50 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-73c18acd-eba6-4282-ad22-ec88593621b1 tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-7d7a1e96-3874-4be8-838a-11b92a2a5913 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:50 devstack sudo[105721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-7d7a1e96-3874-4be8-838a-11b92a2a5913 1073741824 Jul 22 03:34:50 devstack sudo[105721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:50 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-19166db2-29b9-424d-8ccb-035748f920a0 tempest-ProjectReaderTests-483930896 None] Create snapshot completed successfully Jul 22 03:34:51 devstack sudo[105721]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:51 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-73c18acd-eba6-4282-ad22-ec88593621b1 tempest-ProjectMemberTests-64253088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-7d7a1e96-3874-4be8-838a-11b92a2a5913 1073741824" returned: 0 in 0.473s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:51 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-73c18acd-eba6-4282-ad22-ec88593621b1 tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-7d7a1e96-3874-4be8-838a-11b92a2a5913 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:51 devstack sudo[105727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-7d7a1e96-3874-4be8-838a-11b92a2a5913 Jul 22 03:34:51 devstack sudo[105727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:51 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-df24ff9d-197b-42ee-8685-72bf5fe0107a tempest-ProjectReaderTests-483930896 None] Acquiring lock "cinder-d26871b8-4d21-46a0-8cf1-2552d6fe1b04-delete_snapshot" by "delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:34:51 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-df24ff9d-197b-42ee-8685-72bf5fe0107a tempest-ProjectReaderTests-483930896 None] Lock "cinder-d26871b8-4d21-46a0-8cf1-2552d6fe1b04-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:34:51 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-df24ff9d-197b-42ee-8685-72bf5fe0107a tempest-ProjectReaderTests-483930896 None] Acquiring lock "cinder-quobyte-1559b4a5-d8d6-4149-8c92-0533550d65bb" by "delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:34:51 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-df24ff9d-197b-42ee-8685-72bf5fe0107a tempest-ProjectReaderTests-483930896 None] Lock "cinder-quobyte-1559b4a5-d8d6-4149-8c92-0533550d65bb" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:34:51 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-df24ff9d-197b-42ee-8685-72bf5fe0107a tempest-ProjectReaderTests-483930896 None] Acquiring lock "cinder-quobyte-d26871b8-4d21-46a0-8cf1-2552d6fe1b04" by "_delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:34:51 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-df24ff9d-197b-42ee-8685-72bf5fe0107a tempest-ProjectReaderTests-483930896 None] Lock "cinder-quobyte-d26871b8-4d21-46a0-8cf1-2552d6fe1b04" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:34:51 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-df24ff9d-197b-42ee-8685-72bf5fe0107a tempest-ProjectReaderTests-483930896 None] Deleting offline snapshot d26871b8-4d21-46a0-8cf1-2552d6fe1b04 of volume 1559b4a5-d8d6-4149-8c92-0533550d65bb {{(pid=87747) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 03:34:51 devstack sudo[105727]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:51 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-df24ff9d-197b-42ee-8685-72bf5fe0107a tempest-ProjectReaderTests-483930896 None] snapshot_file for this snap is: volume-1559b4a5-d8d6-4149-8c92-0533550d65bb.d26871b8-4d21-46a0-8cf1-2552d6fe1b04 {{(pid=87747) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 03:34:51 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-73c18acd-eba6-4282-ad22-ec88593621b1 tempest-ProjectMemberTests-64253088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-7d7a1e96-3874-4be8-838a-11b92a2a5913" returned: 0 in 0.275s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:51 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-73c18acd-eba6-4282-ad22-ec88593621b1 tempest-ProjectMemberTests-64253088 None] <== create_volume: return (790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:34:51 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-73c18acd-eba6-4282-ad22-ec88593621b1 tempest-ProjectMemberTests-64253088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.793s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:34:51 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-006da056-d95d-41fd-8919-28d8f1c78dc2 tempest-SnapshotDependencyTests-1942573504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.917s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:34:51 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-006da056-d95d-41fd-8919-28d8f1c78dc2 tempest-SnapshotDependencyTests-1942573504 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:34:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1575359227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0dd02463-e194-4d32-8a1b-cdaaaedd01d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fb34e8b09974906bafc5d1ce97e5c78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:34:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:34:50Z,use_quota=True,user_id='452741dd22a14b74ba7626c593145253',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:34:51 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-006da056-d95d-41fd-8919-28d8f1c78dc2 tempest-SnapshotDependencyTests-1942573504 None] Creating volume 0dd02463-e194-4d32-8a1b-cdaaaedd01d1 {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:34:51 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-006da056-d95d-41fd-8919-28d8f1c78dc2 tempest-SnapshotDependencyTests-1942573504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:34:51 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-006da056-d95d-41fd-8919-28d8f1c78dc2 tempest-SnapshotDependencyTests-1942573504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:34:51 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-006da056-d95d-41fd-8919-28d8f1c78dc2 tempest-SnapshotDependencyTests-1942573504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:34:51 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-006da056-d95d-41fd-8919-28d8f1c78dc2 tempest-SnapshotDependencyTests-1942573504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:34:51 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-006da056-d95d-41fd-8919-28d8f1c78dc2 tempest-SnapshotDependencyTests-1942573504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:34:51 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-006da056-d95d-41fd-8919-28d8f1c78dc2 tempest-SnapshotDependencyTests-1942573504 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:34:51 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-006da056-d95d-41fd-8919-28d8f1c78dc2 tempest-SnapshotDependencyTests-1942573504 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:34:51 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-006da056-d95d-41fd-8919-28d8f1c78dc2 tempest-SnapshotDependencyTests-1942573504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0dd02463-e194-4d32-8a1b-cdaaaedd01d1 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:51 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[18db6b33-68e0-4ee8-a2d9-0508915b74ac]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:34:51 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-df24ff9d-197b-42ee-8685-72bf5fe0107a tempest-ProjectReaderTests-483930896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1559b4a5-d8d6-4149-8c92-0533550d65bb.d26871b8-4d21-46a0-8cf1-2552d6fe1b04 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:51 devstack sudo[105730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0dd02463-e194-4d32-8a1b-cdaaaedd01d1 1073741824 Jul 22 03:34:51 devstack sudo[105730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:51 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-73c18acd-eba6-4282-ad22-ec88593621b1 tempest-ProjectMemberTests-64253088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90e3bb07-b174-41aa-be70-95398766f479) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d7a1e96-3874-4be8-838a-11b92a2a5913', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:34:51 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-73c18acd-eba6-4282-ad22-ec88593621b1 tempest-ProjectMemberTests-64253088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6985b93f-d339-4cc3-b7c1-8bd64fac1e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:34:51 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-73c18acd-eba6-4282-ad22-ec88593621b1 tempest-ProjectMemberTests-64253088 None] Volume volume-7d7a1e96-3874-4be8-838a-11b92a2a5913 (7d7a1e96-3874-4be8-838a-11b92a2a5913): created successfully Jul 22 03:34:51 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-73c18acd-eba6-4282-ad22-ec88593621b1 tempest-ProjectMemberTests-64253088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6985b93f-d339-4cc3-b7c1-8bd64fac1e04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:34:51 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-73c18acd-eba6-4282-ad22-ec88593621b1 tempest-ProjectMemberTests-64253088 None] Flow 'volume_create_manager' (95be6116-8a02-4aa7-b26c-151bc5039a1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:34:51 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-73c18acd-eba6-4282-ad22-ec88593621b1 tempest-ProjectMemberTests-64253088 None] Created volume successfully. Jul 22 03:34:51 devstack sudo[105731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1559b4a5-d8d6-4149-8c92-0533550d65bb.d26871b8-4d21-46a0-8cf1-2552d6fe1b04 Jul 22 03:34:51 devstack sudo[105731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:51 devstack sudo[105731]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:51 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-df24ff9d-197b-42ee-8685-72bf5fe0107a tempest-ProjectReaderTests-483930896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1559b4a5-d8d6-4149-8c92-0533550d65bb.d26871b8-4d21-46a0-8cf1-2552d6fe1b04" returned: 0 in 0.378s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:51 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-df24ff9d-197b-42ee-8685-72bf5fe0107a tempest-ProjectReaderTests-483930896 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1559b4a5-d8d6-4149-8c92-0533550d65bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87747) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 03:34:51 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[07138bfe-df59-4fef-b9d3-35d5d22074a9]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:34:51 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-df24ff9d-197b-42ee-8685-72bf5fe0107a tempest-ProjectReaderTests-483930896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1559b4a5-d8d6-4149-8c92-0533550d65bb {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:51 devstack sudo[105730]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:51 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-006da056-d95d-41fd-8919-28d8f1c78dc2 tempest-SnapshotDependencyTests-1942573504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0dd02463-e194-4d32-8a1b-cdaaaedd01d1 1073741824" returned: 0 in 0.449s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:51 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-006da056-d95d-41fd-8919-28d8f1c78dc2 tempest-SnapshotDependencyTests-1942573504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0dd02463-e194-4d32-8a1b-cdaaaedd01d1 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:51 devstack sudo[105743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0dd02463-e194-4d32-8a1b-cdaaaedd01d1 Jul 22 03:34:51 devstack sudo[105743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:51 devstack sudo[105742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1559b4a5-d8d6-4149-8c92-0533550d65bb Jul 22 03:34:51 devstack sudo[105742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:52 devstack sudo[105743]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:52 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-006da056-d95d-41fd-8919-28d8f1c78dc2 tempest-SnapshotDependencyTests-1942573504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0dd02463-e194-4d32-8a1b-cdaaaedd01d1" returned: 0 in 0.322s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:52 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-006da056-d95d-41fd-8919-28d8f1c78dc2 tempest-SnapshotDependencyTests-1942573504 None] <== create_volume: return (820ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:34:52 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-006da056-d95d-41fd-8919-28d8f1c78dc2 tempest-SnapshotDependencyTests-1942573504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.823s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:34:52 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-006da056-d95d-41fd-8919-28d8f1c78dc2 tempest-SnapshotDependencyTests-1942573504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8846e72-824f-4be4-8e62-85ef132b1ca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0dd02463-e194-4d32-8a1b-cdaaaedd01d1', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:34:52 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-006da056-d95d-41fd-8919-28d8f1c78dc2 tempest-SnapshotDependencyTests-1942573504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (655f1d34-9d02-4e06-8750-a71ef18b22aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:34:52 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-f40ac280-b43e-4fe5-9d65-3ee14fa6a36b tempest-ProjectMemberTests-64253088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:34:52 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-f40ac280-b43e-4fe5-9d65-3ee14fa6a36b tempest-ProjectMemberTests-64253088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:34:52 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-006da056-d95d-41fd-8919-28d8f1c78dc2 tempest-SnapshotDependencyTests-1942573504 None] Volume volume-0dd02463-e194-4d32-8a1b-cdaaaedd01d1 (0dd02463-e194-4d32-8a1b-cdaaaedd01d1): created successfully Jul 22 03:34:52 devstack sudo[105742]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:52 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-006da056-d95d-41fd-8919-28d8f1c78dc2 tempest-SnapshotDependencyTests-1942573504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (655f1d34-9d02-4e06-8750-a71ef18b22aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:34:52 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-006da056-d95d-41fd-8919-28d8f1c78dc2 tempest-SnapshotDependencyTests-1942573504 None] Flow 'volume_create_manager' (82ec5c72-052f-4cc8-8596-deb98ea62a3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:34:52 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-df24ff9d-197b-42ee-8685-72bf5fe0107a tempest-ProjectReaderTests-483930896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1559b4a5-d8d6-4149-8c92-0533550d65bb" returned: 0 in 0.464s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:52 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-f40ac280-b43e-4fe5-9d65-3ee14fa6a36b tempest-ProjectMemberTests-64253088 None] Creating offline snapshot ff10a9c4-9208-4ab8-a456-10b460e77006 of volume 7d7a1e96-3874-4be8-838a-11b92a2a5913 {{(pid=87747) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 03:34:52 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-df24ff9d-197b-42ee-8685-72bf5fe0107a tempest-ProjectReaderTests-483930896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1559b4a5-d8d6-4149-8c92-0533550d65bb.d26871b8-4d21-46a0-8cf1-2552d6fe1b04 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:52 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-006da056-d95d-41fd-8919-28d8f1c78dc2 tempest-SnapshotDependencyTests-1942573504 None] Created volume successfully. Jul 22 03:34:52 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4f40761-ca1d-4c52-9515-e4d0a9caeaeb]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:34:52 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f40ac280-b43e-4fe5-9d65-3ee14fa6a36b tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-7d7a1e96-3874-4be8-838a-11b92a2a5913 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:52 devstack sudo[105750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1559b4a5-d8d6-4149-8c92-0533550d65bb.d26871b8-4d21-46a0-8cf1-2552d6fe1b04 Jul 22 03:34:52 devstack sudo[105750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:52 devstack sudo[105751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-7d7a1e96-3874-4be8-838a-11b92a2a5913 Jul 22 03:34:52 devstack sudo[105751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:52 devstack sudo[105750]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:52 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-df24ff9d-197b-42ee-8685-72bf5fe0107a tempest-ProjectReaderTests-483930896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1559b4a5-d8d6-4149-8c92-0533550d65bb.d26871b8-4d21-46a0-8cf1-2552d6fe1b04" returned: 0 in 0.444s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:52 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-df24ff9d-197b-42ee-8685-72bf5fe0107a tempest-ProjectReaderTests-483930896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1559b4a5-d8d6-4149-8c92-0533550d65bb.d26871b8-4d21-46a0-8cf1-2552d6fe1b04 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:52 devstack sudo[105761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1559b4a5-d8d6-4149-8c92-0533550d65bb.d26871b8-4d21-46a0-8cf1-2552d6fe1b04 Jul 22 03:34:52 devstack sudo[105761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:52 devstack sudo[105751]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:52 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-620845c1-6d2e-480d-8a78-49aa73bba8c6 tempest-SnapshotDependencyTests-1942573504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:34:52 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f40ac280-b43e-4fe5-9d65-3ee14fa6a36b tempest-ProjectMemberTests-64253088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-7d7a1e96-3874-4be8-838a-11b92a2a5913" returned: 0 in 0.468s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:52 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f40ac280-b43e-4fe5-9d65-3ee14fa6a36b tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-7d7a1e96-3874-4be8-838a-11b92a2a5913,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-7d7a1e96-3874-4be8-838a-11b92a2a5913.ff10a9c4-9208-4ab8-a456-10b460e77006 1G {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:52 devstack sudo[105763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-7d7a1e96-3874-4be8-838a-11b92a2a5913,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-7d7a1e96-3874-4be8-838a-11b92a2a5913.ff10a9c4-9208-4ab8-a456-10b460e77006 1G Jul 22 03:34:52 devstack sudo[105763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:52 devstack sudo[105761]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:52 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-df24ff9d-197b-42ee-8685-72bf5fe0107a tempest-ProjectReaderTests-483930896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1559b4a5-d8d6-4149-8c92-0533550d65bb.d26871b8-4d21-46a0-8cf1-2552d6fe1b04" returned: 0 in 0.283s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:53 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-df24ff9d-197b-42ee-8685-72bf5fe0107a tempest-ProjectReaderTests-483930896 None] Lock "cinder-quobyte-d26871b8-4d21-46a0-8cf1-2552d6fe1b04" released by "_delete_snapshot" :: held 1.699s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:34:53 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-df24ff9d-197b-42ee-8685-72bf5fe0107a tempest-ProjectReaderTests-483930896 None] Lock "cinder-quobyte-1559b4a5-d8d6-4149-8c92-0533550d65bb" released by "delete_snapshot" :: held 1.723s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:34:53 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-df24ff9d-197b-42ee-8685-72bf5fe0107a tempest-ProjectReaderTests-483930896 None] Created reservations ['5470a08e-221e-4b6f-adca-ba55e49a1457', '52d8c85f-128e-4f4e-b535-0901be2428e9', '047d8b31-fba3-4ef9-b946-e87b2a45e4b2', '87d8f802-3935-459b-a671-1cda41806072'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:34:53 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-df24ff9d-197b-42ee-8685-72bf5fe0107a tempest-ProjectReaderTests-483930896 None] Delete snapshot completed successfully. Jul 22 03:34:53 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-df24ff9d-197b-42ee-8685-72bf5fe0107a tempest-ProjectReaderTests-483930896 None] Lock "cinder-d26871b8-4d21-46a0-8cf1-2552d6fe1b04-delete_snapshot" released by "delete_snapshot" :: held 1.877s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:34:53 devstack sudo[105763]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:53 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f40ac280-b43e-4fe5-9d65-3ee14fa6a36b tempest-ProjectMemberTests-64253088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-7d7a1e96-3874-4be8-838a-11b92a2a5913,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-7d7a1e96-3874-4be8-838a-11b92a2a5913.ff10a9c4-9208-4ab8-a456-10b460e77006 1G" returned: 0 in 0.473s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:53 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f40ac280-b43e-4fe5-9d65-3ee14fa6a36b tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d7a1e96-3874-4be8-838a-11b92a2a5913 -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-7d7a1e96-3874-4be8-838a-11b92a2a5913.ff10a9c4-9208-4ab8-a456-10b460e77006 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:53 devstack sudo[105770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d7a1e96-3874-4be8-838a-11b92a2a5913 -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-7d7a1e96-3874-4be8-838a-11b92a2a5913.ff10a9c4-9208-4ab8-a456-10b460e77006 Jul 22 03:34:53 devstack sudo[105770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:53 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-cec18884-b958-4b1e-8687-08a13f89ccc1 tempest-ProjectReaderTests-483930896 None] Acquiring lock "cinder-1559b4a5-d8d6-4149-8c92-0533550d65bb-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:34:53 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-cec18884-b958-4b1e-8687-08a13f89ccc1 tempest-ProjectReaderTests-483930896 None] Lock "cinder-1559b4a5-d8d6-4149-8c92-0533550d65bb-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:34:53 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-cec18884-b958-4b1e-8687-08a13f89ccc1 tempest-ProjectReaderTests-483930896 None] Acquiring lock "cinder-quobyte-1559b4a5-d8d6-4149-8c92-0533550d65bb" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:34:53 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-cec18884-b958-4b1e-8687-08a13f89ccc1 tempest-ProjectReaderTests-483930896 None] Lock "cinder-quobyte-1559b4a5-d8d6-4149-8c92-0533550d65bb" acquired by "delete_volume" :: waited 0.015s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:34:53 devstack sudo[105770]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:53 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f40ac280-b43e-4fe5-9d65-3ee14fa6a36b tempest-ProjectMemberTests-64253088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d7a1e96-3874-4be8-838a-11b92a2a5913 -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-7d7a1e96-3874-4be8-838a-11b92a2a5913.ff10a9c4-9208-4ab8-a456-10b460e77006" returned: 0 in 0.324s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:53 devstack cinder-volume[87747]: WARNING cinder.volume.drivers.remotefs [None req-f40ac280-b43e-4fe5-9d65-3ee14fa6a36b tempest-ProjectMemberTests-64253088 None] /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-7d7a1e96-3874-4be8-838a-11b92a2a5913.ff10a9c4-9208-4ab8-a456-10b460e77006 is being set with open permissions: ugo+rw Jul 22 03:34:53 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f40ac280-b43e-4fe5-9d65-3ee14fa6a36b tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-7d7a1e96-3874-4be8-838a-11b92a2a5913.ff10a9c4-9208-4ab8-a456-10b460e77006 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:53 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dc96762-74a1-4f11-95b4-e4752103422d]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:34:53 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-cec18884-b958-4b1e-8687-08a13f89ccc1 tempest-ProjectReaderTests-483930896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1559b4a5-d8d6-4149-8c92-0533550d65bb {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:53 devstack sudo[105776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-7d7a1e96-3874-4be8-838a-11b92a2a5913.ff10a9c4-9208-4ab8-a456-10b460e77006 Jul 22 03:34:53 devstack sudo[105776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:53 devstack sudo[105777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1559b4a5-d8d6-4149-8c92-0533550d65bb Jul 22 03:34:53 devstack sudo[105777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:53 devstack sudo[105776]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:53 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f40ac280-b43e-4fe5-9d65-3ee14fa6a36b tempest-ProjectMemberTests-64253088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-7d7a1e96-3874-4be8-838a-11b92a2a5913.ff10a9c4-9208-4ab8-a456-10b460e77006" returned: 0 in 0.251s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:53 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f40ac280-b43e-4fe5-9d65-3ee14fa6a36b tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-7d7a1e96-3874-4be8-838a-11b92a2a5913.info {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:53 devstack sudo[105781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-7d7a1e96-3874-4be8-838a-11b92a2a5913.info Jul 22 03:34:53 devstack sudo[105781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:53 devstack sudo[105777]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:53 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-cec18884-b958-4b1e-8687-08a13f89ccc1 tempest-ProjectReaderTests-483930896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1559b4a5-d8d6-4149-8c92-0533550d65bb" returned: 0 in 0.380s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:53 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-cec18884-b958-4b1e-8687-08a13f89ccc1 tempest-ProjectReaderTests-483930896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1559b4a5-d8d6-4149-8c92-0533550d65bb {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:53 devstack sudo[105786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1559b4a5-d8d6-4149-8c92-0533550d65bb Jul 22 03:34:53 devstack sudo[105786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:54 devstack sudo[105781]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:54 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f40ac280-b43e-4fe5-9d65-3ee14fa6a36b tempest-ProjectMemberTests-64253088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-7d7a1e96-3874-4be8-838a-11b92a2a5913.info" returned: 0 in 0.279s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:54 devstack cinder-volume[87747]: WARNING cinder.volume.drivers.remotefs [None req-f40ac280-b43e-4fe5-9d65-3ee14fa6a36b tempest-ProjectMemberTests-64253088 None] /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-7d7a1e96-3874-4be8-838a-11b92a2a5913.info is being set with open permissions: ugo+rw Jul 22 03:34:54 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f40ac280-b43e-4fe5-9d65-3ee14fa6a36b tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-7d7a1e96-3874-4be8-838a-11b92a2a5913.info {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:54 devstack sudo[105789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-7d7a1e96-3874-4be8-838a-11b92a2a5913.info Jul 22 03:34:54 devstack sudo[105789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:54 devstack sudo[105786]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:54 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-cec18884-b958-4b1e-8687-08a13f89ccc1 tempest-ProjectReaderTests-483930896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-1559b4a5-d8d6-4149-8c92-0533550d65bb" returned: 0 in 0.293s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:54 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-cec18884-b958-4b1e-8687-08a13f89ccc1 tempest-ProjectReaderTests-483930896 None] Lock "cinder-quobyte-1559b4a5-d8d6-4149-8c92-0533550d65bb" released by "delete_volume" :: held 0.757s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:34:54 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-cec18884-b958-4b1e-8687-08a13f89ccc1 tempest-ProjectReaderTests-483930896 None] Created reservations ['e107ea05-4640-4b0e-beac-bb27cb2e4f03', '549b0abd-cfd6-4d2f-b4d5-98ee710511fa', '360d4ce1-7b94-4af2-b708-fb174ebe1d69', '96728f19-9b65-4e8a-a93c-0ac1911fd2a5'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:34:54 devstack sudo[105789]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:54 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f40ac280-b43e-4fe5-9d65-3ee14fa6a36b tempest-ProjectMemberTests-64253088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-7d7a1e96-3874-4be8-838a-11b92a2a5913.info" returned: 0 in 0.298s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:54 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-f40ac280-b43e-4fe5-9d65-3ee14fa6a36b tempest-ProjectMemberTests-64253088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.208s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:34:54 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-620845c1-6d2e-480d-8a78-49aa73bba8c6 tempest-SnapshotDependencyTests-1942573504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.684s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:34:54 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-620845c1-6d2e-480d-8a78-49aa73bba8c6 tempest-SnapshotDependencyTests-1942573504 None] Creating offline snapshot 354a5fdf-737a-439b-9535-09d3852970b0 of volume 0dd02463-e194-4d32-8a1b-cdaaaedd01d1 {{(pid=87747) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 03:34:54 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-f40ac280-b43e-4fe5-9d65-3ee14fa6a36b tempest-ProjectMemberTests-64253088 None] Create snapshot completed successfully Jul 22 03:34:54 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[66efab60-e4df-420b-b467-297d1432e272]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:34:54 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-620845c1-6d2e-480d-8a78-49aa73bba8c6 tempest-SnapshotDependencyTests-1942573504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0dd02463-e194-4d32-8a1b-cdaaaedd01d1 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:54 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-cec18884-b958-4b1e-8687-08a13f89ccc1 tempest-ProjectReaderTests-483930896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:34:54 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-cec18884-b958-4b1e-8687-08a13f89ccc1 tempest-ProjectReaderTests-483930896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:34:54 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-cec18884-b958-4b1e-8687-08a13f89ccc1 tempest-ProjectReaderTests-483930896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:34:54 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-cec18884-b958-4b1e-8687-08a13f89ccc1 tempest-ProjectReaderTests-483930896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:34:54 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-cec18884-b958-4b1e-8687-08a13f89ccc1 tempest-ProjectReaderTests-483930896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:34:54 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-cec18884-b958-4b1e-8687-08a13f89ccc1 tempest-ProjectReaderTests-483930896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:54 devstack sudo[105794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:34:54 devstack sudo[105794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:54 devstack sudo[105793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0dd02463-e194-4d32-8a1b-cdaaaedd01d1 Jul 22 03:34:54 devstack sudo[105793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:54 devstack sudo[105794]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:54 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-cec18884-b958-4b1e-8687-08a13f89ccc1 tempest-ProjectReaderTests-483930896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.333s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:54 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-cec18884-b958-4b1e-8687-08a13f89ccc1 tempest-ProjectReaderTests-483930896 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:34:54 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-cec18884-b958-4b1e-8687-08a13f89ccc1 tempest-ProjectReaderTests-483930896 None] Deleted volume successfully. Jul 22 03:34:54 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-cec18884-b958-4b1e-8687-08a13f89ccc1 tempest-ProjectReaderTests-483930896 None] Lock "cinder-1559b4a5-d8d6-4149-8c92-0533550d65bb-delete_volume" released by "delete_volume" :: held 1.449s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:34:54 devstack sudo[105793]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:54 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-620845c1-6d2e-480d-8a78-49aa73bba8c6 tempest-SnapshotDependencyTests-1942573504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0dd02463-e194-4d32-8a1b-cdaaaedd01d1" returned: 0 in 0.433s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:54 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-620845c1-6d2e-480d-8a78-49aa73bba8c6 tempest-SnapshotDependencyTests-1942573504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0dd02463-e194-4d32-8a1b-cdaaaedd01d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0dd02463-e194-4d32-8a1b-cdaaaedd01d1.354a5fdf-737a-439b-9535-09d3852970b0 1G {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:54 devstack sudo[105801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0dd02463-e194-4d32-8a1b-cdaaaedd01d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0dd02463-e194-4d32-8a1b-cdaaaedd01d1.354a5fdf-737a-439b-9535-09d3852970b0 1G Jul 22 03:34:54 devstack sudo[105801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:55 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-c662c839-7ec1-4607-abe1-873d363317c0 tempest-ProjectReaderTests-483930896 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:34:55 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-c662c839-7ec1-4607-abe1-873d363317c0 tempest-ProjectReaderTests-483930896 None] Flow 'volume_create_manager' (a84ca175-bb53-45ce-874a-28ae8b7fae31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:34:55 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-c662c839-7ec1-4607-abe1-873d363317c0 tempest-ProjectReaderTests-483930896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de5498e6-3d66-4004-a45d-92523007158d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:34:55 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-c662c839-7ec1-4607-abe1-873d363317c0 tempest-ProjectReaderTests-483930896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de5498e6-3d66-4004-a45d-92523007158d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:34:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2103109915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=086b2378-d086-4864-9fbf-b19ba83c4659,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd45f1aa7e184c4599e74792f6f4b497',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:34:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:34:55Z,use_quota=True,user_id='222bb0de5f274a1db76ea74beb58d4b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:34:55 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-c662c839-7ec1-4607-abe1-873d363317c0 tempest-ProjectReaderTests-483930896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (069f4dbd-adf9-47f2-883b-55f3b74a230b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:34:55 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-c662c839-7ec1-4607-abe1-873d363317c0 tempest-ProjectReaderTests-483930896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (069f4dbd-adf9-47f2-883b-55f3b74a230b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:34:55 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-c662c839-7ec1-4607-abe1-873d363317c0 tempest-ProjectReaderTests-483930896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab88d676-f0db-4b88-8780-d493e8bd2629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:34:55 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-c662c839-7ec1-4607-abe1-873d363317c0 tempest-ProjectReaderTests-483930896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab88d676-f0db-4b88-8780-d493e8bd2629) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '086b2378-d086-4864-9fbf-b19ba83c4659', 'volume_name': 'volume-086b2378-d086-4864-9fbf-b19ba83c4659', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:34:55 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-c662c839-7ec1-4607-abe1-873d363317c0 tempest-ProjectReaderTests-483930896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a68c8f1c-c415-4c32-b368-40f8086cf968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:34:55 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-c662c839-7ec1-4607-abe1-873d363317c0 tempest-ProjectReaderTests-483930896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a68c8f1c-c415-4c32-b368-40f8086cf968) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:34:55 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-c662c839-7ec1-4607-abe1-873d363317c0 tempest-ProjectReaderTests-483930896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30735c9b-3faf-4f94-9c95-3c6235beb1bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:34:55 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-c662c839-7ec1-4607-abe1-873d363317c0 tempest-ProjectReaderTests-483930896 None] Volume 086b2378-d086-4864-9fbf-b19ba83c4659: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-086b2378-d086-4864-9fbf-b19ba83c4659', 'volume_size': 1} Jul 22 03:34:55 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-c662c839-7ec1-4607-abe1-873d363317c0 tempest-ProjectReaderTests-483930896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:34:55 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-f6894f30-7e28-4728-bbe7-c847ab95815f tempest-ProjectMemberTests-64253088 None] Acquiring lock "cinder-ff10a9c4-9208-4ab8-a456-10b460e77006-delete_snapshot" by "delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:34:55 devstack sudo[105801]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:55 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-f6894f30-7e28-4728-bbe7-c847ab95815f tempest-ProjectMemberTests-64253088 None] Lock "cinder-ff10a9c4-9208-4ab8-a456-10b460e77006-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:34:55 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-f6894f30-7e28-4728-bbe7-c847ab95815f tempest-ProjectMemberTests-64253088 None] Acquiring lock "cinder-quobyte-7d7a1e96-3874-4be8-838a-11b92a2a5913" by "delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:34:55 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-620845c1-6d2e-480d-8a78-49aa73bba8c6 tempest-SnapshotDependencyTests-1942573504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0dd02463-e194-4d32-8a1b-cdaaaedd01d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0dd02463-e194-4d32-8a1b-cdaaaedd01d1.354a5fdf-737a-439b-9535-09d3852970b0 1G" returned: 0 in 0.504s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:55 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-620845c1-6d2e-480d-8a78-49aa73bba8c6 tempest-SnapshotDependencyTests-1942573504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0dd02463-e194-4d32-8a1b-cdaaaedd01d1 -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0dd02463-e194-4d32-8a1b-cdaaaedd01d1.354a5fdf-737a-439b-9535-09d3852970b0 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:55 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-f6894f30-7e28-4728-bbe7-c847ab95815f tempest-ProjectMemberTests-64253088 None] Lock "cinder-quobyte-7d7a1e96-3874-4be8-838a-11b92a2a5913" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:34:55 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-f6894f30-7e28-4728-bbe7-c847ab95815f tempest-ProjectMemberTests-64253088 None] Acquiring lock "cinder-quobyte-ff10a9c4-9208-4ab8-a456-10b460e77006" by "_delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:34:55 devstack sudo[105807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0dd02463-e194-4d32-8a1b-cdaaaedd01d1 -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0dd02463-e194-4d32-8a1b-cdaaaedd01d1.354a5fdf-737a-439b-9535-09d3852970b0 Jul 22 03:34:55 devstack sudo[105807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:55 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-f6894f30-7e28-4728-bbe7-c847ab95815f tempest-ProjectMemberTests-64253088 None] Lock "cinder-quobyte-ff10a9c4-9208-4ab8-a456-10b460e77006" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:34:55 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-f6894f30-7e28-4728-bbe7-c847ab95815f tempest-ProjectMemberTests-64253088 None] Deleting offline snapshot ff10a9c4-9208-4ab8-a456-10b460e77006 of volume 7d7a1e96-3874-4be8-838a-11b92a2a5913 {{(pid=87747) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 03:34:55 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-f6894f30-7e28-4728-bbe7-c847ab95815f tempest-ProjectMemberTests-64253088 None] snapshot_file for this snap is: volume-7d7a1e96-3874-4be8-838a-11b92a2a5913.ff10a9c4-9208-4ab8-a456-10b460e77006 {{(pid=87747) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 03:34:55 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[41e8e38c-d99c-4836-8a98-cdc1c80c04dc]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:34:55 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f6894f30-7e28-4728-bbe7-c847ab95815f tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-7d7a1e96-3874-4be8-838a-11b92a2a5913.ff10a9c4-9208-4ab8-a456-10b460e77006 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:55 devstack sudo[105809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-7d7a1e96-3874-4be8-838a-11b92a2a5913.ff10a9c4-9208-4ab8-a456-10b460e77006 Jul 22 03:34:55 devstack sudo[105809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:55 devstack sudo[105807]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:55 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-620845c1-6d2e-480d-8a78-49aa73bba8c6 tempest-SnapshotDependencyTests-1942573504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0dd02463-e194-4d32-8a1b-cdaaaedd01d1 -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0dd02463-e194-4d32-8a1b-cdaaaedd01d1.354a5fdf-737a-439b-9535-09d3852970b0" returned: 0 in 0.352s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:55 devstack cinder-volume[87747]: WARNING cinder.volume.drivers.remotefs [None req-620845c1-6d2e-480d-8a78-49aa73bba8c6 tempest-SnapshotDependencyTests-1942573504 None] /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0dd02463-e194-4d32-8a1b-cdaaaedd01d1.354a5fdf-737a-439b-9535-09d3852970b0 is being set with open permissions: ugo+rw Jul 22 03:34:55 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-620845c1-6d2e-480d-8a78-49aa73bba8c6 tempest-SnapshotDependencyTests-1942573504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0dd02463-e194-4d32-8a1b-cdaaaedd01d1.354a5fdf-737a-439b-9535-09d3852970b0 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:55 devstack sudo[105814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0dd02463-e194-4d32-8a1b-cdaaaedd01d1.354a5fdf-737a-439b-9535-09d3852970b0 Jul 22 03:34:55 devstack sudo[105814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:55 devstack sudo[105809]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:55 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f6894f30-7e28-4728-bbe7-c847ab95815f tempest-ProjectMemberTests-64253088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-7d7a1e96-3874-4be8-838a-11b92a2a5913.ff10a9c4-9208-4ab8-a456-10b460e77006" returned: 0 in 0.410s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:55 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-f6894f30-7e28-4728-bbe7-c847ab95815f tempest-ProjectMemberTests-64253088 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d7a1e96-3874-4be8-838a-11b92a2a5913(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87747) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 03:34:55 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ab47b5a-4b8c-4851-bfdd-bc4c8293af3e]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:34:55 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f6894f30-7e28-4728-bbe7-c847ab95815f tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-7d7a1e96-3874-4be8-838a-11b92a2a5913 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:56 devstack sudo[105814]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:56 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-620845c1-6d2e-480d-8a78-49aa73bba8c6 tempest-SnapshotDependencyTests-1942573504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0dd02463-e194-4d32-8a1b-cdaaaedd01d1.354a5fdf-737a-439b-9535-09d3852970b0" returned: 0 in 0.323s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:56 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-620845c1-6d2e-480d-8a78-49aa73bba8c6 tempest-SnapshotDependencyTests-1942573504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0dd02463-e194-4d32-8a1b-cdaaaedd01d1.info {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:56 devstack sudo[105819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-7d7a1e96-3874-4be8-838a-11b92a2a5913 Jul 22 03:34:56 devstack sudo[105819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:56 devstack sudo[105823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0dd02463-e194-4d32-8a1b-cdaaaedd01d1.info Jul 22 03:34:56 devstack sudo[105823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:56 devstack sudo[105819]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:56 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f6894f30-7e28-4728-bbe7-c847ab95815f tempest-ProjectMemberTests-64253088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-7d7a1e96-3874-4be8-838a-11b92a2a5913" returned: 0 in 0.439s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:56 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f6894f30-7e28-4728-bbe7-c847ab95815f tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-7d7a1e96-3874-4be8-838a-11b92a2a5913.ff10a9c4-9208-4ab8-a456-10b460e77006 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:56 devstack sudo[105823]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:56 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-620845c1-6d2e-480d-8a78-49aa73bba8c6 tempest-SnapshotDependencyTests-1942573504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0dd02463-e194-4d32-8a1b-cdaaaedd01d1.info" returned: 0 in 0.283s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:56 devstack cinder-volume[87747]: WARNING cinder.volume.drivers.remotefs [None req-620845c1-6d2e-480d-8a78-49aa73bba8c6 tempest-SnapshotDependencyTests-1942573504 None] /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0dd02463-e194-4d32-8a1b-cdaaaedd01d1.info is being set with open permissions: ugo+rw Jul 22 03:34:56 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-620845c1-6d2e-480d-8a78-49aa73bba8c6 tempest-SnapshotDependencyTests-1942573504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0dd02463-e194-4d32-8a1b-cdaaaedd01d1.info {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:56 devstack sudo[105829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-7d7a1e96-3874-4be8-838a-11b92a2a5913.ff10a9c4-9208-4ab8-a456-10b460e77006 Jul 22 03:34:56 devstack sudo[105829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:56 devstack sudo[105830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0dd02463-e194-4d32-8a1b-cdaaaedd01d1.info Jul 22 03:34:56 devstack sudo[105830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:56 devstack sudo[105830]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:56 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-620845c1-6d2e-480d-8a78-49aa73bba8c6 tempest-SnapshotDependencyTests-1942573504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0dd02463-e194-4d32-8a1b-cdaaaedd01d1.info" returned: 0 in 0.271s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:56 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-620845c1-6d2e-480d-8a78-49aa73bba8c6 tempest-SnapshotDependencyTests-1942573504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.297s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:34:56 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-c662c839-7ec1-4607-abe1-873d363317c0 tempest-ProjectReaderTests-483930896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.474s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:34:56 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-c662c839-7ec1-4607-abe1-873d363317c0 tempest-ProjectReaderTests-483930896 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:34:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2103109915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=086b2378-d086-4864-9fbf-b19ba83c4659,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd45f1aa7e184c4599e74792f6f4b497',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:34:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:34:55Z,use_quota=True,user_id='222bb0de5f274a1db76ea74beb58d4b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:34:56 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-c662c839-7ec1-4607-abe1-873d363317c0 tempest-ProjectReaderTests-483930896 None] Creating volume 086b2378-d086-4864-9fbf-b19ba83c4659 {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:34:56 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-c662c839-7ec1-4607-abe1-873d363317c0 tempest-ProjectReaderTests-483930896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:34:56 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-c662c839-7ec1-4607-abe1-873d363317c0 tempest-ProjectReaderTests-483930896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:34:56 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-c662c839-7ec1-4607-abe1-873d363317c0 tempest-ProjectReaderTests-483930896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:34:56 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-c662c839-7ec1-4607-abe1-873d363317c0 tempest-ProjectReaderTests-483930896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:34:56 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-c662c839-7ec1-4607-abe1-873d363317c0 tempest-ProjectReaderTests-483930896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:34:56 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-c662c839-7ec1-4607-abe1-873d363317c0 tempest-ProjectReaderTests-483930896 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:34:56 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-c662c839-7ec1-4607-abe1-873d363317c0 tempest-ProjectReaderTests-483930896 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:34:56 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-c662c839-7ec1-4607-abe1-873d363317c0 tempest-ProjectReaderTests-483930896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-086b2378-d086-4864-9fbf-b19ba83c4659 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:56 devstack sudo[105838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-086b2378-d086-4864-9fbf-b19ba83c4659 1073741824 Jul 22 03:34:56 devstack sudo[105838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:56 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-620845c1-6d2e-480d-8a78-49aa73bba8c6 tempest-SnapshotDependencyTests-1942573504 None] Create snapshot completed successfully Jul 22 03:34:56 devstack sudo[105829]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:56 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f6894f30-7e28-4728-bbe7-c847ab95815f tempest-ProjectMemberTests-64253088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-7d7a1e96-3874-4be8-838a-11b92a2a5913.ff10a9c4-9208-4ab8-a456-10b460e77006" returned: 0 in 0.405s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:56 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f6894f30-7e28-4728-bbe7-c847ab95815f tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-7d7a1e96-3874-4be8-838a-11b92a2a5913.ff10a9c4-9208-4ab8-a456-10b460e77006 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:56 devstack sudo[105840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-7d7a1e96-3874-4be8-838a-11b92a2a5913.ff10a9c4-9208-4ab8-a456-10b460e77006 Jul 22 03:34:56 devstack sudo[105840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:57 devstack sudo[105840]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:57 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f6894f30-7e28-4728-bbe7-c847ab95815f tempest-ProjectMemberTests-64253088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-7d7a1e96-3874-4be8-838a-11b92a2a5913.ff10a9c4-9208-4ab8-a456-10b460e77006" returned: 0 in 0.305s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:57 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-f6894f30-7e28-4728-bbe7-c847ab95815f tempest-ProjectMemberTests-64253088 None] Lock "cinder-quobyte-ff10a9c4-9208-4ab8-a456-10b460e77006" released by "_delete_snapshot" :: held 1.705s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:34:57 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-f6894f30-7e28-4728-bbe7-c847ab95815f tempest-ProjectMemberTests-64253088 None] Lock "cinder-quobyte-7d7a1e96-3874-4be8-838a-11b92a2a5913" released by "delete_snapshot" :: held 1.735s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:34:57 devstack sudo[105838]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:57 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-c662c839-7ec1-4607-abe1-873d363317c0 tempest-ProjectReaderTests-483930896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-086b2378-d086-4864-9fbf-b19ba83c4659 1073741824" returned: 0 in 0.528s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:57 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-f6894f30-7e28-4728-bbe7-c847ab95815f tempest-ProjectMemberTests-64253088 None] Created reservations ['eb2274b8-4473-476c-bb8c-d7ab0d7fa553', 'aae67cd8-763e-4599-854a-bbbee4711cee', 'db0d0b59-1381-41a4-9894-f4cc60653428', '7a9a0a59-38e3-4c15-b24b-aef2a15d61c1'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:34:57 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-c662c839-7ec1-4607-abe1-873d363317c0 tempest-ProjectReaderTests-483930896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-086b2378-d086-4864-9fbf-b19ba83c4659 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:57 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-f6894f30-7e28-4728-bbe7-c847ab95815f tempest-ProjectMemberTests-64253088 None] Delete snapshot completed successfully. Jul 22 03:34:57 devstack sudo[105847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-086b2378-d086-4864-9fbf-b19ba83c4659 Jul 22 03:34:57 devstack sudo[105847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:57 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-f6894f30-7e28-4728-bbe7-c847ab95815f tempest-ProjectMemberTests-64253088 None] Lock "cinder-ff10a9c4-9208-4ab8-a456-10b460e77006-delete_snapshot" released by "delete_snapshot" :: held 1.945s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:34:57 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-12e767cc-e99b-40ca-a1e0-dcea957ad17b tempest-ProjectMemberTests-64253088 None] Acquiring lock "cinder-7d7a1e96-3874-4be8-838a-11b92a2a5913-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:34:57 devstack sudo[105847]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:57 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-c662c839-7ec1-4607-abe1-873d363317c0 tempest-ProjectReaderTests-483930896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-086b2378-d086-4864-9fbf-b19ba83c4659" returned: 0 in 0.322s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:57 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-c662c839-7ec1-4607-abe1-873d363317c0 tempest-ProjectReaderTests-483930896 None] <== create_volume: return (905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:34:57 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-c662c839-7ec1-4607-abe1-873d363317c0 tempest-ProjectReaderTests-483930896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:34:57 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-12e767cc-e99b-40ca-a1e0-dcea957ad17b tempest-ProjectMemberTests-64253088 None] Lock "cinder-7d7a1e96-3874-4be8-838a-11b92a2a5913-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:34:57 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-c662c839-7ec1-4607-abe1-873d363317c0 tempest-ProjectReaderTests-483930896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30735c9b-3faf-4f94-9c95-3c6235beb1bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-086b2378-d086-4864-9fbf-b19ba83c4659', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:34:57 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-c662c839-7ec1-4607-abe1-873d363317c0 tempest-ProjectReaderTests-483930896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5afc1f5f-7ac0-4480-aae4-8bff20c97ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:34:57 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-c662c839-7ec1-4607-abe1-873d363317c0 tempest-ProjectReaderTests-483930896 None] Volume volume-086b2378-d086-4864-9fbf-b19ba83c4659 (086b2378-d086-4864-9fbf-b19ba83c4659): created successfully Jul 22 03:34:57 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-c662c839-7ec1-4607-abe1-873d363317c0 tempest-ProjectReaderTests-483930896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5afc1f5f-7ac0-4480-aae4-8bff20c97ab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:34:57 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-c662c839-7ec1-4607-abe1-873d363317c0 tempest-ProjectReaderTests-483930896 None] Flow 'volume_create_manager' (a84ca175-bb53-45ce-874a-28ae8b7fae31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:34:57 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-c662c839-7ec1-4607-abe1-873d363317c0 tempest-ProjectReaderTests-483930896 None] Created volume successfully. Jul 22 03:34:57 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-12e767cc-e99b-40ca-a1e0-dcea957ad17b tempest-ProjectMemberTests-64253088 None] Acquiring lock "cinder-quobyte-7d7a1e96-3874-4be8-838a-11b92a2a5913" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:34:57 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-12e767cc-e99b-40ca-a1e0-dcea957ad17b tempest-ProjectMemberTests-64253088 None] Lock "cinder-quobyte-7d7a1e96-3874-4be8-838a-11b92a2a5913" acquired by "delete_volume" :: waited 0.033s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:34:57 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5d4802e-2024-4f7a-ad11-212486bffc49]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:34:57 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-12e767cc-e99b-40ca-a1e0-dcea957ad17b tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-7d7a1e96-3874-4be8-838a-11b92a2a5913 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:57 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-340dc5a3-1cca-40be-a11a-7ac70903cb47 tempest-SnapshotDependencyTests-1942573504 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:34:58 devstack sudo[105851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-7d7a1e96-3874-4be8-838a-11b92a2a5913 Jul 22 03:34:58 devstack sudo[105851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:58 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-340dc5a3-1cca-40be-a11a-7ac70903cb47 tempest-SnapshotDependencyTests-1942573504 None] Flow 'volume_create_manager' (5d51ae3b-f089-4a20-a4de-964b9ae8415c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:34:58 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-340dc5a3-1cca-40be-a11a-7ac70903cb47 tempest-SnapshotDependencyTests-1942573504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ac34c56-ad31-4c0a-9770-38b5b6e9e9b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:34:58 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-340dc5a3-1cca-40be-a11a-7ac70903cb47 tempest-SnapshotDependencyTests-1942573504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ac34c56-ad31-4c0a-9770-38b5b6e9e9b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:34:58Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fd2280b-4f0f-41d4-8f7b-a49f5faca7fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fb34e8b09974906bafc5d1ce97e5c78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:34:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=354a5fdf-737a-439b-9535-09d3852970b0,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:34:58Z,use_quota=True,user_id='452741dd22a14b74ba7626c593145253',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:34:58 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-340dc5a3-1cca-40be-a11a-7ac70903cb47 tempest-SnapshotDependencyTests-1942573504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e8b95b1-0a70-40b9-84b2-12587ce0eb12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:34:58 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-340dc5a3-1cca-40be-a11a-7ac70903cb47 tempest-SnapshotDependencyTests-1942573504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e8b95b1-0a70-40b9-84b2-12587ce0eb12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:34:58 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-340dc5a3-1cca-40be-a11a-7ac70903cb47 tempest-SnapshotDependencyTests-1942573504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b137eb31-1fa5-4357-9f15-c1821a654fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:34:58 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-340dc5a3-1cca-40be-a11a-7ac70903cb47 tempest-SnapshotDependencyTests-1942573504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b137eb31-1fa5-4357-9f15-c1821a654fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2fd2280b-4f0f-41d4-8f7b-a49f5faca7fc', 'volume_name': 'volume-2fd2280b-4f0f-41d4-8f7b-a49f5faca7fc', 'volume_size': 1, 'snapshot_id': '354a5fdf-737a-439b-9535-09d3852970b0'}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:34:58 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-340dc5a3-1cca-40be-a11a-7ac70903cb47 tempest-SnapshotDependencyTests-1942573504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9c2391b-70cd-4d84-b11b-28540c4731e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:34:58 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-340dc5a3-1cca-40be-a11a-7ac70903cb47 tempest-SnapshotDependencyTests-1942573504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9c2391b-70cd-4d84-b11b-28540c4731e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:34:58 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-340dc5a3-1cca-40be-a11a-7ac70903cb47 tempest-SnapshotDependencyTests-1942573504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d6a7bc7-a30e-491d-9474-1852910ef1a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:34:58 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-340dc5a3-1cca-40be-a11a-7ac70903cb47 tempest-SnapshotDependencyTests-1942573504 None] Volume 2fd2280b-4f0f-41d4-8f7b-a49f5faca7fc: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2fd2280b-4f0f-41d4-8f7b-a49f5faca7fc', 'volume_size': 1, 'snapshot_id': '354a5fdf-737a-439b-9535-09d3852970b0'} Jul 22 03:34:58 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-340dc5a3-1cca-40be-a11a-7ac70903cb47 tempest-SnapshotDependencyTests-1942573504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:34:58 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-340dc5a3-1cca-40be-a11a-7ac70903cb47 tempest-SnapshotDependencyTests-1942573504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:34:58 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-340dc5a3-1cca-40be-a11a-7ac70903cb47 tempest-SnapshotDependencyTests-1942573504 None] Acquiring lock "cinder-quobyte-354a5fdf-737a-439b-9535-09d3852970b0-2fd2280b-4f0f-41d4-8f7b-a49f5faca7fc" by "_create_volume_from_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:34:58 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-340dc5a3-1cca-40be-a11a-7ac70903cb47 tempest-SnapshotDependencyTests-1942573504 None] Lock "cinder-quobyte-354a5fdf-737a-439b-9535-09d3852970b0-2fd2280b-4f0f-41d4-8f7b-a49f5faca7fc" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:34:58 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-340dc5a3-1cca-40be-a11a-7ac70903cb47 tempest-SnapshotDependencyTests-1942573504 None] Creating volume 2fd2280b-4f0f-41d4-8f7b-a49f5faca7fc from snapshot 354a5fdf-737a-439b-9535-09d3852970b0 {{(pid=87747) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 22 03:34:58 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-340dc5a3-1cca-40be-a11a-7ac70903cb47 tempest-SnapshotDependencyTests-1942573504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:34:58 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-340dc5a3-1cca-40be-a11a-7ac70903cb47 tempest-SnapshotDependencyTests-1942573504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:34:58 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-340dc5a3-1cca-40be-a11a-7ac70903cb47 tempest-SnapshotDependencyTests-1942573504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:34:58 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-340dc5a3-1cca-40be-a11a-7ac70903cb47 tempest-SnapshotDependencyTests-1942573504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:34:58 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-340dc5a3-1cca-40be-a11a-7ac70903cb47 tempest-SnapshotDependencyTests-1942573504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:34:58 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-340dc5a3-1cca-40be-a11a-7ac70903cb47 tempest-SnapshotDependencyTests-1942573504 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:34:58 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-340dc5a3-1cca-40be-a11a-7ac70903cb47 tempest-SnapshotDependencyTests-1942573504 None] Acquiring lock "cinder-quobyte-2fd2280b-4f0f-41d4-8f7b-a49f5faca7fc" by "_copy_volume_from_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:34:58 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-340dc5a3-1cca-40be-a11a-7ac70903cb47 tempest-SnapshotDependencyTests-1942573504 None] Lock "cinder-quobyte-2fd2280b-4f0f-41d4-8f7b-a49f5faca7fc" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:34:58 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-340dc5a3-1cca-40be-a11a-7ac70903cb47 tempest-SnapshotDependencyTests-1942573504 None] snapshot: 354a5fdf-737a-439b-9535-09d3852970b0, volume: 2fd2280b-4f0f-41d4-8f7b-a49f5faca7fc, {{(pid=87747) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 22 03:34:58 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-340dc5a3-1cca-40be-a11a-7ac70903cb47 tempest-SnapshotDependencyTests-1942573504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:34:58 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-340dc5a3-1cca-40be-a11a-7ac70903cb47 tempest-SnapshotDependencyTests-1942573504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:34:58 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-340dc5a3-1cca-40be-a11a-7ac70903cb47 tempest-SnapshotDependencyTests-1942573504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:34:58 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-340dc5a3-1cca-40be-a11a-7ac70903cb47 tempest-SnapshotDependencyTests-1942573504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:34:58 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-340dc5a3-1cca-40be-a11a-7ac70903cb47 tempest-SnapshotDependencyTests-1942573504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:34:58 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[d82237e5-daab-4a57-9f27-6a2310ece8f0]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:34:58 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-340dc5a3-1cca-40be-a11a-7ac70903cb47 tempest-SnapshotDependencyTests-1942573504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0dd02463-e194-4d32-8a1b-cdaaaedd01d1.354a5fdf-737a-439b-9535-09d3852970b0 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:58 devstack sudo[105851]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:58 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-12e767cc-e99b-40ca-a1e0-dcea957ad17b tempest-ProjectMemberTests-64253088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-7d7a1e96-3874-4be8-838a-11b92a2a5913" returned: 0 in 0.410s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:58 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-12e767cc-e99b-40ca-a1e0-dcea957ad17b tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-7d7a1e96-3874-4be8-838a-11b92a2a5913 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:58 devstack sudo[105853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0dd02463-e194-4d32-8a1b-cdaaaedd01d1.354a5fdf-737a-439b-9535-09d3852970b0 Jul 22 03:34:58 devstack sudo[105853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:58 devstack sudo[105857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-7d7a1e96-3874-4be8-838a-11b92a2a5913 Jul 22 03:34:58 devstack sudo[105857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:58 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-6028dac9-b630-4b6d-b67c-691484ac400a tempest-ProjectReaderTests-483930896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:34:58 devstack sudo[105853]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:58 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-340dc5a3-1cca-40be-a11a-7ac70903cb47 tempest-SnapshotDependencyTests-1942573504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0dd02463-e194-4d32-8a1b-cdaaaedd01d1.354a5fdf-737a-439b-9535-09d3852970b0" returned: 0 in 0.438s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:58 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-340dc5a3-1cca-40be-a11a-7ac70903cb47 tempest-SnapshotDependencyTests-1942573504 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0dd02463-e194-4d32-8a1b-cdaaaedd01d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87747) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 03:34:58 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-340dc5a3-1cca-40be-a11a-7ac70903cb47 tempest-SnapshotDependencyTests-1942573504 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0dd02463-e194-4d32-8a1b-cdaaaedd01d1 {{(pid=87747) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 22 03:34:58 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-340dc5a3-1cca-40be-a11a-7ac70903cb47 tempest-SnapshotDependencyTests-1942573504 None] Creating direct copy from snapshot {{(pid=87747) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 22 03:34:58 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[17325794-5958-49d0-9d3e-cb33d2b643be]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:34:58 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-340dc5a3-1cca-40be-a11a-7ac70903cb47 tempest-SnapshotDependencyTests-1942573504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0dd02463-e194-4d32-8a1b-cdaaaedd01d1 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:58 devstack sudo[105857]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:58 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-12e767cc-e99b-40ca-a1e0-dcea957ad17b tempest-ProjectMemberTests-64253088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-7d7a1e96-3874-4be8-838a-11b92a2a5913" returned: 0 in 0.383s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:58 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-12e767cc-e99b-40ca-a1e0-dcea957ad17b tempest-ProjectMemberTests-64253088 None] Lock "cinder-quobyte-7d7a1e96-3874-4be8-838a-11b92a2a5913" released by "delete_volume" :: held 0.892s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:34:58 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-12e767cc-e99b-40ca-a1e0-dcea957ad17b tempest-ProjectMemberTests-64253088 None] Created reservations ['cc5e0d8b-e864-4fee-aa5e-72518c0725e5', '6665da9c-62b2-4f55-9ef4-d264ea86f6db', '2b62987e-524f-4278-a81a-8556edf5635a', '17574f7d-e01c-4c3b-b32c-d1cfc74c0947'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:34:58 devstack sudo[105864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0dd02463-e194-4d32-8a1b-cdaaaedd01d1 Jul 22 03:34:58 devstack sudo[105864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:58 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f986164-75a6-4f4f-8906-ef9bf8cda20d tempest-ProjectReaderTests-1662189440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:34:58 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-6f986164-75a6-4f4f-8906-ef9bf8cda20d tempest-ProjectReaderTests-1662189440 None] Flow 'volume_create_manager' (a08da1bf-4c85-43ad-bf4c-5f66720156df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:34:58 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-6f986164-75a6-4f4f-8906-ef9bf8cda20d tempest-ProjectReaderTests-1662189440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e806dce-9823-4962-b196-536e9b89b9c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:34:58 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-12e767cc-e99b-40ca-a1e0-dcea957ad17b tempest-ProjectMemberTests-64253088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:34:58 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-12e767cc-e99b-40ca-a1e0-dcea957ad17b tempest-ProjectMemberTests-64253088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:34:58 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-12e767cc-e99b-40ca-a1e0-dcea957ad17b tempest-ProjectMemberTests-64253088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:34:58 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-12e767cc-e99b-40ca-a1e0-dcea957ad17b tempest-ProjectMemberTests-64253088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:34:58 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-12e767cc-e99b-40ca-a1e0-dcea957ad17b tempest-ProjectMemberTests-64253088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:34:58 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-12e767cc-e99b-40ca-a1e0-dcea957ad17b tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:58 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-6f986164-75a6-4f4f-8906-ef9bf8cda20d tempest-ProjectReaderTests-1662189440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e806dce-9823-4962-b196-536e9b89b9c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:34:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-193575752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ae66333-01ca-4ad7-bebf-587b27c32a5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ca5909155df44ec8406d9012aa8352a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:34:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:34:59Z,use_quota=True,user_id='a784f076d7d44105ab3bafdbc8e09c8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:34:58 devstack sudo[105866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:34:58 devstack sudo[105866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:58 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-6f986164-75a6-4f4f-8906-ef9bf8cda20d tempest-ProjectReaderTests-1662189440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59f30080-fe05-40fc-b5a8-0371b96e7a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:34:58 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-6f986164-75a6-4f4f-8906-ef9bf8cda20d tempest-ProjectReaderTests-1662189440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59f30080-fe05-40fc-b5a8-0371b96e7a85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:34:58 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-6f986164-75a6-4f4f-8906-ef9bf8cda20d tempest-ProjectReaderTests-1662189440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1b17ad8-9543-4fd4-85b4-84c592e6db49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:34:58 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-6f986164-75a6-4f4f-8906-ef9bf8cda20d tempest-ProjectReaderTests-1662189440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1b17ad8-9543-4fd4-85b4-84c592e6db49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ae66333-01ca-4ad7-bebf-587b27c32a5b', 'volume_name': 'volume-3ae66333-01ca-4ad7-bebf-587b27c32a5b', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:34:58 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-6f986164-75a6-4f4f-8906-ef9bf8cda20d tempest-ProjectReaderTests-1662189440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7220e69f-b8dc-494a-be37-3f2fc7c1da9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:34:58 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-6f986164-75a6-4f4f-8906-ef9bf8cda20d tempest-ProjectReaderTests-1662189440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7220e69f-b8dc-494a-be37-3f2fc7c1da9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:34:58 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-6f986164-75a6-4f4f-8906-ef9bf8cda20d tempest-ProjectReaderTests-1662189440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ab71480-21c1-41ee-bea3-202ef8db4e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:34:58 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-6f986164-75a6-4f4f-8906-ef9bf8cda20d tempest-ProjectReaderTests-1662189440 None] Volume 3ae66333-01ca-4ad7-bebf-587b27c32a5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ae66333-01ca-4ad7-bebf-587b27c32a5b', 'volume_size': 1} Jul 22 03:34:58 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-6f986164-75a6-4f4f-8906-ef9bf8cda20d tempest-ProjectReaderTests-1662189440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:34:59 devstack sudo[105864]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:59 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-340dc5a3-1cca-40be-a11a-7ac70903cb47 tempest-SnapshotDependencyTests-1942573504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0dd02463-e194-4d32-8a1b-cdaaaedd01d1" returned: 0 in 0.387s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:59 devstack cinder-volume[87747]: DEBUG cinder.utils [None req-340dc5a3-1cca-40be-a11a-7ac70903cb47 tempest-SnapshotDependencyTests-1942573504 None] Path /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2fd2280b-4f0f-41d4-8f7b-a49f5faca7fc not found in is_blk_device check {{(pid=87747) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 22 03:34:59 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-340dc5a3-1cca-40be-a11a-7ac70903cb47 tempest-SnapshotDependencyTests-1942573504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0dd02463-e194-4d32-8a1b-cdaaaedd01d1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2fd2280b-4f0f-41d4-8f7b-a49f5faca7fc {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:34:59 devstack sudo[105873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0dd02463-e194-4d32-8a1b-cdaaaedd01d1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2fd2280b-4f0f-41d4-8f7b-a49f5faca7fc Jul 22 03:34:59 devstack sudo[105873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:34:59 devstack sudo[105866]: pam_unix(sudo:session): session closed for user root Jul 22 03:34:59 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-12e767cc-e99b-40ca-a1e0-dcea957ad17b tempest-ProjectMemberTests-64253088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.248s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:34:59 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-12e767cc-e99b-40ca-a1e0-dcea957ad17b tempest-ProjectMemberTests-64253088 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:34:59 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-12e767cc-e99b-40ca-a1e0-dcea957ad17b tempest-ProjectMemberTests-64253088 None] Deleted volume successfully. Jul 22 03:34:59 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-12e767cc-e99b-40ca-a1e0-dcea957ad17b tempest-ProjectMemberTests-64253088 None] Lock "cinder-7d7a1e96-3874-4be8-838a-11b92a2a5913-delete_volume" released by "delete_volume" :: held 1.489s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:35:01 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-2eb74db4-c926-4259-b53c-d236ee062207 tempest-ProjectMemberTests-64253088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:35:01 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2eb74db4-c926-4259-b53c-d236ee062207 tempest-ProjectMemberTests-64253088 None] Flow 'volume_create_manager' (9ea8223f-7847-4fd8-8446-9a276c0f0143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:35:01 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2eb74db4-c926-4259-b53c-d236ee062207 tempest-ProjectMemberTests-64253088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fc360c6-79fe-42f9-bdcd-2b4820104c4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:35:01 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2eb74db4-c926-4259-b53c-d236ee062207 tempest-ProjectMemberTests-64253088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fc360c6-79fe-42f9-bdcd-2b4820104c4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:35:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-456941009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02bdf016-6166-424e-bd87-8e04e3349ee0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05eb3b4eac3e4ffe97247852227f9ffa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:35:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:35:01Z,use_quota=True,user_id='ecf77e3a2be443e28cffe6ba02afc5e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:35:01 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2eb74db4-c926-4259-b53c-d236ee062207 tempest-ProjectMemberTests-64253088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c32c488-db5f-44bd-a540-55faee0ef3a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:35:01 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2eb74db4-c926-4259-b53c-d236ee062207 tempest-ProjectMemberTests-64253088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c32c488-db5f-44bd-a540-55faee0ef3a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:35:01 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2eb74db4-c926-4259-b53c-d236ee062207 tempest-ProjectMemberTests-64253088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (240a12fc-882b-4673-8af9-d3ed60ab9783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:35:01 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2eb74db4-c926-4259-b53c-d236ee062207 tempest-ProjectMemberTests-64253088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (240a12fc-882b-4673-8af9-d3ed60ab9783) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02bdf016-6166-424e-bd87-8e04e3349ee0', 'volume_name': 'volume-02bdf016-6166-424e-bd87-8e04e3349ee0', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:35:01 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2eb74db4-c926-4259-b53c-d236ee062207 tempest-ProjectMemberTests-64253088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e7dbc08-2869-4e0c-9466-1e485b9cd98e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:35:01 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2eb74db4-c926-4259-b53c-d236ee062207 tempest-ProjectMemberTests-64253088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e7dbc08-2869-4e0c-9466-1e485b9cd98e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:35:01 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2eb74db4-c926-4259-b53c-d236ee062207 tempest-ProjectMemberTests-64253088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc5f8566-7969-4c4a-b702-526ce021f2a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:35:01 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-2eb74db4-c926-4259-b53c-d236ee062207 tempest-ProjectMemberTests-64253088 None] Volume 02bdf016-6166-424e-bd87-8e04e3349ee0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02bdf016-6166-424e-bd87-8e04e3349ee0', 'volume_size': 1} Jul 22 03:35:01 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-2eb74db4-c926-4259-b53c-d236ee062207 tempest-ProjectMemberTests-64253088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:35:03 devstack sudo[105873]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:03 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-340dc5a3-1cca-40be-a11a-7ac70903cb47 tempest-SnapshotDependencyTests-1942573504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0dd02463-e194-4d32-8a1b-cdaaaedd01d1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2fd2280b-4f0f-41d4-8f7b-a49f5faca7fc" returned: 0 in 4.386s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:03 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5697ad1-5caa-4faa-ba8b-71294c439eb4]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:35:03 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-340dc5a3-1cca-40be-a11a-7ac70903cb47 tempest-SnapshotDependencyTests-1942573504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0dd02463-e194-4d32-8a1b-cdaaaedd01d1 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:03 devstack sudo[105891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0dd02463-e194-4d32-8a1b-cdaaaedd01d1 Jul 22 03:35:03 devstack sudo[105891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:03 devstack sudo[105891]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:03 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-340dc5a3-1cca-40be-a11a-7ac70903cb47 tempest-SnapshotDependencyTests-1942573504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0dd02463-e194-4d32-8a1b-cdaaaedd01d1" returned: 0 in 0.524s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:03 devstack cinder-volume[87747]: DEBUG cinder.image.image_utils [None req-340dc5a3-1cca-40be-a11a-7ac70903cb47 tempest-SnapshotDependencyTests-1942573504 None] Image conversion details: src /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0dd02463-e194-4d32-8a1b-cdaaaedd01d1, size 1024.00 MB, duration 4.39 sec, destination /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2fd2280b-4f0f-41d4-8f7b-a49f5faca7fc {{(pid=87747) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 22 03:35:03 devstack cinder-volume[87747]: INFO cinder.image.image_utils [None req-340dc5a3-1cca-40be-a11a-7ac70903cb47 tempest-SnapshotDependencyTests-1942573504 None] Converted 1024.00 MB image at 233.40 MB/s Jul 22 03:35:03 devstack cinder-volume[87747]: WARNING cinder.volume.drivers.remotefs [None req-340dc5a3-1cca-40be-a11a-7ac70903cb47 tempest-SnapshotDependencyTests-1942573504 None] /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2fd2280b-4f0f-41d4-8f7b-a49f5faca7fc is being set with open permissions: ugo+rw Jul 22 03:35:03 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-340dc5a3-1cca-40be-a11a-7ac70903cb47 tempest-SnapshotDependencyTests-1942573504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2fd2280b-4f0f-41d4-8f7b-a49f5faca7fc {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:03 devstack sudo[105896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2fd2280b-4f0f-41d4-8f7b-a49f5faca7fc Jul 22 03:35:03 devstack sudo[105896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:04 devstack sudo[105896]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:04 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-340dc5a3-1cca-40be-a11a-7ac70903cb47 tempest-SnapshotDependencyTests-1942573504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2fd2280b-4f0f-41d4-8f7b-a49f5faca7fc" returned: 0 in 0.243s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:04 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-340dc5a3-1cca-40be-a11a-7ac70903cb47 tempest-SnapshotDependencyTests-1942573504 None] Lock "cinder-quobyte-2fd2280b-4f0f-41d4-8f7b-a49f5faca7fc" released by "_copy_volume_from_snapshot" :: held 6.080s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:35:04 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-340dc5a3-1cca-40be-a11a-7ac70903cb47 tempest-SnapshotDependencyTests-1942573504 None] Lock "cinder-quobyte-354a5fdf-737a-439b-9535-09d3852970b0-2fd2280b-4f0f-41d4-8f7b-a49f5faca7fc" released by "_create_volume_from_snapshot" :: held 6.112s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:35:04 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-340dc5a3-1cca-40be-a11a-7ac70903cb47 tempest-SnapshotDependencyTests-1942573504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.129s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:35:04 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-6028dac9-b630-4b6d-b67c-691484ac400a tempest-ProjectReaderTests-483930896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.610s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:35:04 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-6028dac9-b630-4b6d-b67c-691484ac400a tempest-ProjectReaderTests-483930896 None] Creating offline snapshot 0285288b-99e6-4770-a0bd-8f3d726b6683 of volume 086b2378-d086-4864-9fbf-b19ba83c4659 {{(pid=87747) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 03:35:04 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1ac0ab9-90db-4c88-a150-f828c3272ca5]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:35:04 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-6028dac9-b630-4b6d-b67c-691484ac400a tempest-ProjectReaderTests-483930896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-086b2378-d086-4864-9fbf-b19ba83c4659 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:04 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-340dc5a3-1cca-40be-a11a-7ac70903cb47 tempest-SnapshotDependencyTests-1942573504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d6a7bc7-a30e-491d-9474-1852910ef1a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fd2280b-4f0f-41d4-8f7b-a49f5faca7fc', 'volume_size': 1, 'snapshot_id': '354a5fdf-737a-439b-9535-09d3852970b0'}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:35:04 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-340dc5a3-1cca-40be-a11a-7ac70903cb47 tempest-SnapshotDependencyTests-1942573504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d0dd11f-9ca5-4e3e-86cd-cf996ba4ab8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:35:04 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-340dc5a3-1cca-40be-a11a-7ac70903cb47 tempest-SnapshotDependencyTests-1942573504 None] Volume volume-2fd2280b-4f0f-41d4-8f7b-a49f5faca7fc (2fd2280b-4f0f-41d4-8f7b-a49f5faca7fc): created successfully Jul 22 03:35:04 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-340dc5a3-1cca-40be-a11a-7ac70903cb47 tempest-SnapshotDependencyTests-1942573504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d0dd11f-9ca5-4e3e-86cd-cf996ba4ab8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:35:04 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-340dc5a3-1cca-40be-a11a-7ac70903cb47 tempest-SnapshotDependencyTests-1942573504 None] Flow 'volume_create_manager' (5d51ae3b-f089-4a20-a4de-964b9ae8415c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:35:04 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-340dc5a3-1cca-40be-a11a-7ac70903cb47 tempest-SnapshotDependencyTests-1942573504 None] Created volume successfully. Jul 22 03:35:04 devstack sudo[105899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-086b2378-d086-4864-9fbf-b19ba83c4659 Jul 22 03:35:04 devstack sudo[105899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:04 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-e782536a-aa65-4f2b-9db2-906a08596066 tempest-SnapshotDependencyTests-1942573504 None] Acquiring lock "cinder-354a5fdf-737a-439b-9535-09d3852970b0-delete_snapshot" by "delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:35:04 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-e782536a-aa65-4f2b-9db2-906a08596066 tempest-SnapshotDependencyTests-1942573504 None] Lock "cinder-354a5fdf-737a-439b-9535-09d3852970b0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:35:04 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-e782536a-aa65-4f2b-9db2-906a08596066 tempest-SnapshotDependencyTests-1942573504 None] Acquiring lock "cinder-quobyte-0dd02463-e194-4d32-8a1b-cdaaaedd01d1" by "delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:35:04 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-e782536a-aa65-4f2b-9db2-906a08596066 tempest-SnapshotDependencyTests-1942573504 None] Lock "cinder-quobyte-0dd02463-e194-4d32-8a1b-cdaaaedd01d1" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:35:04 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-e782536a-aa65-4f2b-9db2-906a08596066 tempest-SnapshotDependencyTests-1942573504 None] Acquiring lock "cinder-quobyte-354a5fdf-737a-439b-9535-09d3852970b0" by "_delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:35:04 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-e782536a-aa65-4f2b-9db2-906a08596066 tempest-SnapshotDependencyTests-1942573504 None] Lock "cinder-quobyte-354a5fdf-737a-439b-9535-09d3852970b0" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:35:04 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-e782536a-aa65-4f2b-9db2-906a08596066 tempest-SnapshotDependencyTests-1942573504 None] Deleting offline snapshot 354a5fdf-737a-439b-9535-09d3852970b0 of volume 0dd02463-e194-4d32-8a1b-cdaaaedd01d1 {{(pid=87747) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 03:35:04 devstack sudo[105899]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:04 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-e782536a-aa65-4f2b-9db2-906a08596066 tempest-SnapshotDependencyTests-1942573504 None] snapshot_file for this snap is: volume-0dd02463-e194-4d32-8a1b-cdaaaedd01d1.354a5fdf-737a-439b-9535-09d3852970b0 {{(pid=87747) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 03:35:04 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-6028dac9-b630-4b6d-b67c-691484ac400a tempest-ProjectReaderTests-483930896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-086b2378-d086-4864-9fbf-b19ba83c4659" returned: 0 in 0.380s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:04 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-6028dac9-b630-4b6d-b67c-691484ac400a tempest-ProjectReaderTests-483930896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-086b2378-d086-4864-9fbf-b19ba83c4659,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-086b2378-d086-4864-9fbf-b19ba83c4659.0285288b-99e6-4770-a0bd-8f3d726b6683 1G {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:04 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[992cfe82-16f6-4114-a58f-35640cb5a264]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:35:04 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-e782536a-aa65-4f2b-9db2-906a08596066 tempest-SnapshotDependencyTests-1942573504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0dd02463-e194-4d32-8a1b-cdaaaedd01d1.354a5fdf-737a-439b-9535-09d3852970b0 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:04 devstack sudo[105904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-086b2378-d086-4864-9fbf-b19ba83c4659,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-086b2378-d086-4864-9fbf-b19ba83c4659.0285288b-99e6-4770-a0bd-8f3d726b6683 1G Jul 22 03:35:04 devstack sudo[105904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:04 devstack sudo[105905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0dd02463-e194-4d32-8a1b-cdaaaedd01d1.354a5fdf-737a-439b-9535-09d3852970b0 Jul 22 03:35:04 devstack sudo[105905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:05 devstack sudo[105905]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:05 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-e782536a-aa65-4f2b-9db2-906a08596066 tempest-SnapshotDependencyTests-1942573504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0dd02463-e194-4d32-8a1b-cdaaaedd01d1.354a5fdf-737a-439b-9535-09d3852970b0" returned: 0 in 0.368s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:05 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-e782536a-aa65-4f2b-9db2-906a08596066 tempest-SnapshotDependencyTests-1942573504 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0dd02463-e194-4d32-8a1b-cdaaaedd01d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87747) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 03:35:05 devstack sudo[105904]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:05 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-6028dac9-b630-4b6d-b67c-691484ac400a tempest-ProjectReaderTests-483930896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-086b2378-d086-4864-9fbf-b19ba83c4659,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-086b2378-d086-4864-9fbf-b19ba83c4659.0285288b-99e6-4770-a0bd-8f3d726b6683 1G" returned: 0 in 0.408s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:05 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-6028dac9-b630-4b6d-b67c-691484ac400a tempest-ProjectReaderTests-483930896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-086b2378-d086-4864-9fbf-b19ba83c4659 -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-086b2378-d086-4864-9fbf-b19ba83c4659.0285288b-99e6-4770-a0bd-8f3d726b6683 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:05 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[00e640fd-c867-471a-9017-311b3ae7dda2]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:35:05 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-e782536a-aa65-4f2b-9db2-906a08596066 tempest-SnapshotDependencyTests-1942573504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0dd02463-e194-4d32-8a1b-cdaaaedd01d1 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:05 devstack sudo[105915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-086b2378-d086-4864-9fbf-b19ba83c4659 -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-086b2378-d086-4864-9fbf-b19ba83c4659.0285288b-99e6-4770-a0bd-8f3d726b6683 Jul 22 03:35:05 devstack sudo[105915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:05 devstack sudo[105916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0dd02463-e194-4d32-8a1b-cdaaaedd01d1 Jul 22 03:35:05 devstack sudo[105916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:05 devstack sudo[105915]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:05 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-6028dac9-b630-4b6d-b67c-691484ac400a tempest-ProjectReaderTests-483930896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-086b2378-d086-4864-9fbf-b19ba83c4659 -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-086b2378-d086-4864-9fbf-b19ba83c4659.0285288b-99e6-4770-a0bd-8f3d726b6683" returned: 0 in 0.307s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:05 devstack cinder-volume[87747]: WARNING cinder.volume.drivers.remotefs [None req-6028dac9-b630-4b6d-b67c-691484ac400a tempest-ProjectReaderTests-483930896 None] /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-086b2378-d086-4864-9fbf-b19ba83c4659.0285288b-99e6-4770-a0bd-8f3d726b6683 is being set with open permissions: ugo+rw Jul 22 03:35:05 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-6028dac9-b630-4b6d-b67c-691484ac400a tempest-ProjectReaderTests-483930896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-086b2378-d086-4864-9fbf-b19ba83c4659.0285288b-99e6-4770-a0bd-8f3d726b6683 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:05 devstack sudo[105922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-086b2378-d086-4864-9fbf-b19ba83c4659.0285288b-99e6-4770-a0bd-8f3d726b6683 Jul 22 03:35:05 devstack sudo[105922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:05 devstack sudo[105916]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:05 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-e782536a-aa65-4f2b-9db2-906a08596066 tempest-SnapshotDependencyTests-1942573504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0dd02463-e194-4d32-8a1b-cdaaaedd01d1" returned: 0 in 0.385s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:05 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-e782536a-aa65-4f2b-9db2-906a08596066 tempest-SnapshotDependencyTests-1942573504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0dd02463-e194-4d32-8a1b-cdaaaedd01d1.354a5fdf-737a-439b-9535-09d3852970b0 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:05 devstack sudo[105927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0dd02463-e194-4d32-8a1b-cdaaaedd01d1.354a5fdf-737a-439b-9535-09d3852970b0 Jul 22 03:35:05 devstack sudo[105927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:05 devstack sudo[105922]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:05 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-6028dac9-b630-4b6d-b67c-691484ac400a tempest-ProjectReaderTests-483930896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-086b2378-d086-4864-9fbf-b19ba83c4659.0285288b-99e6-4770-a0bd-8f3d726b6683" returned: 0 in 0.242s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:05 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-6028dac9-b630-4b6d-b67c-691484ac400a tempest-ProjectReaderTests-483930896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-086b2378-d086-4864-9fbf-b19ba83c4659.info {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:05 devstack sudo[105930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-086b2378-d086-4864-9fbf-b19ba83c4659.info Jul 22 03:35:05 devstack sudo[105930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:05 devstack sudo[105927]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:05 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-e782536a-aa65-4f2b-9db2-906a08596066 tempest-SnapshotDependencyTests-1942573504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0dd02463-e194-4d32-8a1b-cdaaaedd01d1.354a5fdf-737a-439b-9535-09d3852970b0" returned: 0 in 0.318s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:05 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-e782536a-aa65-4f2b-9db2-906a08596066 tempest-SnapshotDependencyTests-1942573504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0dd02463-e194-4d32-8a1b-cdaaaedd01d1.354a5fdf-737a-439b-9535-09d3852970b0 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:05 devstack sudo[105935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0dd02463-e194-4d32-8a1b-cdaaaedd01d1.354a5fdf-737a-439b-9535-09d3852970b0 Jul 22 03:35:05 devstack sudo[105935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:05 devstack sudo[105930]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:05 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-6028dac9-b630-4b6d-b67c-691484ac400a tempest-ProjectReaderTests-483930896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-086b2378-d086-4864-9fbf-b19ba83c4659.info" returned: 0 in 0.264s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:05 devstack cinder-volume[87747]: WARNING cinder.volume.drivers.remotefs [None req-6028dac9-b630-4b6d-b67c-691484ac400a tempest-ProjectReaderTests-483930896 None] /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-086b2378-d086-4864-9fbf-b19ba83c4659.info is being set with open permissions: ugo+rw Jul 22 03:35:05 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-6028dac9-b630-4b6d-b67c-691484ac400a tempest-ProjectReaderTests-483930896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-086b2378-d086-4864-9fbf-b19ba83c4659.info {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:05 devstack sudo[105938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-086b2378-d086-4864-9fbf-b19ba83c4659.info Jul 22 03:35:05 devstack sudo[105938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:06 devstack sudo[105935]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:06 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-e782536a-aa65-4f2b-9db2-906a08596066 tempest-SnapshotDependencyTests-1942573504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0dd02463-e194-4d32-8a1b-cdaaaedd01d1.354a5fdf-737a-439b-9535-09d3852970b0" returned: 0 in 0.251s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:06 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-e782536a-aa65-4f2b-9db2-906a08596066 tempest-SnapshotDependencyTests-1942573504 None] Lock "cinder-quobyte-354a5fdf-737a-439b-9535-09d3852970b0" released by "_delete_snapshot" :: held 1.440s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:35:06 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-e782536a-aa65-4f2b-9db2-906a08596066 tempest-SnapshotDependencyTests-1942573504 None] Lock "cinder-quobyte-0dd02463-e194-4d32-8a1b-cdaaaedd01d1" released by "delete_snapshot" :: held 1.468s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:35:06 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-e782536a-aa65-4f2b-9db2-906a08596066 tempest-SnapshotDependencyTests-1942573504 None] Created reservations ['ba7d07dd-7cf6-41ba-8dd5-801c04078616', 'a9e5825e-43f5-4155-a97e-6a47e1d24734', 'b1b86ba3-d3c6-45b6-b733-8e03401e1111', '4691c761-8dff-4f60-93eb-30737f2664f6'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:35:06 devstack sudo[105938]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:06 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-6028dac9-b630-4b6d-b67c-691484ac400a tempest-ProjectReaderTests-483930896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-086b2378-d086-4864-9fbf-b19ba83c4659.info" returned: 0 in 0.256s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:06 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-6028dac9-b630-4b6d-b67c-691484ac400a tempest-ProjectReaderTests-483930896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.943s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:35:06 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-6f986164-75a6-4f4f-8906-ef9bf8cda20d tempest-ProjectReaderTests-1662189440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.226s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:35:06 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-6f986164-75a6-4f4f-8906-ef9bf8cda20d tempest-ProjectReaderTests-1662189440 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:34:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-193575752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ae66333-01ca-4ad7-bebf-587b27c32a5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ca5909155df44ec8406d9012aa8352a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:34:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:34:59Z,use_quota=True,user_id='a784f076d7d44105ab3bafdbc8e09c8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:35:06 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-6f986164-75a6-4f4f-8906-ef9bf8cda20d tempest-ProjectReaderTests-1662189440 None] Creating volume 3ae66333-01ca-4ad7-bebf-587b27c32a5b {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:35:06 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-6f986164-75a6-4f4f-8906-ef9bf8cda20d tempest-ProjectReaderTests-1662189440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:35:06 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-6f986164-75a6-4f4f-8906-ef9bf8cda20d tempest-ProjectReaderTests-1662189440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:35:06 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-6f986164-75a6-4f4f-8906-ef9bf8cda20d tempest-ProjectReaderTests-1662189440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:35:06 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-6f986164-75a6-4f4f-8906-ef9bf8cda20d tempest-ProjectReaderTests-1662189440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:35:06 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-6f986164-75a6-4f4f-8906-ef9bf8cda20d tempest-ProjectReaderTests-1662189440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:35:06 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-6f986164-75a6-4f4f-8906-ef9bf8cda20d tempest-ProjectReaderTests-1662189440 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:35:06 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-6f986164-75a6-4f4f-8906-ef9bf8cda20d tempest-ProjectReaderTests-1662189440 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:35:06 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-6f986164-75a6-4f4f-8906-ef9bf8cda20d tempest-ProjectReaderTests-1662189440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3ae66333-01ca-4ad7-bebf-587b27c32a5b 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:06 devstack sudo[105942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3ae66333-01ca-4ad7-bebf-587b27c32a5b 1073741824 Jul 22 03:35:06 devstack sudo[105942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:06 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-6028dac9-b630-4b6d-b67c-691484ac400a tempest-ProjectReaderTests-483930896 None] Create snapshot completed successfully Jul 22 03:35:06 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-e782536a-aa65-4f2b-9db2-906a08596066 tempest-SnapshotDependencyTests-1942573504 None] Delete snapshot completed successfully. Jul 22 03:35:06 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-e782536a-aa65-4f2b-9db2-906a08596066 tempest-SnapshotDependencyTests-1942573504 None] Lock "cinder-354a5fdf-737a-439b-9535-09d3852970b0-delete_snapshot" released by "delete_snapshot" :: held 1.669s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:35:06 devstack sudo[105942]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:06 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-6f986164-75a6-4f4f-8906-ef9bf8cda20d tempest-ProjectReaderTests-1662189440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3ae66333-01ca-4ad7-bebf-587b27c32a5b 1073741824" returned: 0 in 0.405s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:06 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-6f986164-75a6-4f4f-8906-ef9bf8cda20d tempest-ProjectReaderTests-1662189440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3ae66333-01ca-4ad7-bebf-587b27c32a5b {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:06 devstack sudo[105947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3ae66333-01ca-4ad7-bebf-587b27c32a5b Jul 22 03:35:06 devstack sudo[105947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:06 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-df9e3ddb-f0dd-4fb8-9e74-7d39635079e6 tempest-SnapshotDependencyTests-1942573504 None] Acquiring lock "cinder-0dd02463-e194-4d32-8a1b-cdaaaedd01d1-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:35:06 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-df9e3ddb-f0dd-4fb8-9e74-7d39635079e6 tempest-SnapshotDependencyTests-1942573504 None] Lock "cinder-0dd02463-e194-4d32-8a1b-cdaaaedd01d1-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:35:06 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-df9e3ddb-f0dd-4fb8-9e74-7d39635079e6 tempest-SnapshotDependencyTests-1942573504 None] Acquiring lock "cinder-quobyte-0dd02463-e194-4d32-8a1b-cdaaaedd01d1" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:35:06 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-df9e3ddb-f0dd-4fb8-9e74-7d39635079e6 tempest-SnapshotDependencyTests-1942573504 None] Lock "cinder-quobyte-0dd02463-e194-4d32-8a1b-cdaaaedd01d1" acquired by "delete_volume" :: waited 0.022s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:35:06 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd3eefcf-55b7-4775-b287-5eb929fdca15]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:35:06 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-df9e3ddb-f0dd-4fb8-9e74-7d39635079e6 tempest-SnapshotDependencyTests-1942573504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0dd02463-e194-4d32-8a1b-cdaaaedd01d1 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:06 devstack sudo[105947]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:06 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-6f986164-75a6-4f4f-8906-ef9bf8cda20d tempest-ProjectReaderTests-1662189440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3ae66333-01ca-4ad7-bebf-587b27c32a5b" returned: 0 in 0.258s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:06 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-6f986164-75a6-4f4f-8906-ef9bf8cda20d tempest-ProjectReaderTests-1662189440 None] <== create_volume: return (700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:35:06 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-6f986164-75a6-4f4f-8906-ef9bf8cda20d tempest-ProjectReaderTests-1662189440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.703s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:35:06 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-2eb74db4-c926-4259-b53c-d236ee062207 tempest-ProjectMemberTests-64253088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.514s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:35:06 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-2eb74db4-c926-4259-b53c-d236ee062207 tempest-ProjectMemberTests-64253088 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:35:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-456941009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02bdf016-6166-424e-bd87-8e04e3349ee0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05eb3b4eac3e4ffe97247852227f9ffa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:35:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:35:01Z,use_quota=True,user_id='ecf77e3a2be443e28cffe6ba02afc5e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:35:06 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-2eb74db4-c926-4259-b53c-d236ee062207 tempest-ProjectMemberTests-64253088 None] Creating volume 02bdf016-6166-424e-bd87-8e04e3349ee0 {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:35:06 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-2eb74db4-c926-4259-b53c-d236ee062207 tempest-ProjectMemberTests-64253088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:35:06 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-2eb74db4-c926-4259-b53c-d236ee062207 tempest-ProjectMemberTests-64253088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:35:06 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-2eb74db4-c926-4259-b53c-d236ee062207 tempest-ProjectMemberTests-64253088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:35:06 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-2eb74db4-c926-4259-b53c-d236ee062207 tempest-ProjectMemberTests-64253088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:35:06 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-2eb74db4-c926-4259-b53c-d236ee062207 tempest-ProjectMemberTests-64253088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:35:06 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-2eb74db4-c926-4259-b53c-d236ee062207 tempest-ProjectMemberTests-64253088 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:35:06 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-2eb74db4-c926-4259-b53c-d236ee062207 tempest-ProjectMemberTests-64253088 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:35:06 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2eb74db4-c926-4259-b53c-d236ee062207 tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-02bdf016-6166-424e-bd87-8e04e3349ee0 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:06 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-6f986164-75a6-4f4f-8906-ef9bf8cda20d tempest-ProjectReaderTests-1662189440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ab71480-21c1-41ee-bea3-202ef8db4e54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ae66333-01ca-4ad7-bebf-587b27c32a5b', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:35:06 devstack sudo[105951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-02bdf016-6166-424e-bd87-8e04e3349ee0 1073741824 Jul 22 03:35:06 devstack sudo[105951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:06 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-6f986164-75a6-4f4f-8906-ef9bf8cda20d tempest-ProjectReaderTests-1662189440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bae954b4-0671-4b1c-860b-26fc44cc0a0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:35:06 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-6f986164-75a6-4f4f-8906-ef9bf8cda20d tempest-ProjectReaderTests-1662189440 None] Volume volume-3ae66333-01ca-4ad7-bebf-587b27c32a5b (3ae66333-01ca-4ad7-bebf-587b27c32a5b): created successfully Jul 22 03:35:06 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-6f986164-75a6-4f4f-8906-ef9bf8cda20d tempest-ProjectReaderTests-1662189440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bae954b4-0671-4b1c-860b-26fc44cc0a0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:35:06 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-6f986164-75a6-4f4f-8906-ef9bf8cda20d tempest-ProjectReaderTests-1662189440 None] Flow 'volume_create_manager' (a08da1bf-4c85-43ad-bf4c-5f66720156df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:35:06 devstack sudo[105950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0dd02463-e194-4d32-8a1b-cdaaaedd01d1 Jul 22 03:35:06 devstack sudo[105950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:06 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-6f986164-75a6-4f4f-8906-ef9bf8cda20d tempest-ProjectReaderTests-1662189440 None] Created volume successfully. Jul 22 03:35:07 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-7c7982bb-b364-4b07-adb2-44a437526398 tempest-ProjectReaderTests-483930896 None] Acquiring lock "cinder-0285288b-99e6-4770-a0bd-8f3d726b6683-delete_snapshot" by "delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:35:07 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-7c7982bb-b364-4b07-adb2-44a437526398 tempest-ProjectReaderTests-483930896 None] Lock "cinder-0285288b-99e6-4770-a0bd-8f3d726b6683-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:35:07 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-7c7982bb-b364-4b07-adb2-44a437526398 tempest-ProjectReaderTests-483930896 None] Acquiring lock "cinder-quobyte-086b2378-d086-4864-9fbf-b19ba83c4659" by "delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:35:07 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-7c7982bb-b364-4b07-adb2-44a437526398 tempest-ProjectReaderTests-483930896 None] Lock "cinder-quobyte-086b2378-d086-4864-9fbf-b19ba83c4659" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:35:07 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-7c7982bb-b364-4b07-adb2-44a437526398 tempest-ProjectReaderTests-483930896 None] Acquiring lock "cinder-quobyte-0285288b-99e6-4770-a0bd-8f3d726b6683" by "_delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:35:07 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-7c7982bb-b364-4b07-adb2-44a437526398 tempest-ProjectReaderTests-483930896 None] Lock "cinder-quobyte-0285288b-99e6-4770-a0bd-8f3d726b6683" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:35:07 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-7c7982bb-b364-4b07-adb2-44a437526398 tempest-ProjectReaderTests-483930896 None] Deleting offline snapshot 0285288b-99e6-4770-a0bd-8f3d726b6683 of volume 086b2378-d086-4864-9fbf-b19ba83c4659 {{(pid=87747) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 03:35:07 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-7c7982bb-b364-4b07-adb2-44a437526398 tempest-ProjectReaderTests-483930896 None] snapshot_file for this snap is: volume-086b2378-d086-4864-9fbf-b19ba83c4659.0285288b-99e6-4770-a0bd-8f3d726b6683 {{(pid=87747) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 03:35:07 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f87c19b-8def-4dc4-9796-0bec3d6ab6fe]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:35:07 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-7c7982bb-b364-4b07-adb2-44a437526398 tempest-ProjectReaderTests-483930896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-086b2378-d086-4864-9fbf-b19ba83c4659.0285288b-99e6-4770-a0bd-8f3d726b6683 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:07 devstack sudo[105950]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:07 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-df9e3ddb-f0dd-4fb8-9e74-7d39635079e6 tempest-SnapshotDependencyTests-1942573504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0dd02463-e194-4d32-8a1b-cdaaaedd01d1" returned: 0 in 0.372s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:07 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-df9e3ddb-f0dd-4fb8-9e74-7d39635079e6 tempest-SnapshotDependencyTests-1942573504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0dd02463-e194-4d32-8a1b-cdaaaedd01d1 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:07 devstack sudo[105961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0dd02463-e194-4d32-8a1b-cdaaaedd01d1 Jul 22 03:35:07 devstack sudo[105961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:07 devstack sudo[105958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-086b2378-d086-4864-9fbf-b19ba83c4659.0285288b-99e6-4770-a0bd-8f3d726b6683 Jul 22 03:35:07 devstack sudo[105958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:07 devstack sudo[105951]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:07 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2eb74db4-c926-4259-b53c-d236ee062207 tempest-ProjectMemberTests-64253088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-02bdf016-6166-424e-bd87-8e04e3349ee0 1073741824" returned: 0 in 0.477s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:07 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2eb74db4-c926-4259-b53c-d236ee062207 tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-02bdf016-6166-424e-bd87-8e04e3349ee0 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:07 devstack sudo[105964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-02bdf016-6166-424e-bd87-8e04e3349ee0 Jul 22 03:35:07 devstack sudo[105964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:07 devstack sudo[105961]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:07 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-df9e3ddb-f0dd-4fb8-9e74-7d39635079e6 tempest-SnapshotDependencyTests-1942573504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-0dd02463-e194-4d32-8a1b-cdaaaedd01d1" returned: 0 in 0.294s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:07 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-df9e3ddb-f0dd-4fb8-9e74-7d39635079e6 tempest-SnapshotDependencyTests-1942573504 None] Lock "cinder-quobyte-0dd02463-e194-4d32-8a1b-cdaaaedd01d1" released by "delete_volume" :: held 0.732s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:35:07 devstack sudo[105958]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:07 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-7c7982bb-b364-4b07-adb2-44a437526398 tempest-ProjectReaderTests-483930896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-086b2378-d086-4864-9fbf-b19ba83c4659.0285288b-99e6-4770-a0bd-8f3d726b6683" returned: 0 in 0.417s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:07 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-7c7982bb-b364-4b07-adb2-44a437526398 tempest-ProjectReaderTests-483930896 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-086b2378-d086-4864-9fbf-b19ba83c4659(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87747) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 03:35:07 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ca0af01-2296-4516-aae9-e0f5c8287dec]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:35:07 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-7c7982bb-b364-4b07-adb2-44a437526398 tempest-ProjectReaderTests-483930896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-086b2378-d086-4864-9fbf-b19ba83c4659 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:07 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-df9e3ddb-f0dd-4fb8-9e74-7d39635079e6 tempest-SnapshotDependencyTests-1942573504 None] Created reservations ['ce2f51c4-1584-4f04-8879-5c1f028625f3', 'c6540aec-77ba-4d8f-92a8-fcc60dc1cd16', '1121299c-ad3b-4cfe-8fb5-c1c4262b35a3', 'c33156a8-a83f-441c-a058-9988e9782d4d'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:35:07 devstack sudo[105964]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:07 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-2eb74db4-c926-4259-b53c-d236ee062207 tempest-ProjectMemberTests-64253088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-02bdf016-6166-424e-bd87-8e04e3349ee0" returned: 0 in 0.282s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:07 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-2eb74db4-c926-4259-b53c-d236ee062207 tempest-ProjectMemberTests-64253088 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:35:07 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-2eb74db4-c926-4259-b53c-d236ee062207 tempest-ProjectMemberTests-64253088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.807s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:35:07 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-aff9c009-fd60-4196-b953-44e1b796cb3e tempest-ProjectReaderTests-1662189440 None] Acquiring lock "cinder-3ae66333-01ca-4ad7-bebf-587b27c32a5b-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:35:07 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2eb74db4-c926-4259-b53c-d236ee062207 tempest-ProjectMemberTests-64253088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc5f8566-7969-4c4a-b702-526ce021f2a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02bdf016-6166-424e-bd87-8e04e3349ee0', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:35:07 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2eb74db4-c926-4259-b53c-d236ee062207 tempest-ProjectMemberTests-64253088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25d45315-e9b1-4038-a90c-8781f3f2b8f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:35:07 devstack sudo[105970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-086b2378-d086-4864-9fbf-b19ba83c4659 Jul 22 03:35:07 devstack sudo[105970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:07 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-2eb74db4-c926-4259-b53c-d236ee062207 tempest-ProjectMemberTests-64253088 None] Volume volume-02bdf016-6166-424e-bd87-8e04e3349ee0 (02bdf016-6166-424e-bd87-8e04e3349ee0): created successfully Jul 22 03:35:07 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2eb74db4-c926-4259-b53c-d236ee062207 tempest-ProjectMemberTests-64253088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25d45315-e9b1-4038-a90c-8781f3f2b8f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:35:07 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-2eb74db4-c926-4259-b53c-d236ee062207 tempest-ProjectMemberTests-64253088 None] Flow 'volume_create_manager' (9ea8223f-7847-4fd8-8446-9a276c0f0143) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:35:07 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-aff9c009-fd60-4196-b953-44e1b796cb3e tempest-ProjectReaderTests-1662189440 None] Lock "cinder-3ae66333-01ca-4ad7-bebf-587b27c32a5b-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:35:07 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-2eb74db4-c926-4259-b53c-d236ee062207 tempest-ProjectMemberTests-64253088 None] Created volume successfully. Jul 22 03:35:07 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-df9e3ddb-f0dd-4fb8-9e74-7d39635079e6 tempest-SnapshotDependencyTests-1942573504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:35:07 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-df9e3ddb-f0dd-4fb8-9e74-7d39635079e6 tempest-SnapshotDependencyTests-1942573504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:35:07 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-df9e3ddb-f0dd-4fb8-9e74-7d39635079e6 tempest-SnapshotDependencyTests-1942573504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:35:07 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-df9e3ddb-f0dd-4fb8-9e74-7d39635079e6 tempest-SnapshotDependencyTests-1942573504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:35:07 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-df9e3ddb-f0dd-4fb8-9e74-7d39635079e6 tempest-SnapshotDependencyTests-1942573504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:35:07 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-df9e3ddb-f0dd-4fb8-9e74-7d39635079e6 tempest-SnapshotDependencyTests-1942573504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:07 devstack sudo[105973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:35:07 devstack sudo[105973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:07 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-aff9c009-fd60-4196-b953-44e1b796cb3e tempest-ProjectReaderTests-1662189440 None] Acquiring lock "cinder-quobyte-3ae66333-01ca-4ad7-bebf-587b27c32a5b" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:35:07 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-aff9c009-fd60-4196-b953-44e1b796cb3e tempest-ProjectReaderTests-1662189440 None] Lock "cinder-quobyte-3ae66333-01ca-4ad7-bebf-587b27c32a5b" acquired by "delete_volume" :: waited 0.016s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:35:07 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf91080b-d365-4dc1-bc55-8c116ffd0495]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:35:07 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-aff9c009-fd60-4196-b953-44e1b796cb3e tempest-ProjectReaderTests-1662189440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3ae66333-01ca-4ad7-bebf-587b27c32a5b {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:07 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-3b90fd4f-6ae5-493a-b085-f9317f0a2c1a tempest-SnapshotDependencyTests-1942573504 None] Acquiring lock "cinder-2fd2280b-4f0f-41d4-8f7b-a49f5faca7fc-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:35:07 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-3b90fd4f-6ae5-493a-b085-f9317f0a2c1a tempest-SnapshotDependencyTests-1942573504 None] Lock "cinder-2fd2280b-4f0f-41d4-8f7b-a49f5faca7fc-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:35:07 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-3b90fd4f-6ae5-493a-b085-f9317f0a2c1a tempest-SnapshotDependencyTests-1942573504 None] Acquiring lock "cinder-quobyte-2fd2280b-4f0f-41d4-8f7b-a49f5faca7fc" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:35:08 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-3b90fd4f-6ae5-493a-b085-f9317f0a2c1a tempest-SnapshotDependencyTests-1942573504 None] Lock "cinder-quobyte-2fd2280b-4f0f-41d4-8f7b-a49f5faca7fc" acquired by "delete_volume" :: waited 0.016s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:35:08 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd2cd608-e443-48c5-9508-d9c530d3488d]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:35:08 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-3b90fd4f-6ae5-493a-b085-f9317f0a2c1a tempest-SnapshotDependencyTests-1942573504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2fd2280b-4f0f-41d4-8f7b-a49f5faca7fc {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:08 devstack sudo[105970]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:08 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-7c7982bb-b364-4b07-adb2-44a437526398 tempest-ProjectReaderTests-483930896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-086b2378-d086-4864-9fbf-b19ba83c4659" returned: 0 in 0.465s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:08 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-7c7982bb-b364-4b07-adb2-44a437526398 tempest-ProjectReaderTests-483930896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-086b2378-d086-4864-9fbf-b19ba83c4659.0285288b-99e6-4770-a0bd-8f3d726b6683 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:08 devstack sudo[105975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3ae66333-01ca-4ad7-bebf-587b27c32a5b Jul 22 03:35:08 devstack sudo[105975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:08 devstack sudo[105982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-086b2378-d086-4864-9fbf-b19ba83c4659.0285288b-99e6-4770-a0bd-8f3d726b6683 Jul 22 03:35:08 devstack sudo[105982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:08 devstack sudo[105973]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:08 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-df9e3ddb-f0dd-4fb8-9e74-7d39635079e6 tempest-SnapshotDependencyTests-1942573504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.307s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:08 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-df9e3ddb-f0dd-4fb8-9e74-7d39635079e6 tempest-SnapshotDependencyTests-1942573504 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:35:08 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-df9e3ddb-f0dd-4fb8-9e74-7d39635079e6 tempest-SnapshotDependencyTests-1942573504 None] Deleted volume successfully. Jul 22 03:35:08 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-df9e3ddb-f0dd-4fb8-9e74-7d39635079e6 tempest-SnapshotDependencyTests-1942573504 None] Lock "cinder-0dd02463-e194-4d32-8a1b-cdaaaedd01d1-delete_volume" released by "delete_volume" :: held 1.421s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:35:08 devstack sudo[105979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2fd2280b-4f0f-41d4-8f7b-a49f5faca7fc Jul 22 03:35:08 devstack sudo[105979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:08 devstack sudo[105975]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:08 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-aff9c009-fd60-4196-b953-44e1b796cb3e tempest-ProjectReaderTests-1662189440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3ae66333-01ca-4ad7-bebf-587b27c32a5b" returned: 0 in 0.444s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:08 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-aff9c009-fd60-4196-b953-44e1b796cb3e tempest-ProjectReaderTests-1662189440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3ae66333-01ca-4ad7-bebf-587b27c32a5b {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:08 devstack sudo[105992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3ae66333-01ca-4ad7-bebf-587b27c32a5b Jul 22 03:35:08 devstack sudo[105992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:08 devstack sudo[105982]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:08 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-7c7982bb-b364-4b07-adb2-44a437526398 tempest-ProjectReaderTests-483930896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-086b2378-d086-4864-9fbf-b19ba83c4659.0285288b-99e6-4770-a0bd-8f3d726b6683" returned: 0 in 0.412s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:08 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-7c7982bb-b364-4b07-adb2-44a437526398 tempest-ProjectReaderTests-483930896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-086b2378-d086-4864-9fbf-b19ba83c4659.0285288b-99e6-4770-a0bd-8f3d726b6683 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:08 devstack sudo[105979]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:08 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-3b90fd4f-6ae5-493a-b085-f9317f0a2c1a tempest-SnapshotDependencyTests-1942573504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2fd2280b-4f0f-41d4-8f7b-a49f5faca7fc" returned: 0 in 0.468s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:08 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-3b90fd4f-6ae5-493a-b085-f9317f0a2c1a tempest-SnapshotDependencyTests-1942573504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2fd2280b-4f0f-41d4-8f7b-a49f5faca7fc {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:08 devstack sudo[105997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-086b2378-d086-4864-9fbf-b19ba83c4659.0285288b-99e6-4770-a0bd-8f3d726b6683 Jul 22 03:35:08 devstack sudo[105997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:08 devstack sudo[105998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2fd2280b-4f0f-41d4-8f7b-a49f5faca7fc Jul 22 03:35:08 devstack sudo[105998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:08 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-5b628106-8f9e-4e56-b6d1-b3ef84714082 tempest-ProjectMemberTests-64253088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:35:08 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-5b628106-8f9e-4e56-b6d1-b3ef84714082 tempest-ProjectMemberTests-64253088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:35:08 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-5b628106-8f9e-4e56-b6d1-b3ef84714082 tempest-ProjectMemberTests-64253088 None] Creating offline snapshot 45423fdf-591f-4b79-9103-08f024cb1cfb of volume 02bdf016-6166-424e-bd87-8e04e3349ee0 {{(pid=87747) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 03:35:08 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[07ba49f2-8aee-48cc-b254-8e7ca390484a]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:35:08 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5b628106-8f9e-4e56-b6d1-b3ef84714082 tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-02bdf016-6166-424e-bd87-8e04e3349ee0 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:08 devstack sudo[105992]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:08 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-aff9c009-fd60-4196-b953-44e1b796cb3e tempest-ProjectReaderTests-1662189440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3ae66333-01ca-4ad7-bebf-587b27c32a5b" returned: 0 in 0.357s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:08 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-aff9c009-fd60-4196-b953-44e1b796cb3e tempest-ProjectReaderTests-1662189440 None] Lock "cinder-quobyte-3ae66333-01ca-4ad7-bebf-587b27c32a5b" released by "delete_volume" :: held 0.867s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:35:08 devstack sudo[106001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-02bdf016-6166-424e-bd87-8e04e3349ee0 Jul 22 03:35:08 devstack sudo[106001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:08 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-aff9c009-fd60-4196-b953-44e1b796cb3e tempest-ProjectReaderTests-1662189440 None] Created reservations ['8be09e99-9062-4c10-a29d-7ebd9a8eb87a', '0a043e84-f50d-416e-b7d3-fef48b5a321d', '26e12285-37f3-4584-b342-39eba75386d1', 'accca08a-be32-4f48-83e8-10a4418f1f9c'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:35:08 devstack sudo[105997]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:08 devstack sudo[105998]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:08 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-7c7982bb-b364-4b07-adb2-44a437526398 tempest-ProjectReaderTests-483930896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-086b2378-d086-4864-9fbf-b19ba83c4659.0285288b-99e6-4770-a0bd-8f3d726b6683" returned: 0 in 0.375s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:08 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-3b90fd4f-6ae5-493a-b085-f9317f0a2c1a tempest-SnapshotDependencyTests-1942573504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-2fd2280b-4f0f-41d4-8f7b-a49f5faca7fc" returned: 0 in 0.367s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:08 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-7c7982bb-b364-4b07-adb2-44a437526398 tempest-ProjectReaderTests-483930896 None] Lock "cinder-quobyte-0285288b-99e6-4770-a0bd-8f3d726b6683" released by "_delete_snapshot" :: held 1.780s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:35:08 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-7c7982bb-b364-4b07-adb2-44a437526398 tempest-ProjectReaderTests-483930896 None] Lock "cinder-quobyte-086b2378-d086-4864-9fbf-b19ba83c4659" released by "delete_snapshot" :: held 1.812s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:35:08 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-3b90fd4f-6ae5-493a-b085-f9317f0a2c1a tempest-SnapshotDependencyTests-1942573504 None] Lock "cinder-quobyte-2fd2280b-4f0f-41d4-8f7b-a49f5faca7fc" released by "delete_volume" :: held 0.897s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:35:08 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-aff9c009-fd60-4196-b953-44e1b796cb3e tempest-ProjectReaderTests-1662189440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:35:08 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-aff9c009-fd60-4196-b953-44e1b796cb3e tempest-ProjectReaderTests-1662189440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:35:08 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-aff9c009-fd60-4196-b953-44e1b796cb3e tempest-ProjectReaderTests-1662189440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:35:08 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-aff9c009-fd60-4196-b953-44e1b796cb3e tempest-ProjectReaderTests-1662189440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:35:08 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-aff9c009-fd60-4196-b953-44e1b796cb3e tempest-ProjectReaderTests-1662189440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:35:08 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-aff9c009-fd60-4196-b953-44e1b796cb3e tempest-ProjectReaderTests-1662189440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:08 devstack sudo[106006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:35:08 devstack sudo[106006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:09 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-3b90fd4f-6ae5-493a-b085-f9317f0a2c1a tempest-SnapshotDependencyTests-1942573504 None] Created reservations ['a70d4670-80ce-4c3f-851c-7dfb07f3c419', 'da4ca778-9631-436b-bc5d-1701cadf35df', '8c237b95-0ba8-4e06-92d3-656a7d4ca292', 'c34a8984-1a1d-4dd4-b7d3-7d9639a90583'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:35:09 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-7c7982bb-b364-4b07-adb2-44a437526398 tempest-ProjectReaderTests-483930896 None] Created reservations ['6ac1ea80-4570-4e3d-a584-0021bf8fbe32', '91272b2b-90d6-4166-aeaf-5f4084690526', 'dff44358-2e06-4bce-b862-89e9d9176926', '6af5f9ea-88a3-4d7b-90c8-40b2c7fff7d3'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:35:09 devstack sudo[106001]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:09 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5b628106-8f9e-4e56-b6d1-b3ef84714082 tempest-ProjectMemberTests-64253088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-02bdf016-6166-424e-bd87-8e04e3349ee0" returned: 0 in 0.460s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:09 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5b628106-8f9e-4e56-b6d1-b3ef84714082 tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-02bdf016-6166-424e-bd87-8e04e3349ee0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-02bdf016-6166-424e-bd87-8e04e3349ee0.45423fdf-591f-4b79-9103-08f024cb1cfb 1G {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:09 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-3b90fd4f-6ae5-493a-b085-f9317f0a2c1a tempest-SnapshotDependencyTests-1942573504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:35:09 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-3b90fd4f-6ae5-493a-b085-f9317f0a2c1a tempest-SnapshotDependencyTests-1942573504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:35:09 devstack sudo[106012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-02bdf016-6166-424e-bd87-8e04e3349ee0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-02bdf016-6166-424e-bd87-8e04e3349ee0.45423fdf-591f-4b79-9103-08f024cb1cfb 1G Jul 22 03:35:09 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-3b90fd4f-6ae5-493a-b085-f9317f0a2c1a tempest-SnapshotDependencyTests-1942573504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:35:09 devstack sudo[106012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:09 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-3b90fd4f-6ae5-493a-b085-f9317f0a2c1a tempest-SnapshotDependencyTests-1942573504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:35:09 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-3b90fd4f-6ae5-493a-b085-f9317f0a2c1a tempest-SnapshotDependencyTests-1942573504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:35:09 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-3b90fd4f-6ae5-493a-b085-f9317f0a2c1a tempest-SnapshotDependencyTests-1942573504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:09 devstack sudo[106014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:35:09 devstack sudo[106014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:09 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-7c7982bb-b364-4b07-adb2-44a437526398 tempest-ProjectReaderTests-483930896 None] Delete snapshot completed successfully. Jul 22 03:35:09 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-7c7982bb-b364-4b07-adb2-44a437526398 tempest-ProjectReaderTests-483930896 None] Lock "cinder-0285288b-99e6-4770-a0bd-8f3d726b6683-delete_snapshot" released by "delete_snapshot" :: held 2.128s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:35:09 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-8a8daac7-2e4e-4501-8299-efd3541d0b54 tempest-ProjectReaderTests-483930896 None] Acquiring lock "cinder-086b2378-d086-4864-9fbf-b19ba83c4659-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:35:09 devstack sudo[106006]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:09 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-aff9c009-fd60-4196-b953-44e1b796cb3e tempest-ProjectReaderTests-1662189440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.358s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:09 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-aff9c009-fd60-4196-b953-44e1b796cb3e tempest-ProjectReaderTests-1662189440 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:35:09 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-aff9c009-fd60-4196-b953-44e1b796cb3e tempest-ProjectReaderTests-1662189440 None] Deleted volume successfully. Jul 22 03:35:09 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-8a8daac7-2e4e-4501-8299-efd3541d0b54 tempest-ProjectReaderTests-483930896 None] Lock "cinder-086b2378-d086-4864-9fbf-b19ba83c4659-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:35:09 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-aff9c009-fd60-4196-b953-44e1b796cb3e tempest-ProjectReaderTests-1662189440 None] Lock "cinder-3ae66333-01ca-4ad7-bebf-587b27c32a5b-delete_volume" released by "delete_volume" :: held 1.601s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:35:09 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-8a8daac7-2e4e-4501-8299-efd3541d0b54 tempest-ProjectReaderTests-483930896 None] Acquiring lock "cinder-quobyte-086b2378-d086-4864-9fbf-b19ba83c4659" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:35:09 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-8a8daac7-2e4e-4501-8299-efd3541d0b54 tempest-ProjectReaderTests-483930896 None] Lock "cinder-quobyte-086b2378-d086-4864-9fbf-b19ba83c4659" acquired by "delete_volume" :: waited 0.023s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:35:09 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d39f29a-091f-421b-a832-a74e94ecc364]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:35:09 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-8a8daac7-2e4e-4501-8299-efd3541d0b54 tempest-ProjectReaderTests-483930896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-086b2378-d086-4864-9fbf-b19ba83c4659 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:09 devstack sudo[106014]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:09 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-3b90fd4f-6ae5-493a-b085-f9317f0a2c1a tempest-SnapshotDependencyTests-1942573504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.377s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:09 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-3b90fd4f-6ae5-493a-b085-f9317f0a2c1a tempest-SnapshotDependencyTests-1942573504 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:35:09 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-3b90fd4f-6ae5-493a-b085-f9317f0a2c1a tempest-SnapshotDependencyTests-1942573504 None] Deleted volume successfully. Jul 22 03:35:09 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-3b90fd4f-6ae5-493a-b085-f9317f0a2c1a tempest-SnapshotDependencyTests-1942573504 None] Lock "cinder-2fd2280b-4f0f-41d4-8f7b-a49f5faca7fc-delete_volume" released by "delete_volume" :: held 1.589s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:35:09 devstack sudo[106022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-086b2378-d086-4864-9fbf-b19ba83c4659 Jul 22 03:35:09 devstack sudo[106022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:09 devstack sudo[106012]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:09 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5b628106-8f9e-4e56-b6d1-b3ef84714082 tempest-ProjectMemberTests-64253088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-02bdf016-6166-424e-bd87-8e04e3349ee0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-02bdf016-6166-424e-bd87-8e04e3349ee0.45423fdf-591f-4b79-9103-08f024cb1cfb 1G" returned: 0 in 0.578s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:09 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5b628106-8f9e-4e56-b6d1-b3ef84714082 tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02bdf016-6166-424e-bd87-8e04e3349ee0 -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-02bdf016-6166-424e-bd87-8e04e3349ee0.45423fdf-591f-4b79-9103-08f024cb1cfb {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:09 devstack sudo[106024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02bdf016-6166-424e-bd87-8e04e3349ee0 -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-02bdf016-6166-424e-bd87-8e04e3349ee0.45423fdf-591f-4b79-9103-08f024cb1cfb Jul 22 03:35:09 devstack sudo[106024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:09 devstack sudo[106022]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:09 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-8a8daac7-2e4e-4501-8299-efd3541d0b54 tempest-ProjectReaderTests-483930896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-086b2378-d086-4864-9fbf-b19ba83c4659" returned: 0 in 0.419s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:09 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-8a8daac7-2e4e-4501-8299-efd3541d0b54 tempest-ProjectReaderTests-483930896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-086b2378-d086-4864-9fbf-b19ba83c4659 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:09 devstack sudo[106031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-086b2378-d086-4864-9fbf-b19ba83c4659 Jul 22 03:35:09 devstack sudo[106031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:09 devstack sudo[106024]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:10 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5b628106-8f9e-4e56-b6d1-b3ef84714082 tempest-ProjectMemberTests-64253088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02bdf016-6166-424e-bd87-8e04e3349ee0 -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-02bdf016-6166-424e-bd87-8e04e3349ee0.45423fdf-591f-4b79-9103-08f024cb1cfb" returned: 0 in 0.347s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:10 devstack cinder-volume[87747]: WARNING cinder.volume.drivers.remotefs [None req-5b628106-8f9e-4e56-b6d1-b3ef84714082 tempest-ProjectMemberTests-64253088 None] /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-02bdf016-6166-424e-bd87-8e04e3349ee0.45423fdf-591f-4b79-9103-08f024cb1cfb is being set with open permissions: ugo+rw Jul 22 03:35:10 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5b628106-8f9e-4e56-b6d1-b3ef84714082 tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-02bdf016-6166-424e-bd87-8e04e3349ee0.45423fdf-591f-4b79-9103-08f024cb1cfb {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:10 devstack sudo[106034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-02bdf016-6166-424e-bd87-8e04e3349ee0.45423fdf-591f-4b79-9103-08f024cb1cfb Jul 22 03:35:10 devstack sudo[106034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:10 devstack sudo[106031]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:10 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-8a8daac7-2e4e-4501-8299-efd3541d0b54 tempest-ProjectReaderTests-483930896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-086b2378-d086-4864-9fbf-b19ba83c4659" returned: 0 in 0.372s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:10 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-8a8daac7-2e4e-4501-8299-efd3541d0b54 tempest-ProjectReaderTests-483930896 None] Lock "cinder-quobyte-086b2378-d086-4864-9fbf-b19ba83c4659" released by "delete_volume" :: held 0.867s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:35:10 devstack sudo[106034]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:10 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5b628106-8f9e-4e56-b6d1-b3ef84714082 tempest-ProjectMemberTests-64253088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-02bdf016-6166-424e-bd87-8e04e3349ee0.45423fdf-591f-4b79-9103-08f024cb1cfb" returned: 0 in 0.300s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:10 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5b628106-8f9e-4e56-b6d1-b3ef84714082 tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-02bdf016-6166-424e-bd87-8e04e3349ee0.info {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:10 devstack sudo[106038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-02bdf016-6166-424e-bd87-8e04e3349ee0.info Jul 22 03:35:10 devstack sudo[106038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:10 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-8a8daac7-2e4e-4501-8299-efd3541d0b54 tempest-ProjectReaderTests-483930896 None] Created reservations ['b8072486-609f-40a4-8ecc-9ccd8d117ba3', '0b3f3f28-4b8c-499a-8589-638c5a9c834d', 'a49a8b2d-2e5a-4f09-80a8-67b82110a94c', '4575de61-8b34-406b-8e89-947a0125bbd3'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:35:10 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbe52e66-2891-4db2-b116-a78aabe974a7 tempest-ProjectReaderTests-1662189440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:35:10 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-dbe52e66-2891-4db2-b116-a78aabe974a7 tempest-ProjectReaderTests-1662189440 None] Flow 'volume_create_manager' (7f783647-ef6d-4065-a056-129d48b37106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:35:10 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-dbe52e66-2891-4db2-b116-a78aabe974a7 tempest-ProjectReaderTests-1662189440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d7aa653-85be-41b2-b64d-4b303ba1459b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:35:10 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-dbe52e66-2891-4db2-b116-a78aabe974a7 tempest-ProjectReaderTests-1662189440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d7aa653-85be-41b2-b64d-4b303ba1459b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:35:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-941043722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1cb8e33-6483-42ac-b4dc-1ff8a730cbf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ca5909155df44ec8406d9012aa8352a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:35:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:35:10Z,use_quota=True,user_id='a784f076d7d44105ab3bafdbc8e09c8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:35:10 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-dbe52e66-2891-4db2-b116-a78aabe974a7 tempest-ProjectReaderTests-1662189440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5b769c9-f40c-4317-b54f-adf323f2d9b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:35:10 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-dbe52e66-2891-4db2-b116-a78aabe974a7 tempest-ProjectReaderTests-1662189440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5b769c9-f40c-4317-b54f-adf323f2d9b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:35:10 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-dbe52e66-2891-4db2-b116-a78aabe974a7 tempest-ProjectReaderTests-1662189440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33d48174-c617-4840-b832-9fa6aeff6f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:35:10 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-dbe52e66-2891-4db2-b116-a78aabe974a7 tempest-ProjectReaderTests-1662189440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33d48174-c617-4840-b832-9fa6aeff6f5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1cb8e33-6483-42ac-b4dc-1ff8a730cbf3', 'volume_name': 'volume-c1cb8e33-6483-42ac-b4dc-1ff8a730cbf3', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:35:10 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-dbe52e66-2891-4db2-b116-a78aabe974a7 tempest-ProjectReaderTests-1662189440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8bc0c78-74ec-4cfa-b7cd-dee5d8cf8ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:35:10 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-dbe52e66-2891-4db2-b116-a78aabe974a7 tempest-ProjectReaderTests-1662189440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8bc0c78-74ec-4cfa-b7cd-dee5d8cf8ed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:35:10 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-dbe52e66-2891-4db2-b116-a78aabe974a7 tempest-ProjectReaderTests-1662189440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4c9087f-73ab-4fe5-b14e-1d24a619a365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:35:10 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-dbe52e66-2891-4db2-b116-a78aabe974a7 tempest-ProjectReaderTests-1662189440 None] Volume c1cb8e33-6483-42ac-b4dc-1ff8a730cbf3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1cb8e33-6483-42ac-b4dc-1ff8a730cbf3', 'volume_size': 1} Jul 22 03:35:10 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-dbe52e66-2891-4db2-b116-a78aabe974a7 tempest-ProjectReaderTests-1662189440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:35:10 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-8a8daac7-2e4e-4501-8299-efd3541d0b54 tempest-ProjectReaderTests-483930896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:35:10 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-8a8daac7-2e4e-4501-8299-efd3541d0b54 tempest-ProjectReaderTests-483930896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:35:10 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-8a8daac7-2e4e-4501-8299-efd3541d0b54 tempest-ProjectReaderTests-483930896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:35:10 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-8a8daac7-2e4e-4501-8299-efd3541d0b54 tempest-ProjectReaderTests-483930896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:35:10 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-8a8daac7-2e4e-4501-8299-efd3541d0b54 tempest-ProjectReaderTests-483930896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:35:10 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-8a8daac7-2e4e-4501-8299-efd3541d0b54 tempest-ProjectReaderTests-483930896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:10 devstack sudo[106041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:35:10 devstack sudo[106041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:10 devstack sudo[106038]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:10 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5b628106-8f9e-4e56-b6d1-b3ef84714082 tempest-ProjectMemberTests-64253088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-02bdf016-6166-424e-bd87-8e04e3349ee0.info" returned: 0 in 0.337s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:10 devstack cinder-volume[87747]: WARNING cinder.volume.drivers.remotefs [None req-5b628106-8f9e-4e56-b6d1-b3ef84714082 tempest-ProjectMemberTests-64253088 None] /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-02bdf016-6166-424e-bd87-8e04e3349ee0.info is being set with open permissions: ugo+rw Jul 22 03:35:10 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5b628106-8f9e-4e56-b6d1-b3ef84714082 tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-02bdf016-6166-424e-bd87-8e04e3349ee0.info {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:10 devstack sudo[106043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-02bdf016-6166-424e-bd87-8e04e3349ee0.info Jul 22 03:35:10 devstack sudo[106043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:10 devstack sudo[106041]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:10 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-8a8daac7-2e4e-4501-8299-efd3541d0b54 tempest-ProjectReaderTests-483930896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.257s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:10 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-8a8daac7-2e4e-4501-8299-efd3541d0b54 tempest-ProjectReaderTests-483930896 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:35:10 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-8a8daac7-2e4e-4501-8299-efd3541d0b54 tempest-ProjectReaderTests-483930896 None] Deleted volume successfully. Jul 22 03:35:10 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-8a8daac7-2e4e-4501-8299-efd3541d0b54 tempest-ProjectReaderTests-483930896 None] Lock "cinder-086b2378-d086-4864-9fbf-b19ba83c4659-delete_volume" released by "delete_volume" :: held 1.568s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:35:10 devstack sudo[106043]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:10 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5b628106-8f9e-4e56-b6d1-b3ef84714082 tempest-ProjectMemberTests-64253088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-02bdf016-6166-424e-bd87-8e04e3349ee0.info" returned: 0 in 0.280s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:10 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-5b628106-8f9e-4e56-b6d1-b3ef84714082 tempest-ProjectMemberTests-64253088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.415s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:35:10 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-dbe52e66-2891-4db2-b116-a78aabe974a7 tempest-ProjectReaderTests-1662189440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.401s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:35:10 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-dbe52e66-2891-4db2-b116-a78aabe974a7 tempest-ProjectReaderTests-1662189440 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:35:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-941043722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1cb8e33-6483-42ac-b4dc-1ff8a730cbf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ca5909155df44ec8406d9012aa8352a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:35:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:35:10Z,use_quota=True,user_id='a784f076d7d44105ab3bafdbc8e09c8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:35:10 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-dbe52e66-2891-4db2-b116-a78aabe974a7 tempest-ProjectReaderTests-1662189440 None] Creating volume c1cb8e33-6483-42ac-b4dc-1ff8a730cbf3 {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:35:10 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-dbe52e66-2891-4db2-b116-a78aabe974a7 tempest-ProjectReaderTests-1662189440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:35:10 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-dbe52e66-2891-4db2-b116-a78aabe974a7 tempest-ProjectReaderTests-1662189440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:35:10 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-dbe52e66-2891-4db2-b116-a78aabe974a7 tempest-ProjectReaderTests-1662189440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:35:10 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-dbe52e66-2891-4db2-b116-a78aabe974a7 tempest-ProjectReaderTests-1662189440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:35:10 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-dbe52e66-2891-4db2-b116-a78aabe974a7 tempest-ProjectReaderTests-1662189440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:35:10 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-dbe52e66-2891-4db2-b116-a78aabe974a7 tempest-ProjectReaderTests-1662189440 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:35:10 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-dbe52e66-2891-4db2-b116-a78aabe974a7 tempest-ProjectReaderTests-1662189440 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:35:10 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-dbe52e66-2891-4db2-b116-a78aabe974a7 tempest-ProjectReaderTests-1662189440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c1cb8e33-6483-42ac-b4dc-1ff8a730cbf3 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:11 devstack sudo[106048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c1cb8e33-6483-42ac-b4dc-1ff8a730cbf3 1073741824 Jul 22 03:35:11 devstack sudo[106048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:11 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-5b628106-8f9e-4e56-b6d1-b3ef84714082 tempest-ProjectMemberTests-64253088 None] Create snapshot completed successfully Jul 22 03:35:11 devstack sudo[106048]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:11 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-dbe52e66-2891-4db2-b116-a78aabe974a7 tempest-ProjectReaderTests-1662189440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c1cb8e33-6483-42ac-b4dc-1ff8a730cbf3 1073741824" returned: 0 in 0.419s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:11 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-dbe52e66-2891-4db2-b116-a78aabe974a7 tempest-ProjectReaderTests-1662189440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c1cb8e33-6483-42ac-b4dc-1ff8a730cbf3 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:11 devstack sudo[106054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c1cb8e33-6483-42ac-b4dc-1ff8a730cbf3 Jul 22 03:35:11 devstack sudo[106054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:11 devstack sudo[106054]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:11 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-dbe52e66-2891-4db2-b116-a78aabe974a7 tempest-ProjectReaderTests-1662189440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c1cb8e33-6483-42ac-b4dc-1ff8a730cbf3" returned: 0 in 0.260s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:11 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-dbe52e66-2891-4db2-b116-a78aabe974a7 tempest-ProjectReaderTests-1662189440 None] <== create_volume: return (722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:35:11 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-dbe52e66-2891-4db2-b116-a78aabe974a7 tempest-ProjectReaderTests-1662189440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.726s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:35:11 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-dbe52e66-2891-4db2-b116-a78aabe974a7 tempest-ProjectReaderTests-1662189440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4c9087f-73ab-4fe5-b14e-1d24a619a365) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1cb8e33-6483-42ac-b4dc-1ff8a730cbf3', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:35:11 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-dbe52e66-2891-4db2-b116-a78aabe974a7 tempest-ProjectReaderTests-1662189440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85bbb523-a041-4f45-9011-ac8d013515ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:35:11 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-dbe52e66-2891-4db2-b116-a78aabe974a7 tempest-ProjectReaderTests-1662189440 None] Volume volume-c1cb8e33-6483-42ac-b4dc-1ff8a730cbf3 (c1cb8e33-6483-42ac-b4dc-1ff8a730cbf3): created successfully Jul 22 03:35:11 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-dbe52e66-2891-4db2-b116-a78aabe974a7 tempest-ProjectReaderTests-1662189440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85bbb523-a041-4f45-9011-ac8d013515ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:35:11 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-dbe52e66-2891-4db2-b116-a78aabe974a7 tempest-ProjectReaderTests-1662189440 None] Flow 'volume_create_manager' (7f783647-ef6d-4065-a056-129d48b37106) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:35:11 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-ed06a89b-da00-4ead-a516-3908d0d6dbc6 tempest-ProjectMemberTests-64253088 None] Acquiring lock "cinder-45423fdf-591f-4b79-9103-08f024cb1cfb-delete_snapshot" by "delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:35:11 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-dbe52e66-2891-4db2-b116-a78aabe974a7 tempest-ProjectReaderTests-1662189440 None] Created volume successfully. Jul 22 03:35:11 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-ed06a89b-da00-4ead-a516-3908d0d6dbc6 tempest-ProjectMemberTests-64253088 None] Lock "cinder-45423fdf-591f-4b79-9103-08f024cb1cfb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:35:11 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-ed06a89b-da00-4ead-a516-3908d0d6dbc6 tempest-ProjectMemberTests-64253088 None] Acquiring lock "cinder-quobyte-02bdf016-6166-424e-bd87-8e04e3349ee0" by "delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:35:11 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-ed06a89b-da00-4ead-a516-3908d0d6dbc6 tempest-ProjectMemberTests-64253088 None] Lock "cinder-quobyte-02bdf016-6166-424e-bd87-8e04e3349ee0" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:35:11 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-ed06a89b-da00-4ead-a516-3908d0d6dbc6 tempest-ProjectMemberTests-64253088 None] Acquiring lock "cinder-quobyte-45423fdf-591f-4b79-9103-08f024cb1cfb" by "_delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:35:11 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-ed06a89b-da00-4ead-a516-3908d0d6dbc6 tempest-ProjectMemberTests-64253088 None] Lock "cinder-quobyte-45423fdf-591f-4b79-9103-08f024cb1cfb" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:35:11 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-ed06a89b-da00-4ead-a516-3908d0d6dbc6 tempest-ProjectMemberTests-64253088 None] Deleting offline snapshot 45423fdf-591f-4b79-9103-08f024cb1cfb of volume 02bdf016-6166-424e-bd87-8e04e3349ee0 {{(pid=87747) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 03:35:11 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-ed06a89b-da00-4ead-a516-3908d0d6dbc6 tempest-ProjectMemberTests-64253088 None] snapshot_file for this snap is: volume-02bdf016-6166-424e-bd87-8e04e3349ee0.45423fdf-591f-4b79-9103-08f024cb1cfb {{(pid=87747) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 03:35:11 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[699a7c95-9d3f-476e-9a08-502680894434]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:35:11 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ed06a89b-da00-4ead-a516-3908d0d6dbc6 tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-02bdf016-6166-424e-bd87-8e04e3349ee0.45423fdf-591f-4b79-9103-08f024cb1cfb {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:12 devstack sudo[106057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-02bdf016-6166-424e-bd87-8e04e3349ee0.45423fdf-591f-4b79-9103-08f024cb1cfb Jul 22 03:35:12 devstack sudo[106057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:12 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-70be658c-bd7a-4bdb-93b7-7c461f348ce0 tempest-ProjectReaderTests-483930896 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:35:12 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-70be658c-bd7a-4bdb-93b7-7c461f348ce0 tempest-ProjectReaderTests-483930896 None] Flow 'volume_create_manager' (7d1a4ee0-b4e9-49ad-85e2-8832889287b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:35:12 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-70be658c-bd7a-4bdb-93b7-7c461f348ce0 tempest-ProjectReaderTests-483930896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35fb7fa1-e0b2-4afc-a455-0f6db223238d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:35:12 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-70be658c-bd7a-4bdb-93b7-7c461f348ce0 tempest-ProjectReaderTests-483930896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35fb7fa1-e0b2-4afc-a455-0f6db223238d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:35:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1587773070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbb6aa1c-9876-41ee-8b0c-21a57d3e3dae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd45f1aa7e184c4599e74792f6f4b497',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:35:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:35:12Z,use_quota=True,user_id='222bb0de5f274a1db76ea74beb58d4b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:35:12 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-70be658c-bd7a-4bdb-93b7-7c461f348ce0 tempest-ProjectReaderTests-483930896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71c3bddf-398e-4a7f-912a-b6011b2b02fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:35:12 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-70be658c-bd7a-4bdb-93b7-7c461f348ce0 tempest-ProjectReaderTests-483930896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71c3bddf-398e-4a7f-912a-b6011b2b02fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:35:12 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-70be658c-bd7a-4bdb-93b7-7c461f348ce0 tempest-ProjectReaderTests-483930896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cf20282-fd30-44b3-8643-99a2252bc625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:35:12 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-70be658c-bd7a-4bdb-93b7-7c461f348ce0 tempest-ProjectReaderTests-483930896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cf20282-fd30-44b3-8643-99a2252bc625) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbb6aa1c-9876-41ee-8b0c-21a57d3e3dae', 'volume_name': 'volume-cbb6aa1c-9876-41ee-8b0c-21a57d3e3dae', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:35:12 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-70be658c-bd7a-4bdb-93b7-7c461f348ce0 tempest-ProjectReaderTests-483930896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (724f9452-5626-455c-a143-4aa9bc2e742b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:35:12 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-70be658c-bd7a-4bdb-93b7-7c461f348ce0 tempest-ProjectReaderTests-483930896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (724f9452-5626-455c-a143-4aa9bc2e742b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:35:12 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-70be658c-bd7a-4bdb-93b7-7c461f348ce0 tempest-ProjectReaderTests-483930896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (260d44ee-5468-4387-a772-c9563fa368a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:35:12 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-70be658c-bd7a-4bdb-93b7-7c461f348ce0 tempest-ProjectReaderTests-483930896 None] Volume cbb6aa1c-9876-41ee-8b0c-21a57d3e3dae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbb6aa1c-9876-41ee-8b0c-21a57d3e3dae', 'volume_size': 1} Jul 22 03:35:12 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-70be658c-bd7a-4bdb-93b7-7c461f348ce0 tempest-ProjectReaderTests-483930896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:35:12 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-70be658c-bd7a-4bdb-93b7-7c461f348ce0 tempest-ProjectReaderTests-483930896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:35:12 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-70be658c-bd7a-4bdb-93b7-7c461f348ce0 tempest-ProjectReaderTests-483930896 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:35:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1587773070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbb6aa1c-9876-41ee-8b0c-21a57d3e3dae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd45f1aa7e184c4599e74792f6f4b497',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:35:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:35:12Z,use_quota=True,user_id='222bb0de5f274a1db76ea74beb58d4b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:35:12 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-70be658c-bd7a-4bdb-93b7-7c461f348ce0 tempest-ProjectReaderTests-483930896 None] Creating volume cbb6aa1c-9876-41ee-8b0c-21a57d3e3dae {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:35:12 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-70be658c-bd7a-4bdb-93b7-7c461f348ce0 tempest-ProjectReaderTests-483930896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:35:12 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-70be658c-bd7a-4bdb-93b7-7c461f348ce0 tempest-ProjectReaderTests-483930896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:35:12 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-70be658c-bd7a-4bdb-93b7-7c461f348ce0 tempest-ProjectReaderTests-483930896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:35:12 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-70be658c-bd7a-4bdb-93b7-7c461f348ce0 tempest-ProjectReaderTests-483930896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:35:12 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-70be658c-bd7a-4bdb-93b7-7c461f348ce0 tempest-ProjectReaderTests-483930896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:35:12 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-70be658c-bd7a-4bdb-93b7-7c461f348ce0 tempest-ProjectReaderTests-483930896 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:35:12 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-70be658c-bd7a-4bdb-93b7-7c461f348ce0 tempest-ProjectReaderTests-483930896 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:35:12 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-70be658c-bd7a-4bdb-93b7-7c461f348ce0 tempest-ProjectReaderTests-483930896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-cbb6aa1c-9876-41ee-8b0c-21a57d3e3dae 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:12 devstack sudo[106061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-cbb6aa1c-9876-41ee-8b0c-21a57d3e3dae 1073741824 Jul 22 03:35:12 devstack sudo[106061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:12 devstack sudo[106057]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:12 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ed06a89b-da00-4ead-a516-3908d0d6dbc6 tempest-ProjectMemberTests-64253088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-02bdf016-6166-424e-bd87-8e04e3349ee0.45423fdf-591f-4b79-9103-08f024cb1cfb" returned: 0 in 0.471s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:12 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-ed06a89b-da00-4ead-a516-3908d0d6dbc6 tempest-ProjectMemberTests-64253088 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-02bdf016-6166-424e-bd87-8e04e3349ee0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87747) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 03:35:12 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e23fc12-b72b-4a4e-ac2e-981623391eb5]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:35:12 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ed06a89b-da00-4ead-a516-3908d0d6dbc6 tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-02bdf016-6166-424e-bd87-8e04e3349ee0 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:12 devstack sudo[106064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-02bdf016-6166-424e-bd87-8e04e3349ee0 Jul 22 03:35:12 devstack sudo[106064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:12 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-3b7a14cf-bb53-4ce7-a049-773a254265f1 tempest-ProjectReaderTests-1662189440 None] Acquiring lock "cinder-c1cb8e33-6483-42ac-b4dc-1ff8a730cbf3-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:35:12 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-3b7a14cf-bb53-4ce7-a049-773a254265f1 tempest-ProjectReaderTests-1662189440 None] Lock "cinder-c1cb8e33-6483-42ac-b4dc-1ff8a730cbf3-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:35:12 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-3b7a14cf-bb53-4ce7-a049-773a254265f1 tempest-ProjectReaderTests-1662189440 None] Acquiring lock "cinder-quobyte-c1cb8e33-6483-42ac-b4dc-1ff8a730cbf3" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:35:12 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-3b7a14cf-bb53-4ce7-a049-773a254265f1 tempest-ProjectReaderTests-1662189440 None] Lock "cinder-quobyte-c1cb8e33-6483-42ac-b4dc-1ff8a730cbf3" acquired by "delete_volume" :: waited 0.022s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:35:12 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[31cf053c-1c8c-44e1-8532-9cc54d509bba]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:35:12 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-3b7a14cf-bb53-4ce7-a049-773a254265f1 tempest-ProjectReaderTests-1662189440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c1cb8e33-6483-42ac-b4dc-1ff8a730cbf3 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:12 devstack sudo[106061]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:12 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-70be658c-bd7a-4bdb-93b7-7c461f348ce0 tempest-ProjectReaderTests-483930896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-cbb6aa1c-9876-41ee-8b0c-21a57d3e3dae 1073741824" returned: 0 in 0.567s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:12 devstack sudo[106070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c1cb8e33-6483-42ac-b4dc-1ff8a730cbf3 Jul 22 03:35:12 devstack sudo[106070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:12 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-70be658c-bd7a-4bdb-93b7-7c461f348ce0 tempest-ProjectReaderTests-483930896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-cbb6aa1c-9876-41ee-8b0c-21a57d3e3dae {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:12 devstack sudo[106064]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:12 devstack sudo[106075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-cbb6aa1c-9876-41ee-8b0c-21a57d3e3dae Jul 22 03:35:12 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ed06a89b-da00-4ead-a516-3908d0d6dbc6 tempest-ProjectMemberTests-64253088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-02bdf016-6166-424e-bd87-8e04e3349ee0" returned: 0 in 0.532s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:12 devstack sudo[106075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:12 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ed06a89b-da00-4ead-a516-3908d0d6dbc6 tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-02bdf016-6166-424e-bd87-8e04e3349ee0.45423fdf-591f-4b79-9103-08f024cb1cfb {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:12 devstack sudo[106077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-02bdf016-6166-424e-bd87-8e04e3349ee0.45423fdf-591f-4b79-9103-08f024cb1cfb Jul 22 03:35:13 devstack sudo[106077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:13 devstack sudo[106070]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:13 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-3b7a14cf-bb53-4ce7-a049-773a254265f1 tempest-ProjectReaderTests-1662189440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c1cb8e33-6483-42ac-b4dc-1ff8a730cbf3" returned: 0 in 0.477s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:13 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-3b7a14cf-bb53-4ce7-a049-773a254265f1 tempest-ProjectReaderTests-1662189440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c1cb8e33-6483-42ac-b4dc-1ff8a730cbf3 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:13 devstack sudo[106075]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:13 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-70be658c-bd7a-4bdb-93b7-7c461f348ce0 tempest-ProjectReaderTests-483930896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-cbb6aa1c-9876-41ee-8b0c-21a57d3e3dae" returned: 0 in 0.320s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:13 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-70be658c-bd7a-4bdb-93b7-7c461f348ce0 tempest-ProjectReaderTests-483930896 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:35:13 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-70be658c-bd7a-4bdb-93b7-7c461f348ce0 tempest-ProjectReaderTests-483930896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:35:13 devstack sudo[106083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c1cb8e33-6483-42ac-b4dc-1ff8a730cbf3 Jul 22 03:35:13 devstack sudo[106083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:13 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-70be658c-bd7a-4bdb-93b7-7c461f348ce0 tempest-ProjectReaderTests-483930896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (260d44ee-5468-4387-a772-c9563fa368a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbb6aa1c-9876-41ee-8b0c-21a57d3e3dae', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:35:13 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-70be658c-bd7a-4bdb-93b7-7c461f348ce0 tempest-ProjectReaderTests-483930896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12832908-3920-4a72-bd99-e4e999dd88d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:35:13 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-70be658c-bd7a-4bdb-93b7-7c461f348ce0 tempest-ProjectReaderTests-483930896 None] Volume volume-cbb6aa1c-9876-41ee-8b0c-21a57d3e3dae (cbb6aa1c-9876-41ee-8b0c-21a57d3e3dae): created successfully Jul 22 03:35:13 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-70be658c-bd7a-4bdb-93b7-7c461f348ce0 tempest-ProjectReaderTests-483930896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12832908-3920-4a72-bd99-e4e999dd88d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:35:13 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-70be658c-bd7a-4bdb-93b7-7c461f348ce0 tempest-ProjectReaderTests-483930896 None] Flow 'volume_create_manager' (7d1a4ee0-b4e9-49ad-85e2-8832889287b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:35:13 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-70be658c-bd7a-4bdb-93b7-7c461f348ce0 tempest-ProjectReaderTests-483930896 None] Created volume successfully. Jul 22 03:35:13 devstack sudo[106077]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:13 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ed06a89b-da00-4ead-a516-3908d0d6dbc6 tempest-ProjectMemberTests-64253088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-02bdf016-6166-424e-bd87-8e04e3349ee0.45423fdf-591f-4b79-9103-08f024cb1cfb" returned: 0 in 0.494s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:13 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ed06a89b-da00-4ead-a516-3908d0d6dbc6 tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-02bdf016-6166-424e-bd87-8e04e3349ee0.45423fdf-591f-4b79-9103-08f024cb1cfb {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:13 devstack sudo[106091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-02bdf016-6166-424e-bd87-8e04e3349ee0.45423fdf-591f-4b79-9103-08f024cb1cfb Jul 22 03:35:13 devstack sudo[106091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:13 devstack sudo[106083]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:13 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-3b7a14cf-bb53-4ce7-a049-773a254265f1 tempest-ProjectReaderTests-1662189440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-c1cb8e33-6483-42ac-b4dc-1ff8a730cbf3" returned: 0 in 0.322s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:13 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-3b7a14cf-bb53-4ce7-a049-773a254265f1 tempest-ProjectReaderTests-1662189440 None] Lock "cinder-quobyte-c1cb8e33-6483-42ac-b4dc-1ff8a730cbf3" released by "delete_volume" :: held 0.842s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:35:13 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-3b7a14cf-bb53-4ce7-a049-773a254265f1 tempest-ProjectReaderTests-1662189440 None] Created reservations ['900c99d9-fb8b-4939-857d-61fa7abcea64', '8697de80-6e7c-43b9-a0a4-a3fe5e2724ec', '1c0bff87-c68a-419c-95bc-751b1134e213', '09cbeb86-94e3-428f-9dca-ec8e77299225'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:35:13 devstack sudo[106091]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:13 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ed06a89b-da00-4ead-a516-3908d0d6dbc6 tempest-ProjectMemberTests-64253088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-02bdf016-6166-424e-bd87-8e04e3349ee0.45423fdf-591f-4b79-9103-08f024cb1cfb" returned: 0 in 0.276s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:13 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-ed06a89b-da00-4ead-a516-3908d0d6dbc6 tempest-ProjectMemberTests-64253088 None] Lock "cinder-quobyte-45423fdf-591f-4b79-9103-08f024cb1cfb" released by "_delete_snapshot" :: held 1.907s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:35:13 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-ed06a89b-da00-4ead-a516-3908d0d6dbc6 tempest-ProjectMemberTests-64253088 None] Lock "cinder-quobyte-02bdf016-6166-424e-bd87-8e04e3349ee0" released by "delete_snapshot" :: held 1.959s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:35:13 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-3b7a14cf-bb53-4ce7-a049-773a254265f1 tempest-ProjectReaderTests-1662189440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:35:13 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-3b7a14cf-bb53-4ce7-a049-773a254265f1 tempest-ProjectReaderTests-1662189440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:35:13 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-3b7a14cf-bb53-4ce7-a049-773a254265f1 tempest-ProjectReaderTests-1662189440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:35:13 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-3b7a14cf-bb53-4ce7-a049-773a254265f1 tempest-ProjectReaderTests-1662189440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:35:13 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-3b7a14cf-bb53-4ce7-a049-773a254265f1 tempest-ProjectReaderTests-1662189440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:35:13 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-3b7a14cf-bb53-4ce7-a049-773a254265f1 tempest-ProjectReaderTests-1662189440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:13 devstack sudo[106095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:35:13 devstack sudo[106095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:13 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-ed06a89b-da00-4ead-a516-3908d0d6dbc6 tempest-ProjectMemberTests-64253088 None] Created reservations ['18191621-d7be-4850-aa53-329450a6bd5f', '1161caaf-bba1-4fab-b8e9-f2fe6dc9a1c0', 'e9587ae1-ef80-4370-a096-a1db645377f4', '1de57036-6ddf-4966-a1ad-9f893fb9c9a2'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:35:14 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-ed06a89b-da00-4ead-a516-3908d0d6dbc6 tempest-ProjectMemberTests-64253088 None] Delete snapshot completed successfully. Jul 22 03:35:14 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-ed06a89b-da00-4ead-a516-3908d0d6dbc6 tempest-ProjectMemberTests-64253088 None] Lock "cinder-45423fdf-591f-4b79-9103-08f024cb1cfb-delete_snapshot" released by "delete_snapshot" :: held 2.212s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:35:14 devstack sudo[106095]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:14 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-3b7a14cf-bb53-4ce7-a049-773a254265f1 tempest-ProjectReaderTests-1662189440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.292s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:14 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-3b7a14cf-bb53-4ce7-a049-773a254265f1 tempest-ProjectReaderTests-1662189440 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:35:14 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-3b7a14cf-bb53-4ce7-a049-773a254265f1 tempest-ProjectReaderTests-1662189440 None] Deleted volume successfully. Jul 22 03:35:14 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-3b7a14cf-bb53-4ce7-a049-773a254265f1 tempest-ProjectReaderTests-1662189440 None] Lock "cinder-c1cb8e33-6483-42ac-b4dc-1ff8a730cbf3-delete_volume" released by "delete_volume" :: held 1.568s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:35:14 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-59e907cc-662a-4760-87e7-26b5639b350f tempest-ProjectReaderTests-483930896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:35:14 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-59e907cc-662a-4760-87e7-26b5639b350f tempest-ProjectReaderTests-483930896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:35:14 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-59e907cc-662a-4760-87e7-26b5639b350f tempest-ProjectReaderTests-483930896 None] Creating offline snapshot 392b1979-db15-42ab-b7a3-eba4a64fb6df of volume cbb6aa1c-9876-41ee-8b0c-21a57d3e3dae {{(pid=87747) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 03:35:14 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[44e987f1-10bb-4e23-9666-b0f857243496]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:35:14 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-59e907cc-662a-4760-87e7-26b5639b350f tempest-ProjectReaderTests-483930896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-cbb6aa1c-9876-41ee-8b0c-21a57d3e3dae {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:14 devstack sudo[106098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-cbb6aa1c-9876-41ee-8b0c-21a57d3e3dae Jul 22 03:35:14 devstack sudo[106098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:14 devstack sudo[106098]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:14 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-59e907cc-662a-4760-87e7-26b5639b350f tempest-ProjectReaderTests-483930896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-cbb6aa1c-9876-41ee-8b0c-21a57d3e3dae" returned: 0 in 0.416s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:14 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-59e907cc-662a-4760-87e7-26b5639b350f tempest-ProjectReaderTests-483930896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-cbb6aa1c-9876-41ee-8b0c-21a57d3e3dae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-cbb6aa1c-9876-41ee-8b0c-21a57d3e3dae.392b1979-db15-42ab-b7a3-eba4a64fb6df 1G {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:14 devstack sudo[106103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-cbb6aa1c-9876-41ee-8b0c-21a57d3e3dae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-cbb6aa1c-9876-41ee-8b0c-21a57d3e3dae.392b1979-db15-42ab-b7a3-eba4a64fb6df 1G Jul 22 03:35:14 devstack sudo[106103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:15 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-f1c47839-d85f-46d1-84d4-d4559342056e tempest-ProjectMemberTests-64253088 None] Acquiring lock "cinder-02bdf016-6166-424e-bd87-8e04e3349ee0-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:35:15 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-f1c47839-d85f-46d1-84d4-d4559342056e tempest-ProjectMemberTests-64253088 None] Lock "cinder-02bdf016-6166-424e-bd87-8e04e3349ee0-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:35:15 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-f1c47839-d85f-46d1-84d4-d4559342056e tempest-ProjectMemberTests-64253088 None] Acquiring lock "cinder-quobyte-02bdf016-6166-424e-bd87-8e04e3349ee0" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:35:15 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-f1c47839-d85f-46d1-84d4-d4559342056e tempest-ProjectMemberTests-64253088 None] Lock "cinder-quobyte-02bdf016-6166-424e-bd87-8e04e3349ee0" acquired by "delete_volume" :: waited 0.032s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:35:15 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c13a5d0-f874-4f60-a991-a4d651cf1964]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:35:15 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f1c47839-d85f-46d1-84d4-d4559342056e tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-02bdf016-6166-424e-bd87-8e04e3349ee0 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:15 devstack sudo[106107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-02bdf016-6166-424e-bd87-8e04e3349ee0 Jul 22 03:35:15 devstack sudo[106107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:15 devstack sudo[106103]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:15 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-59e907cc-662a-4760-87e7-26b5639b350f tempest-ProjectReaderTests-483930896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-cbb6aa1c-9876-41ee-8b0c-21a57d3e3dae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-cbb6aa1c-9876-41ee-8b0c-21a57d3e3dae.392b1979-db15-42ab-b7a3-eba4a64fb6df 1G" returned: 0 in 0.618s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:15 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-59e907cc-662a-4760-87e7-26b5639b350f tempest-ProjectReaderTests-483930896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cbb6aa1c-9876-41ee-8b0c-21a57d3e3dae -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-cbb6aa1c-9876-41ee-8b0c-21a57d3e3dae.392b1979-db15-42ab-b7a3-eba4a64fb6df {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:15 devstack sudo[106113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cbb6aa1c-9876-41ee-8b0c-21a57d3e3dae -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-cbb6aa1c-9876-41ee-8b0c-21a57d3e3dae.392b1979-db15-42ab-b7a3-eba4a64fb6df Jul 22 03:35:15 devstack sudo[106113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:15 devstack sudo[106107]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:15 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f1c47839-d85f-46d1-84d4-d4559342056e tempest-ProjectMemberTests-64253088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-02bdf016-6166-424e-bd87-8e04e3349ee0" returned: 0 in 0.432s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:15 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f1c47839-d85f-46d1-84d4-d4559342056e tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-02bdf016-6166-424e-bd87-8e04e3349ee0 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:15 devstack sudo[106117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-02bdf016-6166-424e-bd87-8e04e3349ee0 Jul 22 03:35:15 devstack sudo[106117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:16 devstack sudo[106113]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:16 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-59e907cc-662a-4760-87e7-26b5639b350f tempest-ProjectReaderTests-483930896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cbb6aa1c-9876-41ee-8b0c-21a57d3e3dae -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-cbb6aa1c-9876-41ee-8b0c-21a57d3e3dae.392b1979-db15-42ab-b7a3-eba4a64fb6df" returned: 0 in 0.440s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:16 devstack cinder-volume[87747]: WARNING cinder.volume.drivers.remotefs [None req-59e907cc-662a-4760-87e7-26b5639b350f tempest-ProjectReaderTests-483930896 None] /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-cbb6aa1c-9876-41ee-8b0c-21a57d3e3dae.392b1979-db15-42ab-b7a3-eba4a64fb6df is being set with open permissions: ugo+rw Jul 22 03:35:16 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-59e907cc-662a-4760-87e7-26b5639b350f tempest-ProjectReaderTests-483930896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-cbb6aa1c-9876-41ee-8b0c-21a57d3e3dae.392b1979-db15-42ab-b7a3-eba4a64fb6df {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:16 devstack sudo[106124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-cbb6aa1c-9876-41ee-8b0c-21a57d3e3dae.392b1979-db15-42ab-b7a3-eba4a64fb6df Jul 22 03:35:16 devstack sudo[106124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:16 devstack sudo[106117]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:16 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f1c47839-d85f-46d1-84d4-d4559342056e tempest-ProjectMemberTests-64253088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-02bdf016-6166-424e-bd87-8e04e3349ee0" returned: 0 in 0.349s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:16 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-f1c47839-d85f-46d1-84d4-d4559342056e tempest-ProjectMemberTests-64253088 None] Lock "cinder-quobyte-02bdf016-6166-424e-bd87-8e04e3349ee0" released by "delete_volume" :: held 0.921s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:35:16 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-f1c47839-d85f-46d1-84d4-d4559342056e tempest-ProjectMemberTests-64253088 None] Created reservations ['7b51e5ef-e332-4093-853a-f45153f857ce', '04d44206-bee5-456f-a608-730fdf2312bb', 'bb77eac7-0871-4082-97f9-edd92b177583', '22b6c021-d481-47fc-9d3a-a80d5891d305'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:35:16 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-f1c47839-d85f-46d1-84d4-d4559342056e tempest-ProjectMemberTests-64253088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:35:16 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-f1c47839-d85f-46d1-84d4-d4559342056e tempest-ProjectMemberTests-64253088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:35:16 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-f1c47839-d85f-46d1-84d4-d4559342056e tempest-ProjectMemberTests-64253088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:35:16 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-f1c47839-d85f-46d1-84d4-d4559342056e tempest-ProjectMemberTests-64253088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:35:16 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-f1c47839-d85f-46d1-84d4-d4559342056e tempest-ProjectMemberTests-64253088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:35:16 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f1c47839-d85f-46d1-84d4-d4559342056e tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:16 devstack sudo[106126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:35:16 devstack sudo[106126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:16 devstack sudo[106124]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:16 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-59e907cc-662a-4760-87e7-26b5639b350f tempest-ProjectReaderTests-483930896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-cbb6aa1c-9876-41ee-8b0c-21a57d3e3dae.392b1979-db15-42ab-b7a3-eba4a64fb6df" returned: 0 in 0.372s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:16 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-59e907cc-662a-4760-87e7-26b5639b350f tempest-ProjectReaderTests-483930896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-cbb6aa1c-9876-41ee-8b0c-21a57d3e3dae.info {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:16 devstack sudo[106129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-cbb6aa1c-9876-41ee-8b0c-21a57d3e3dae.info Jul 22 03:35:16 devstack sudo[106129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:16 devstack sudo[106126]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:16 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f1c47839-d85f-46d1-84d4-d4559342056e tempest-ProjectMemberTests-64253088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.257s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:16 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-f1c47839-d85f-46d1-84d4-d4559342056e tempest-ProjectMemberTests-64253088 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:35:16 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-f1c47839-d85f-46d1-84d4-d4559342056e tempest-ProjectMemberTests-64253088 None] Deleted volume successfully. Jul 22 03:35:16 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-f1c47839-d85f-46d1-84d4-d4559342056e tempest-ProjectMemberTests-64253088 None] Lock "cinder-02bdf016-6166-424e-bd87-8e04e3349ee0-delete_volume" released by "delete_volume" :: held 1.555s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:35:16 devstack sudo[106129]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:16 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-59e907cc-662a-4760-87e7-26b5639b350f tempest-ProjectReaderTests-483930896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-cbb6aa1c-9876-41ee-8b0c-21a57d3e3dae.info" returned: 0 in 0.337s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:16 devstack cinder-volume[87747]: WARNING cinder.volume.drivers.remotefs [None req-59e907cc-662a-4760-87e7-26b5639b350f tempest-ProjectReaderTests-483930896 None] /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-cbb6aa1c-9876-41ee-8b0c-21a57d3e3dae.info is being set with open permissions: ugo+rw Jul 22 03:35:16 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-59e907cc-662a-4760-87e7-26b5639b350f tempest-ProjectReaderTests-483930896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-cbb6aa1c-9876-41ee-8b0c-21a57d3e3dae.info {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:16 devstack sudo[106133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-cbb6aa1c-9876-41ee-8b0c-21a57d3e3dae.info Jul 22 03:35:16 devstack sudo[106133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:17 devstack sudo[106133]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:17 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-59e907cc-662a-4760-87e7-26b5639b350f tempest-ProjectReaderTests-483930896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-cbb6aa1c-9876-41ee-8b0c-21a57d3e3dae.info" returned: 0 in 0.260s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:17 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-59e907cc-662a-4760-87e7-26b5639b350f tempest-ProjectReaderTests-483930896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.535s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:35:17 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-59e907cc-662a-4760-87e7-26b5639b350f tempest-ProjectReaderTests-483930896 None] Create snapshot completed successfully Jul 22 03:35:17 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-5cb27f8d-4cbb-4d08-8f00-60e3bebb8cd8 tempest-ProjectReaderTests-483930896 None] Acquiring lock "cinder-392b1979-db15-42ab-b7a3-eba4a64fb6df-delete_snapshot" by "delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:35:17 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-5cb27f8d-4cbb-4d08-8f00-60e3bebb8cd8 tempest-ProjectReaderTests-483930896 None] Lock "cinder-392b1979-db15-42ab-b7a3-eba4a64fb6df-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:35:17 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-5cb27f8d-4cbb-4d08-8f00-60e3bebb8cd8 tempest-ProjectReaderTests-483930896 None] Acquiring lock "cinder-quobyte-cbb6aa1c-9876-41ee-8b0c-21a57d3e3dae" by "delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:35:17 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-5cb27f8d-4cbb-4d08-8f00-60e3bebb8cd8 tempest-ProjectReaderTests-483930896 None] Lock "cinder-quobyte-cbb6aa1c-9876-41ee-8b0c-21a57d3e3dae" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:35:17 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-5cb27f8d-4cbb-4d08-8f00-60e3bebb8cd8 tempest-ProjectReaderTests-483930896 None] Acquiring lock "cinder-quobyte-392b1979-db15-42ab-b7a3-eba4a64fb6df" by "_delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:35:17 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-5cb27f8d-4cbb-4d08-8f00-60e3bebb8cd8 tempest-ProjectReaderTests-483930896 None] Lock "cinder-quobyte-392b1979-db15-42ab-b7a3-eba4a64fb6df" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:35:17 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-5cb27f8d-4cbb-4d08-8f00-60e3bebb8cd8 tempest-ProjectReaderTests-483930896 None] Deleting offline snapshot 392b1979-db15-42ab-b7a3-eba4a64fb6df of volume cbb6aa1c-9876-41ee-8b0c-21a57d3e3dae {{(pid=87747) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 03:35:17 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-5cb27f8d-4cbb-4d08-8f00-60e3bebb8cd8 tempest-ProjectReaderTests-483930896 None] snapshot_file for this snap is: volume-cbb6aa1c-9876-41ee-8b0c-21a57d3e3dae.392b1979-db15-42ab-b7a3-eba4a64fb6df {{(pid=87747) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 03:35:17 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[456a24fa-c901-4929-80ce-4f75d3841541]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:35:17 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5cb27f8d-4cbb-4d08-8f00-60e3bebb8cd8 tempest-ProjectReaderTests-483930896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-cbb6aa1c-9876-41ee-8b0c-21a57d3e3dae.392b1979-db15-42ab-b7a3-eba4a64fb6df {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:17 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d933857-5436-4f0c-a4c2-2440a95d3de1 tempest-ProjectMemberTests-64253088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:35:17 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-5d933857-5436-4f0c-a4c2-2440a95d3de1 tempest-ProjectMemberTests-64253088 None] Flow 'volume_create_manager' (1e2ab13b-f31d-43ef-8a13-f72a1ec63e6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:35:17 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-5d933857-5436-4f0c-a4c2-2440a95d3de1 tempest-ProjectMemberTests-64253088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31e04259-6325-4e6f-9403-7bc8eb7ee369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:35:17 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-5d933857-5436-4f0c-a4c2-2440a95d3de1 tempest-ProjectMemberTests-64253088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31e04259-6325-4e6f-9403-7bc8eb7ee369) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:35:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-436898099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2f1225e-8d1a-4ce3-a38f-ac27e770b1ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05eb3b4eac3e4ffe97247852227f9ffa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:35:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:35:18Z,use_quota=True,user_id='ecf77e3a2be443e28cffe6ba02afc5e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:35:17 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-5d933857-5436-4f0c-a4c2-2440a95d3de1 tempest-ProjectMemberTests-64253088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b097b1b5-3d3d-4c0e-81f4-dccaff60d590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:35:17 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-5d933857-5436-4f0c-a4c2-2440a95d3de1 tempest-ProjectMemberTests-64253088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b097b1b5-3d3d-4c0e-81f4-dccaff60d590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:35:17 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-5d933857-5436-4f0c-a4c2-2440a95d3de1 tempest-ProjectMemberTests-64253088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cca19d52-1613-4f59-98c6-42024378588f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:35:18 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-5d933857-5436-4f0c-a4c2-2440a95d3de1 tempest-ProjectMemberTests-64253088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cca19d52-1613-4f59-98c6-42024378588f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2f1225e-8d1a-4ce3-a38f-ac27e770b1ac', 'volume_name': 'volume-d2f1225e-8d1a-4ce3-a38f-ac27e770b1ac', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:35:18 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-5d933857-5436-4f0c-a4c2-2440a95d3de1 tempest-ProjectMemberTests-64253088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29c868e1-2358-410d-b928-6af6225220ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:35:18 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-5d933857-5436-4f0c-a4c2-2440a95d3de1 tempest-ProjectMemberTests-64253088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29c868e1-2358-410d-b928-6af6225220ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:35:18 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-5d933857-5436-4f0c-a4c2-2440a95d3de1 tempest-ProjectMemberTests-64253088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44466daf-1c8e-4c2a-ab92-9fa98027a49e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:35:18 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-5d933857-5436-4f0c-a4c2-2440a95d3de1 tempest-ProjectMemberTests-64253088 None] Volume d2f1225e-8d1a-4ce3-a38f-ac27e770b1ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2f1225e-8d1a-4ce3-a38f-ac27e770b1ac', 'volume_size': 1} Jul 22 03:35:18 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-5d933857-5436-4f0c-a4c2-2440a95d3de1 tempest-ProjectMemberTests-64253088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:35:18 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-5d933857-5436-4f0c-a4c2-2440a95d3de1 tempest-ProjectMemberTests-64253088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:35:18 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-5d933857-5436-4f0c-a4c2-2440a95d3de1 tempest-ProjectMemberTests-64253088 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:35:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-436898099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2f1225e-8d1a-4ce3-a38f-ac27e770b1ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05eb3b4eac3e4ffe97247852227f9ffa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:35:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:35:18Z,use_quota=True,user_id='ecf77e3a2be443e28cffe6ba02afc5e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:35:18 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-5d933857-5436-4f0c-a4c2-2440a95d3de1 tempest-ProjectMemberTests-64253088 None] Creating volume d2f1225e-8d1a-4ce3-a38f-ac27e770b1ac {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:35:18 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-5d933857-5436-4f0c-a4c2-2440a95d3de1 tempest-ProjectMemberTests-64253088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:35:18 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-5d933857-5436-4f0c-a4c2-2440a95d3de1 tempest-ProjectMemberTests-64253088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:35:18 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-5d933857-5436-4f0c-a4c2-2440a95d3de1 tempest-ProjectMemberTests-64253088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:35:18 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-5d933857-5436-4f0c-a4c2-2440a95d3de1 tempest-ProjectMemberTests-64253088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:35:18 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-5d933857-5436-4f0c-a4c2-2440a95d3de1 tempest-ProjectMemberTests-64253088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:35:18 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-5d933857-5436-4f0c-a4c2-2440a95d3de1 tempest-ProjectMemberTests-64253088 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:35:18 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-5d933857-5436-4f0c-a4c2-2440a95d3de1 tempest-ProjectMemberTests-64253088 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:35:18 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5d933857-5436-4f0c-a4c2-2440a95d3de1 tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d2f1225e-8d1a-4ce3-a38f-ac27e770b1ac 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:18 devstack sudo[106137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-cbb6aa1c-9876-41ee-8b0c-21a57d3e3dae.392b1979-db15-42ab-b7a3-eba4a64fb6df Jul 22 03:35:18 devstack sudo[106137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:18 devstack sudo[106139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d2f1225e-8d1a-4ce3-a38f-ac27e770b1ac 1073741824 Jul 22 03:35:18 devstack sudo[106139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:18 devstack sudo[106137]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:18 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5cb27f8d-4cbb-4d08-8f00-60e3bebb8cd8 tempest-ProjectReaderTests-483930896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-cbb6aa1c-9876-41ee-8b0c-21a57d3e3dae.392b1979-db15-42ab-b7a3-eba4a64fb6df" returned: 0 in 0.393s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:18 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-5cb27f8d-4cbb-4d08-8f00-60e3bebb8cd8 tempest-ProjectReaderTests-483930896 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cbb6aa1c-9876-41ee-8b0c-21a57d3e3dae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87747) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 03:35:18 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5925b6a-8a7c-4e51-9dfc-0768a78e5408]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:35:18 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5cb27f8d-4cbb-4d08-8f00-60e3bebb8cd8 tempest-ProjectReaderTests-483930896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-cbb6aa1c-9876-41ee-8b0c-21a57d3e3dae {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:18 devstack sudo[106148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-cbb6aa1c-9876-41ee-8b0c-21a57d3e3dae Jul 22 03:35:18 devstack sudo[106148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:18 devstack sudo[106139]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:18 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5d933857-5436-4f0c-a4c2-2440a95d3de1 tempest-ProjectMemberTests-64253088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d2f1225e-8d1a-4ce3-a38f-ac27e770b1ac 1073741824" returned: 0 in 0.491s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:18 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5d933857-5436-4f0c-a4c2-2440a95d3de1 tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d2f1225e-8d1a-4ce3-a38f-ac27e770b1ac {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:18 devstack sudo[106151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d2f1225e-8d1a-4ce3-a38f-ac27e770b1ac Jul 22 03:35:18 devstack sudo[106151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:18 devstack sudo[106148]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:18 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5cb27f8d-4cbb-4d08-8f00-60e3bebb8cd8 tempest-ProjectReaderTests-483930896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-cbb6aa1c-9876-41ee-8b0c-21a57d3e3dae" returned: 0 in 0.425s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:18 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5cb27f8d-4cbb-4d08-8f00-60e3bebb8cd8 tempest-ProjectReaderTests-483930896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-cbb6aa1c-9876-41ee-8b0c-21a57d3e3dae.392b1979-db15-42ab-b7a3-eba4a64fb6df {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:18 devstack sudo[106156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-cbb6aa1c-9876-41ee-8b0c-21a57d3e3dae.392b1979-db15-42ab-b7a3-eba4a64fb6df Jul 22 03:35:18 devstack sudo[106156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:18 devstack sudo[106151]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:18 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5d933857-5436-4f0c-a4c2-2440a95d3de1 tempest-ProjectMemberTests-64253088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d2f1225e-8d1a-4ce3-a38f-ac27e770b1ac" returned: 0 in 0.292s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:18 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-5d933857-5436-4f0c-a4c2-2440a95d3de1 tempest-ProjectMemberTests-64253088 None] <== create_volume: return (847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:35:18 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-5d933857-5436-4f0c-a4c2-2440a95d3de1 tempest-ProjectMemberTests-64253088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.850s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:35:18 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-5d933857-5436-4f0c-a4c2-2440a95d3de1 tempest-ProjectMemberTests-64253088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44466daf-1c8e-4c2a-ab92-9fa98027a49e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2f1225e-8d1a-4ce3-a38f-ac27e770b1ac', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:35:18 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-5d933857-5436-4f0c-a4c2-2440a95d3de1 tempest-ProjectMemberTests-64253088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (353c445c-5b7e-4b71-b1ab-e2f834d6160d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:35:18 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-5d933857-5436-4f0c-a4c2-2440a95d3de1 tempest-ProjectMemberTests-64253088 None] Volume volume-d2f1225e-8d1a-4ce3-a38f-ac27e770b1ac (d2f1225e-8d1a-4ce3-a38f-ac27e770b1ac): created successfully Jul 22 03:35:18 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-5d933857-5436-4f0c-a4c2-2440a95d3de1 tempest-ProjectMemberTests-64253088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (353c445c-5b7e-4b71-b1ab-e2f834d6160d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:35:18 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-5d933857-5436-4f0c-a4c2-2440a95d3de1 tempest-ProjectMemberTests-64253088 None] Flow 'volume_create_manager' (1e2ab13b-f31d-43ef-8a13-f72a1ec63e6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:35:18 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-5d933857-5436-4f0c-a4c2-2440a95d3de1 tempest-ProjectMemberTests-64253088 None] Created volume successfully. Jul 22 03:35:19 devstack sudo[106156]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:19 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5cb27f8d-4cbb-4d08-8f00-60e3bebb8cd8 tempest-ProjectReaderTests-483930896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-cbb6aa1c-9876-41ee-8b0c-21a57d3e3dae.392b1979-db15-42ab-b7a3-eba4a64fb6df" returned: 0 in 0.374s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:19 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5cb27f8d-4cbb-4d08-8f00-60e3bebb8cd8 tempest-ProjectReaderTests-483930896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-cbb6aa1c-9876-41ee-8b0c-21a57d3e3dae.392b1979-db15-42ab-b7a3-eba4a64fb6df {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:19 devstack sudo[106163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-cbb6aa1c-9876-41ee-8b0c-21a57d3e3dae.392b1979-db15-42ab-b7a3-eba4a64fb6df Jul 22 03:35:19 devstack sudo[106163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:19 devstack sudo[106163]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:19 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5cb27f8d-4cbb-4d08-8f00-60e3bebb8cd8 tempest-ProjectReaderTests-483930896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-cbb6aa1c-9876-41ee-8b0c-21a57d3e3dae.392b1979-db15-42ab-b7a3-eba4a64fb6df" returned: 0 in 0.260s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:19 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-5cb27f8d-4cbb-4d08-8f00-60e3bebb8cd8 tempest-ProjectReaderTests-483930896 None] Lock "cinder-quobyte-392b1979-db15-42ab-b7a3-eba4a64fb6df" released by "_delete_snapshot" :: held 1.555s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:35:19 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-5cb27f8d-4cbb-4d08-8f00-60e3bebb8cd8 tempest-ProjectReaderTests-483930896 None] Lock "cinder-quobyte-cbb6aa1c-9876-41ee-8b0c-21a57d3e3dae" released by "delete_snapshot" :: held 1.579s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:35:19 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-5cb27f8d-4cbb-4d08-8f00-60e3bebb8cd8 tempest-ProjectReaderTests-483930896 None] Created reservations ['ce08ecde-4e94-4198-b97d-bb9c53b2fe08', '83a2d661-1428-4d5a-ae26-9727a2d80569', '65f91c4f-d30b-43d3-ac67-6d86b0056d49', 'c1a7c4ed-9a90-405c-abc1-0917d1a4db3d'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:35:19 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-5cb27f8d-4cbb-4d08-8f00-60e3bebb8cd8 tempest-ProjectReaderTests-483930896 None] Delete snapshot completed successfully. Jul 22 03:35:19 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-5cb27f8d-4cbb-4d08-8f00-60e3bebb8cd8 tempest-ProjectReaderTests-483930896 None] Lock "cinder-392b1979-db15-42ab-b7a3-eba4a64fb6df-delete_snapshot" released by "delete_snapshot" :: held 1.719s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:35:19 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-1e8f080a-eb32-4da7-997a-665eb30d17db tempest-ProjectReaderTests-483930896 None] Acquiring lock "cinder-cbb6aa1c-9876-41ee-8b0c-21a57d3e3dae-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:35:19 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-1e8f080a-eb32-4da7-997a-665eb30d17db tempest-ProjectReaderTests-483930896 None] Lock "cinder-cbb6aa1c-9876-41ee-8b0c-21a57d3e3dae-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:35:20 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-1e8f080a-eb32-4da7-997a-665eb30d17db tempest-ProjectReaderTests-483930896 None] Acquiring lock "cinder-quobyte-cbb6aa1c-9876-41ee-8b0c-21a57d3e3dae" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:35:20 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-1e8f080a-eb32-4da7-997a-665eb30d17db tempest-ProjectReaderTests-483930896 None] Lock "cinder-quobyte-cbb6aa1c-9876-41ee-8b0c-21a57d3e3dae" acquired by "delete_volume" :: waited 0.018s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:35:20 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[6253d4ed-585a-4584-ba25-d62659e59474]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:35:20 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-1e8f080a-eb32-4da7-997a-665eb30d17db tempest-ProjectReaderTests-483930896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-cbb6aa1c-9876-41ee-8b0c-21a57d3e3dae {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:20 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-c74d8575-1395-4753-9bbc-1d2e31d251b6 tempest-ProjectMemberTests-64253088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:35:20 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-c74d8575-1395-4753-9bbc-1d2e31d251b6 tempest-ProjectMemberTests-64253088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:35:20 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-c74d8575-1395-4753-9bbc-1d2e31d251b6 tempest-ProjectMemberTests-64253088 None] Creating offline snapshot f8d5814c-6ec5-4bfb-9326-d1493c320002 of volume d2f1225e-8d1a-4ce3-a38f-ac27e770b1ac {{(pid=87747) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 03:35:20 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[b94c9d52-2737-4c04-98ec-6bea163c12a5]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:35:20 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-c74d8575-1395-4753-9bbc-1d2e31d251b6 tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d2f1225e-8d1a-4ce3-a38f-ac27e770b1ac {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:20 devstack sudo[106166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-cbb6aa1c-9876-41ee-8b0c-21a57d3e3dae Jul 22 03:35:20 devstack sudo[106166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:20 devstack sudo[106167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d2f1225e-8d1a-4ce3-a38f-ac27e770b1ac Jul 22 03:35:20 devstack sudo[106167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:20 devstack sudo[106166]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:20 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-1e8f080a-eb32-4da7-997a-665eb30d17db tempest-ProjectReaderTests-483930896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-cbb6aa1c-9876-41ee-8b0c-21a57d3e3dae" returned: 0 in 0.379s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:20 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-1e8f080a-eb32-4da7-997a-665eb30d17db tempest-ProjectReaderTests-483930896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-cbb6aa1c-9876-41ee-8b0c-21a57d3e3dae {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:20 devstack sudo[106176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-cbb6aa1c-9876-41ee-8b0c-21a57d3e3dae Jul 22 03:35:20 devstack sudo[106176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:20 devstack sudo[106167]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:20 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-c74d8575-1395-4753-9bbc-1d2e31d251b6 tempest-ProjectMemberTests-64253088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d2f1225e-8d1a-4ce3-a38f-ac27e770b1ac" returned: 0 in 0.374s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:20 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-c74d8575-1395-4753-9bbc-1d2e31d251b6 tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d2f1225e-8d1a-4ce3-a38f-ac27e770b1ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d2f1225e-8d1a-4ce3-a38f-ac27e770b1ac.f8d5814c-6ec5-4bfb-9326-d1493c320002 1G {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:20 devstack sudo[106178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d2f1225e-8d1a-4ce3-a38f-ac27e770b1ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d2f1225e-8d1a-4ce3-a38f-ac27e770b1ac.f8d5814c-6ec5-4bfb-9326-d1493c320002 1G Jul 22 03:35:20 devstack sudo[106178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:20 devstack sudo[106176]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:20 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-1e8f080a-eb32-4da7-997a-665eb30d17db tempest-ProjectReaderTests-483930896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-cbb6aa1c-9876-41ee-8b0c-21a57d3e3dae" returned: 0 in 0.247s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:20 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-1e8f080a-eb32-4da7-997a-665eb30d17db tempest-ProjectReaderTests-483930896 None] Lock "cinder-quobyte-cbb6aa1c-9876-41ee-8b0c-21a57d3e3dae" released by "delete_volume" :: held 0.694s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:35:20 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-1e8f080a-eb32-4da7-997a-665eb30d17db tempest-ProjectReaderTests-483930896 None] Created reservations ['260417f1-f2b3-4152-81c1-4216cdd5e389', 'be6e5441-1eb4-4908-a387-344a3cf7f345', 'b3452322-2985-4241-ad04-166524cfbc19', 'd9aaed5e-50ac-4385-8b9b-3d3f4dff0572'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:35:20 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-1e8f080a-eb32-4da7-997a-665eb30d17db tempest-ProjectReaderTests-483930896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:35:20 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-1e8f080a-eb32-4da7-997a-665eb30d17db tempest-ProjectReaderTests-483930896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:35:20 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-1e8f080a-eb32-4da7-997a-665eb30d17db tempest-ProjectReaderTests-483930896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:35:20 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-1e8f080a-eb32-4da7-997a-665eb30d17db tempest-ProjectReaderTests-483930896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:35:20 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-1e8f080a-eb32-4da7-997a-665eb30d17db tempest-ProjectReaderTests-483930896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:35:20 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-1e8f080a-eb32-4da7-997a-665eb30d17db tempest-ProjectReaderTests-483930896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:20 devstack sudo[106184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:35:20 devstack sudo[106184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:20 devstack sudo[106178]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:20 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-c74d8575-1395-4753-9bbc-1d2e31d251b6 tempest-ProjectMemberTests-64253088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d2f1225e-8d1a-4ce3-a38f-ac27e770b1ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d2f1225e-8d1a-4ce3-a38f-ac27e770b1ac.f8d5814c-6ec5-4bfb-9326-d1493c320002 1G" returned: 0 in 0.410s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:20 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-c74d8575-1395-4753-9bbc-1d2e31d251b6 tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2f1225e-8d1a-4ce3-a38f-ac27e770b1ac -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d2f1225e-8d1a-4ce3-a38f-ac27e770b1ac.f8d5814c-6ec5-4bfb-9326-d1493c320002 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:20 devstack sudo[106186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2f1225e-8d1a-4ce3-a38f-ac27e770b1ac -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d2f1225e-8d1a-4ce3-a38f-ac27e770b1ac.f8d5814c-6ec5-4bfb-9326-d1493c320002 Jul 22 03:35:20 devstack sudo[106186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:21 devstack sudo[106184]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:21 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-1e8f080a-eb32-4da7-997a-665eb30d17db tempest-ProjectReaderTests-483930896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.268s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:21 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-1e8f080a-eb32-4da7-997a-665eb30d17db tempest-ProjectReaderTests-483930896 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:35:21 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-1e8f080a-eb32-4da7-997a-665eb30d17db tempest-ProjectReaderTests-483930896 None] Deleted volume successfully. Jul 22 03:35:21 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-1e8f080a-eb32-4da7-997a-665eb30d17db tempest-ProjectReaderTests-483930896 None] Lock "cinder-cbb6aa1c-9876-41ee-8b0c-21a57d3e3dae-delete_volume" released by "delete_volume" :: held 1.197s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:35:21 devstack sudo[106186]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:21 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-c74d8575-1395-4753-9bbc-1d2e31d251b6 tempest-ProjectMemberTests-64253088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2f1225e-8d1a-4ce3-a38f-ac27e770b1ac -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d2f1225e-8d1a-4ce3-a38f-ac27e770b1ac.f8d5814c-6ec5-4bfb-9326-d1493c320002" returned: 0 in 0.314s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:21 devstack cinder-volume[87747]: WARNING cinder.volume.drivers.remotefs [None req-c74d8575-1395-4753-9bbc-1d2e31d251b6 tempest-ProjectMemberTests-64253088 None] /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d2f1225e-8d1a-4ce3-a38f-ac27e770b1ac.f8d5814c-6ec5-4bfb-9326-d1493c320002 is being set with open permissions: ugo+rw Jul 22 03:35:21 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-c74d8575-1395-4753-9bbc-1d2e31d251b6 tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d2f1225e-8d1a-4ce3-a38f-ac27e770b1ac.f8d5814c-6ec5-4bfb-9326-d1493c320002 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:21 devstack sudo[106192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d2f1225e-8d1a-4ce3-a38f-ac27e770b1ac.f8d5814c-6ec5-4bfb-9326-d1493c320002 Jul 22 03:35:21 devstack sudo[106192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:21 devstack sudo[106192]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:21 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-c74d8575-1395-4753-9bbc-1d2e31d251b6 tempest-ProjectMemberTests-64253088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d2f1225e-8d1a-4ce3-a38f-ac27e770b1ac.f8d5814c-6ec5-4bfb-9326-d1493c320002" returned: 0 in 0.245s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:21 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-c74d8575-1395-4753-9bbc-1d2e31d251b6 tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d2f1225e-8d1a-4ce3-a38f-ac27e770b1ac.info {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:21 devstack sudo[106195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d2f1225e-8d1a-4ce3-a38f-ac27e770b1ac.info Jul 22 03:35:21 devstack sudo[106195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:21 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-57e47be4-bae5-4b54-9deb-81ea853dc33d tempest-ProjectReaderTests-483930896 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:35:21 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-57e47be4-bae5-4b54-9deb-81ea853dc33d tempest-ProjectReaderTests-483930896 None] Flow 'volume_create_manager' (24acd506-77b4-49b7-a8f7-9346b7e29613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:35:21 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-57e47be4-bae5-4b54-9deb-81ea853dc33d tempest-ProjectReaderTests-483930896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e615b090-a38b-44a0-ad7f-c67656855bf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:35:21 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-57e47be4-bae5-4b54-9deb-81ea853dc33d tempest-ProjectReaderTests-483930896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e615b090-a38b-44a0-ad7f-c67656855bf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:35:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-450220887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89c805cf-49d9-47e3-93d9-ed43aa4768a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd45f1aa7e184c4599e74792f6f4b497',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:35:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:35:22Z,use_quota=True,user_id='222bb0de5f274a1db76ea74beb58d4b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:35:21 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-57e47be4-bae5-4b54-9deb-81ea853dc33d tempest-ProjectReaderTests-483930896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (247642d3-ecb9-4a05-bbec-11654f124a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:35:21 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-57e47be4-bae5-4b54-9deb-81ea853dc33d tempest-ProjectReaderTests-483930896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (247642d3-ecb9-4a05-bbec-11654f124a4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:35:21 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-57e47be4-bae5-4b54-9deb-81ea853dc33d tempest-ProjectReaderTests-483930896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79f2bb4d-91de-46c0-9ccb-f0cdb58efa90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:35:21 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-57e47be4-bae5-4b54-9deb-81ea853dc33d tempest-ProjectReaderTests-483930896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79f2bb4d-91de-46c0-9ccb-f0cdb58efa90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89c805cf-49d9-47e3-93d9-ed43aa4768a3', 'volume_name': 'volume-89c805cf-49d9-47e3-93d9-ed43aa4768a3', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:35:21 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-57e47be4-bae5-4b54-9deb-81ea853dc33d tempest-ProjectReaderTests-483930896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e6d4c5d-8821-4ee5-80a9-1674a70087f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:35:21 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-57e47be4-bae5-4b54-9deb-81ea853dc33d tempest-ProjectReaderTests-483930896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e6d4c5d-8821-4ee5-80a9-1674a70087f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:35:21 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-57e47be4-bae5-4b54-9deb-81ea853dc33d tempest-ProjectReaderTests-483930896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e5d9890-0803-4fdf-9a83-a50e7ee7321e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:35:21 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-57e47be4-bae5-4b54-9deb-81ea853dc33d tempest-ProjectReaderTests-483930896 None] Volume 89c805cf-49d9-47e3-93d9-ed43aa4768a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89c805cf-49d9-47e3-93d9-ed43aa4768a3', 'volume_size': 1} Jul 22 03:35:21 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-57e47be4-bae5-4b54-9deb-81ea853dc33d tempest-ProjectReaderTests-483930896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:35:21 devstack sudo[106195]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:21 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-c74d8575-1395-4753-9bbc-1d2e31d251b6 tempest-ProjectMemberTests-64253088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d2f1225e-8d1a-4ce3-a38f-ac27e770b1ac.info" returned: 0 in 0.262s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:21 devstack cinder-volume[87747]: WARNING cinder.volume.drivers.remotefs [None req-c74d8575-1395-4753-9bbc-1d2e31d251b6 tempest-ProjectMemberTests-64253088 None] /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d2f1225e-8d1a-4ce3-a38f-ac27e770b1ac.info is being set with open permissions: ugo+rw Jul 22 03:35:21 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-c74d8575-1395-4753-9bbc-1d2e31d251b6 tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d2f1225e-8d1a-4ce3-a38f-ac27e770b1ac.info {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:21 devstack sudo[106198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d2f1225e-8d1a-4ce3-a38f-ac27e770b1ac.info Jul 22 03:35:21 devstack sudo[106198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:22 devstack sudo[106198]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-c74d8575-1395-4753-9bbc-1d2e31d251b6 tempest-ProjectMemberTests-64253088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d2f1225e-8d1a-4ce3-a38f-ac27e770b1ac.info" returned: 0 in 0.237s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-c74d8575-1395-4753-9bbc-1d2e31d251b6 tempest-ProjectMemberTests-64253088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.922s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:35:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-57e47be4-bae5-4b54-9deb-81ea853dc33d tempest-ProjectReaderTests-483930896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.343s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:35:22 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-57e47be4-bae5-4b54-9deb-81ea853dc33d tempest-ProjectReaderTests-483930896 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:35:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-450220887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89c805cf-49d9-47e3-93d9-ed43aa4768a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd45f1aa7e184c4599e74792f6f4b497',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:35:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:35:22Z,use_quota=True,user_id='222bb0de5f274a1db76ea74beb58d4b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:35:22 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-57e47be4-bae5-4b54-9deb-81ea853dc33d tempest-ProjectReaderTests-483930896 None] Creating volume 89c805cf-49d9-47e3-93d9-ed43aa4768a3 {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:35:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-57e47be4-bae5-4b54-9deb-81ea853dc33d tempest-ProjectReaderTests-483930896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:35:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-57e47be4-bae5-4b54-9deb-81ea853dc33d tempest-ProjectReaderTests-483930896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:35:22 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-57e47be4-bae5-4b54-9deb-81ea853dc33d tempest-ProjectReaderTests-483930896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:35:22 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-57e47be4-bae5-4b54-9deb-81ea853dc33d tempest-ProjectReaderTests-483930896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:35:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-57e47be4-bae5-4b54-9deb-81ea853dc33d tempest-ProjectReaderTests-483930896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:35:22 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-57e47be4-bae5-4b54-9deb-81ea853dc33d tempest-ProjectReaderTests-483930896 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:35:22 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-57e47be4-bae5-4b54-9deb-81ea853dc33d tempest-ProjectReaderTests-483930896 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:35:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-57e47be4-bae5-4b54-9deb-81ea853dc33d tempest-ProjectReaderTests-483930896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-89c805cf-49d9-47e3-93d9-ed43aa4768a3 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:22 devstack sudo[106201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-89c805cf-49d9-47e3-93d9-ed43aa4768a3 1073741824 Jul 22 03:35:22 devstack sudo[106201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:22 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-c74d8575-1395-4753-9bbc-1d2e31d251b6 tempest-ProjectMemberTests-64253088 None] Create snapshot completed successfully Jul 22 03:35:22 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-e7a6cc9a-1e45-4762-9766-ffac332d832b tempest-ProjectMemberTests-64253088 None] Acquiring lock "cinder-f8d5814c-6ec5-4bfb-9326-d1493c320002-delete_snapshot" by "delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:35:22 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-e7a6cc9a-1e45-4762-9766-ffac332d832b tempest-ProjectMemberTests-64253088 None] Lock "cinder-f8d5814c-6ec5-4bfb-9326-d1493c320002-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:35:22 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-e7a6cc9a-1e45-4762-9766-ffac332d832b tempest-ProjectMemberTests-64253088 None] Acquiring lock "cinder-quobyte-d2f1225e-8d1a-4ce3-a38f-ac27e770b1ac" by "delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:35:22 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-e7a6cc9a-1e45-4762-9766-ffac332d832b tempest-ProjectMemberTests-64253088 None] Lock "cinder-quobyte-d2f1225e-8d1a-4ce3-a38f-ac27e770b1ac" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:35:22 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-e7a6cc9a-1e45-4762-9766-ffac332d832b tempest-ProjectMemberTests-64253088 None] Acquiring lock "cinder-quobyte-f8d5814c-6ec5-4bfb-9326-d1493c320002" by "_delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:35:22 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-e7a6cc9a-1e45-4762-9766-ffac332d832b tempest-ProjectMemberTests-64253088 None] Lock "cinder-quobyte-f8d5814c-6ec5-4bfb-9326-d1493c320002" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:35:22 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-e7a6cc9a-1e45-4762-9766-ffac332d832b tempest-ProjectMemberTests-64253088 None] Deleting offline snapshot f8d5814c-6ec5-4bfb-9326-d1493c320002 of volume d2f1225e-8d1a-4ce3-a38f-ac27e770b1ac {{(pid=87747) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 03:35:22 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-e7a6cc9a-1e45-4762-9766-ffac332d832b tempest-ProjectMemberTests-64253088 None] snapshot_file for this snap is: volume-d2f1225e-8d1a-4ce3-a38f-ac27e770b1ac.f8d5814c-6ec5-4bfb-9326-d1493c320002 {{(pid=87747) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 03:35:22 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a15eb0c-f50e-4bea-bcfa-b0790972c64f]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:35:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-e7a6cc9a-1e45-4762-9766-ffac332d832b tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d2f1225e-8d1a-4ce3-a38f-ac27e770b1ac.f8d5814c-6ec5-4bfb-9326-d1493c320002 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:22 devstack cinder-volume[87747]: DEBUG oslo_service.periodic_task [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87747) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 03:35:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:35:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:35:22 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:35:22 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:35:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:35:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:22 devstack sudo[106206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d2f1225e-8d1a-4ce3-a38f-ac27e770b1ac.f8d5814c-6ec5-4bfb-9326-d1493c320002 Jul 22 03:35:22 devstack sudo[106206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:22 devstack sudo[106208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:35:22 devstack sudo[106208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:22 devstack sudo[106201]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-57e47be4-bae5-4b54-9deb-81ea853dc33d tempest-ProjectReaderTests-483930896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-89c805cf-49d9-47e3-93d9-ed43aa4768a3 1073741824" returned: 0 in 0.448s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-57e47be4-bae5-4b54-9deb-81ea853dc33d tempest-ProjectReaderTests-483930896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-89c805cf-49d9-47e3-93d9-ed43aa4768a3 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:22 devstack sudo[106211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-89c805cf-49d9-47e3-93d9-ed43aa4768a3 Jul 22 03:35:22 devstack sudo[106211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:22 devstack sudo[106208]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.274s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:22 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:35:22 devstack cinder-volume[87747]: DEBUG oslo_service.periodic_task [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Running periodic task VolumeManager._thread_info {{(pid=87747) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 03:35:22 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] thread count: 28 {{(pid=87747) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 22 03:35:22 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] thread info: [<_MainThread(MainThread, started 132775275860096)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87747) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 22 03:35:22 devstack sudo[106206]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-e7a6cc9a-1e45-4762-9766-ffac332d832b tempest-ProjectMemberTests-64253088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d2f1225e-8d1a-4ce3-a38f-ac27e770b1ac.f8d5814c-6ec5-4bfb-9326-d1493c320002" returned: 0 in 0.409s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:22 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-e7a6cc9a-1e45-4762-9766-ffac332d832b tempest-ProjectMemberTests-64253088 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2f1225e-8d1a-4ce3-a38f-ac27e770b1ac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87747) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 03:35:22 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8139916-d57f-4ef7-8ba4-94f2748bd9ca]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:35:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-e7a6cc9a-1e45-4762-9766-ffac332d832b tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d2f1225e-8d1a-4ce3-a38f-ac27e770b1ac {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:22 devstack sudo[106211]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-57e47be4-bae5-4b54-9deb-81ea853dc33d tempest-ProjectReaderTests-483930896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-89c805cf-49d9-47e3-93d9-ed43aa4768a3" returned: 0 in 0.277s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:22 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-57e47be4-bae5-4b54-9deb-81ea853dc33d tempest-ProjectReaderTests-483930896 None] <== create_volume: return (783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:35:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-57e47be4-bae5-4b54-9deb-81ea853dc33d tempest-ProjectReaderTests-483930896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.786s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:35:22 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-57e47be4-bae5-4b54-9deb-81ea853dc33d tempest-ProjectReaderTests-483930896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e5d9890-0803-4fdf-9a83-a50e7ee7321e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89c805cf-49d9-47e3-93d9-ed43aa4768a3', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:35:22 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-57e47be4-bae5-4b54-9deb-81ea853dc33d tempest-ProjectReaderTests-483930896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fee52f0e-b338-41ac-b63d-2a5533ce6e27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:35:22 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-57e47be4-bae5-4b54-9deb-81ea853dc33d tempest-ProjectReaderTests-483930896 None] Volume volume-89c805cf-49d9-47e3-93d9-ed43aa4768a3 (89c805cf-49d9-47e3-93d9-ed43aa4768a3): created successfully Jul 22 03:35:22 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-57e47be4-bae5-4b54-9deb-81ea853dc33d tempest-ProjectReaderTests-483930896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fee52f0e-b338-41ac-b63d-2a5533ce6e27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:35:22 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-57e47be4-bae5-4b54-9deb-81ea853dc33d tempest-ProjectReaderTests-483930896 None] Flow 'volume_create_manager' (24acd506-77b4-49b7-a8f7-9346b7e29613) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:35:22 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-57e47be4-bae5-4b54-9deb-81ea853dc33d tempest-ProjectReaderTests-483930896 None] Created volume successfully. Jul 22 03:35:22 devstack sudo[106218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d2f1225e-8d1a-4ce3-a38f-ac27e770b1ac Jul 22 03:35:22 devstack sudo[106218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:23 devstack sudo[106218]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:23 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-e7a6cc9a-1e45-4762-9766-ffac332d832b tempest-ProjectMemberTests-64253088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d2f1225e-8d1a-4ce3-a38f-ac27e770b1ac" returned: 0 in 0.352s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:23 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-e7a6cc9a-1e45-4762-9766-ffac332d832b tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d2f1225e-8d1a-4ce3-a38f-ac27e770b1ac.f8d5814c-6ec5-4bfb-9326-d1493c320002 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:23 devstack sudo[106224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d2f1225e-8d1a-4ce3-a38f-ac27e770b1ac.f8d5814c-6ec5-4bfb-9326-d1493c320002 Jul 22 03:35:23 devstack sudo[106224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:23 devstack sudo[106224]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:23 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-e7a6cc9a-1e45-4762-9766-ffac332d832b tempest-ProjectMemberTests-64253088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d2f1225e-8d1a-4ce3-a38f-ac27e770b1ac.f8d5814c-6ec5-4bfb-9326-d1493c320002" returned: 0 in 0.325s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:23 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-e7a6cc9a-1e45-4762-9766-ffac332d832b tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d2f1225e-8d1a-4ce3-a38f-ac27e770b1ac.f8d5814c-6ec5-4bfb-9326-d1493c320002 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:23 devstack sudo[106230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d2f1225e-8d1a-4ce3-a38f-ac27e770b1ac.f8d5814c-6ec5-4bfb-9326-d1493c320002 Jul 22 03:35:23 devstack sudo[106230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:23 devstack sudo[106230]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:23 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-e7a6cc9a-1e45-4762-9766-ffac332d832b tempest-ProjectMemberTests-64253088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d2f1225e-8d1a-4ce3-a38f-ac27e770b1ac.f8d5814c-6ec5-4bfb-9326-d1493c320002" returned: 0 in 0.254s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:23 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-e7a6cc9a-1e45-4762-9766-ffac332d832b tempest-ProjectMemberTests-64253088 None] Lock "cinder-quobyte-f8d5814c-6ec5-4bfb-9326-d1493c320002" released by "_delete_snapshot" :: held 1.429s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:35:23 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-e7a6cc9a-1e45-4762-9766-ffac332d832b tempest-ProjectMemberTests-64253088 None] Lock "cinder-quobyte-d2f1225e-8d1a-4ce3-a38f-ac27e770b1ac" released by "delete_snapshot" :: held 1.455s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:35:23 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-e7a6cc9a-1e45-4762-9766-ffac332d832b tempest-ProjectMemberTests-64253088 None] Created reservations ['485801bb-8ff1-4391-83be-8a607fea6725', '72f0296d-2c49-41de-8e14-74e3b4769790', '47f05742-935d-4dd9-a2b9-50257769c075', '67b71646-6871-4c5e-b3ac-6829ca5b0bd7'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:35:23 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-98798f01-2c4d-435a-9be5-60d7725e829d tempest-ProjectReaderTests-483930896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:35:23 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-98798f01-2c4d-435a-9be5-60d7725e829d tempest-ProjectReaderTests-483930896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:35:23 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-98798f01-2c4d-435a-9be5-60d7725e829d tempest-ProjectReaderTests-483930896 None] Creating offline snapshot 2cc3825f-c03a-4c5a-8b80-b92a7b903804 of volume 89c805cf-49d9-47e3-93d9-ed43aa4768a3 {{(pid=87747) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 03:35:23 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6560f02-5353-4c7f-b643-04286026fa60]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:35:23 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-98798f01-2c4d-435a-9be5-60d7725e829d tempest-ProjectReaderTests-483930896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-89c805cf-49d9-47e3-93d9-ed43aa4768a3 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:23 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-e7a6cc9a-1e45-4762-9766-ffac332d832b tempest-ProjectMemberTests-64253088 None] Delete snapshot completed successfully. Jul 22 03:35:23 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-e7a6cc9a-1e45-4762-9766-ffac332d832b tempest-ProjectMemberTests-64253088 None] Lock "cinder-f8d5814c-6ec5-4bfb-9326-d1493c320002-delete_snapshot" released by "delete_snapshot" :: held 1.665s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:35:24 devstack sudo[106233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-89c805cf-49d9-47e3-93d9-ed43aa4768a3 Jul 22 03:35:24 devstack sudo[106233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:24 devstack sudo[106233]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:24 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-98798f01-2c4d-435a-9be5-60d7725e829d tempest-ProjectReaderTests-483930896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-89c805cf-49d9-47e3-93d9-ed43aa4768a3" returned: 0 in 0.361s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:24 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-98798f01-2c4d-435a-9be5-60d7725e829d tempest-ProjectReaderTests-483930896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-89c805cf-49d9-47e3-93d9-ed43aa4768a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-89c805cf-49d9-47e3-93d9-ed43aa4768a3.2cc3825f-c03a-4c5a-8b80-b92a7b903804 1G {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:24 devstack sudo[106238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-89c805cf-49d9-47e3-93d9-ed43aa4768a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-89c805cf-49d9-47e3-93d9-ed43aa4768a3.2cc3825f-c03a-4c5a-8b80-b92a7b903804 1G Jul 22 03:35:24 devstack sudo[106238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:24 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-c3e72b81-2ca7-48a6-af9c-6d648ae29eb7 tempest-ProjectMemberTests-64253088 None] Acquiring lock "cinder-d2f1225e-8d1a-4ce3-a38f-ac27e770b1ac-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:35:24 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-c3e72b81-2ca7-48a6-af9c-6d648ae29eb7 tempest-ProjectMemberTests-64253088 None] Lock "cinder-d2f1225e-8d1a-4ce3-a38f-ac27e770b1ac-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:35:24 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-c3e72b81-2ca7-48a6-af9c-6d648ae29eb7 tempest-ProjectMemberTests-64253088 None] Acquiring lock "cinder-quobyte-d2f1225e-8d1a-4ce3-a38f-ac27e770b1ac" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:35:24 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-c3e72b81-2ca7-48a6-af9c-6d648ae29eb7 tempest-ProjectMemberTests-64253088 None] Lock "cinder-quobyte-d2f1225e-8d1a-4ce3-a38f-ac27e770b1ac" acquired by "delete_volume" :: waited 0.017s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:35:24 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[c730ebb9-5f9a-47f2-8304-bf7ca2ce142d]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:35:24 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-c3e72b81-2ca7-48a6-af9c-6d648ae29eb7 tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d2f1225e-8d1a-4ce3-a38f-ac27e770b1ac {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:24 devstack sudo[106243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d2f1225e-8d1a-4ce3-a38f-ac27e770b1ac Jul 22 03:35:24 devstack sudo[106243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:24 devstack sudo[106238]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:24 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-98798f01-2c4d-435a-9be5-60d7725e829d tempest-ProjectReaderTests-483930896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-89c805cf-49d9-47e3-93d9-ed43aa4768a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-89c805cf-49d9-47e3-93d9-ed43aa4768a3.2cc3825f-c03a-4c5a-8b80-b92a7b903804 1G" returned: 0 in 0.425s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:24 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-98798f01-2c4d-435a-9be5-60d7725e829d tempest-ProjectReaderTests-483930896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89c805cf-49d9-47e3-93d9-ed43aa4768a3 -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-89c805cf-49d9-47e3-93d9-ed43aa4768a3.2cc3825f-c03a-4c5a-8b80-b92a7b903804 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:24 devstack sudo[106245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89c805cf-49d9-47e3-93d9-ed43aa4768a3 -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-89c805cf-49d9-47e3-93d9-ed43aa4768a3.2cc3825f-c03a-4c5a-8b80-b92a7b903804 Jul 22 03:35:24 devstack sudo[106245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:24 devstack sudo[106243]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:24 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-c3e72b81-2ca7-48a6-af9c-6d648ae29eb7 tempest-ProjectMemberTests-64253088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d2f1225e-8d1a-4ce3-a38f-ac27e770b1ac" returned: 0 in 0.388s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:24 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-c3e72b81-2ca7-48a6-af9c-6d648ae29eb7 tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d2f1225e-8d1a-4ce3-a38f-ac27e770b1ac {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:24 devstack sudo[106252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d2f1225e-8d1a-4ce3-a38f-ac27e770b1ac Jul 22 03:35:24 devstack sudo[106252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:24 devstack sudo[106245]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:24 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-98798f01-2c4d-435a-9be5-60d7725e829d tempest-ProjectReaderTests-483930896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89c805cf-49d9-47e3-93d9-ed43aa4768a3 -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-89c805cf-49d9-47e3-93d9-ed43aa4768a3.2cc3825f-c03a-4c5a-8b80-b92a7b903804" returned: 0 in 0.303s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:25 devstack cinder-volume[87747]: WARNING cinder.volume.drivers.remotefs [None req-98798f01-2c4d-435a-9be5-60d7725e829d tempest-ProjectReaderTests-483930896 None] /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-89c805cf-49d9-47e3-93d9-ed43aa4768a3.2cc3825f-c03a-4c5a-8b80-b92a7b903804 is being set with open permissions: ugo+rw Jul 22 03:35:25 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-98798f01-2c4d-435a-9be5-60d7725e829d tempest-ProjectReaderTests-483930896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-89c805cf-49d9-47e3-93d9-ed43aa4768a3.2cc3825f-c03a-4c5a-8b80-b92a7b903804 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:25 devstack sudo[106255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-89c805cf-49d9-47e3-93d9-ed43aa4768a3.2cc3825f-c03a-4c5a-8b80-b92a7b903804 Jul 22 03:35:25 devstack sudo[106255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:25 devstack sudo[106252]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:25 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-c3e72b81-2ca7-48a6-af9c-6d648ae29eb7 tempest-ProjectMemberTests-64253088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-d2f1225e-8d1a-4ce3-a38f-ac27e770b1ac" returned: 0 in 0.260s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:25 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-c3e72b81-2ca7-48a6-af9c-6d648ae29eb7 tempest-ProjectMemberTests-64253088 None] Lock "cinder-quobyte-d2f1225e-8d1a-4ce3-a38f-ac27e770b1ac" released by "delete_volume" :: held 0.705s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:35:25 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-c3e72b81-2ca7-48a6-af9c-6d648ae29eb7 tempest-ProjectMemberTests-64253088 None] Created reservations ['05f31ce4-be58-4c2f-8bfa-eed600f79eaf', '4341cbcd-d5fa-494d-9186-a911da21dbdc', 'ed929ae4-ff28-49b2-a48b-8dc6c12f61a6', 'b7a4e79f-0cca-4508-8256-b90ef0b98a50'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:35:25 devstack sudo[106255]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:25 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-98798f01-2c4d-435a-9be5-60d7725e829d tempest-ProjectReaderTests-483930896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-89c805cf-49d9-47e3-93d9-ed43aa4768a3.2cc3825f-c03a-4c5a-8b80-b92a7b903804" returned: 0 in 0.261s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:25 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-98798f01-2c4d-435a-9be5-60d7725e829d tempest-ProjectReaderTests-483930896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-89c805cf-49d9-47e3-93d9-ed43aa4768a3.info {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:25 devstack sudo[106259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-89c805cf-49d9-47e3-93d9-ed43aa4768a3.info Jul 22 03:35:25 devstack sudo[106259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:25 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-c3e72b81-2ca7-48a6-af9c-6d648ae29eb7 tempest-ProjectMemberTests-64253088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:35:25 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-c3e72b81-2ca7-48a6-af9c-6d648ae29eb7 tempest-ProjectMemberTests-64253088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:35:25 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-c3e72b81-2ca7-48a6-af9c-6d648ae29eb7 tempest-ProjectMemberTests-64253088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:35:25 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-c3e72b81-2ca7-48a6-af9c-6d648ae29eb7 tempest-ProjectMemberTests-64253088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:35:25 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-c3e72b81-2ca7-48a6-af9c-6d648ae29eb7 tempest-ProjectMemberTests-64253088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:35:25 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-c3e72b81-2ca7-48a6-af9c-6d648ae29eb7 tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:25 devstack sudo[106261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:35:25 devstack sudo[106261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:25 devstack sudo[106259]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:25 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-98798f01-2c4d-435a-9be5-60d7725e829d tempest-ProjectReaderTests-483930896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-89c805cf-49d9-47e3-93d9-ed43aa4768a3.info" returned: 0 in 0.250s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:25 devstack cinder-volume[87747]: WARNING cinder.volume.drivers.remotefs [None req-98798f01-2c4d-435a-9be5-60d7725e829d tempest-ProjectReaderTests-483930896 None] /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-89c805cf-49d9-47e3-93d9-ed43aa4768a3.info is being set with open permissions: ugo+rw Jul 22 03:35:25 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-98798f01-2c4d-435a-9be5-60d7725e829d tempest-ProjectReaderTests-483930896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-89c805cf-49d9-47e3-93d9-ed43aa4768a3.info {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:25 devstack sudo[106264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-89c805cf-49d9-47e3-93d9-ed43aa4768a3.info Jul 22 03:35:25 devstack sudo[106264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:25 devstack sudo[106261]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:25 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-c3e72b81-2ca7-48a6-af9c-6d648ae29eb7 tempest-ProjectMemberTests-64253088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.264s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:25 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-c3e72b81-2ca7-48a6-af9c-6d648ae29eb7 tempest-ProjectMemberTests-64253088 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:35:25 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-c3e72b81-2ca7-48a6-af9c-6d648ae29eb7 tempest-ProjectMemberTests-64253088 None] Deleted volume successfully. Jul 22 03:35:25 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-c3e72b81-2ca7-48a6-af9c-6d648ae29eb7 tempest-ProjectMemberTests-64253088 None] Lock "cinder-d2f1225e-8d1a-4ce3-a38f-ac27e770b1ac-delete_volume" released by "delete_volume" :: held 1.190s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:35:25 devstack sudo[106264]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:25 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-98798f01-2c4d-435a-9be5-60d7725e829d tempest-ProjectReaderTests-483930896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-89c805cf-49d9-47e3-93d9-ed43aa4768a3.info" returned: 0 in 0.286s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:25 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-98798f01-2c4d-435a-9be5-60d7725e829d tempest-ProjectReaderTests-483930896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.969s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:35:25 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-98798f01-2c4d-435a-9be5-60d7725e829d tempest-ProjectReaderTests-483930896 None] Create snapshot completed successfully Jul 22 03:35:26 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-7db2217f-f715-4311-8a56-84a3b43f743b tempest-ProjectReaderTests-483930896 None] Acquiring lock "cinder-2cc3825f-c03a-4c5a-8b80-b92a7b903804-delete_snapshot" by "delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:35:26 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-020408ef-cf51-4dbb-af84-80fe4d69974c tempest-ProjectMemberTests-64253088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:35:26 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-020408ef-cf51-4dbb-af84-80fe4d69974c tempest-ProjectMemberTests-64253088 None] Flow 'volume_create_manager' (ebc777c7-6131-410e-882f-98d00b72baa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:35:26 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-020408ef-cf51-4dbb-af84-80fe4d69974c tempest-ProjectMemberTests-64253088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1d56035-8def-4442-9ddb-a5552d934f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:35:26 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-7db2217f-f715-4311-8a56-84a3b43f743b tempest-ProjectReaderTests-483930896 None] Lock "cinder-2cc3825f-c03a-4c5a-8b80-b92a7b903804-delete_snapshot" acquired by "delete_snapshot" :: waited 0.056s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:35:26 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-7db2217f-f715-4311-8a56-84a3b43f743b tempest-ProjectReaderTests-483930896 None] Acquiring lock "cinder-quobyte-89c805cf-49d9-47e3-93d9-ed43aa4768a3" by "delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:35:26 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-020408ef-cf51-4dbb-af84-80fe4d69974c tempest-ProjectMemberTests-64253088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1d56035-8def-4442-9ddb-a5552d934f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:35:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1744526357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=648f6b9c-a368-4f59-9825-305b477f51f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05eb3b4eac3e4ffe97247852227f9ffa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:35:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:35:26Z,use_quota=True,user_id='ecf77e3a2be443e28cffe6ba02afc5e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:35:26 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-020408ef-cf51-4dbb-af84-80fe4d69974c tempest-ProjectMemberTests-64253088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (542c17f3-56b5-425d-9c2a-c77fefa86829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:35:26 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-020408ef-cf51-4dbb-af84-80fe4d69974c tempest-ProjectMemberTests-64253088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (542c17f3-56b5-425d-9c2a-c77fefa86829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:35:26 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-020408ef-cf51-4dbb-af84-80fe4d69974c tempest-ProjectMemberTests-64253088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a29595a-95fe-4fa5-8f18-074439837277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:35:26 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-020408ef-cf51-4dbb-af84-80fe4d69974c tempest-ProjectMemberTests-64253088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a29595a-95fe-4fa5-8f18-074439837277) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '648f6b9c-a368-4f59-9825-305b477f51f6', 'volume_name': 'volume-648f6b9c-a368-4f59-9825-305b477f51f6', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:35:26 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-020408ef-cf51-4dbb-af84-80fe4d69974c tempest-ProjectMemberTests-64253088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8199f98-ca65-43ab-a389-dbd979633766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:35:26 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-020408ef-cf51-4dbb-af84-80fe4d69974c tempest-ProjectMemberTests-64253088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8199f98-ca65-43ab-a389-dbd979633766) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:35:26 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-020408ef-cf51-4dbb-af84-80fe4d69974c tempest-ProjectMemberTests-64253088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e27db8f-0681-4f5a-9814-8ed358c6acba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:35:26 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-020408ef-cf51-4dbb-af84-80fe4d69974c tempest-ProjectMemberTests-64253088 None] Volume 648f6b9c-a368-4f59-9825-305b477f51f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-648f6b9c-a368-4f59-9825-305b477f51f6', 'volume_size': 1} Jul 22 03:35:26 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-020408ef-cf51-4dbb-af84-80fe4d69974c tempest-ProjectMemberTests-64253088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:35:26 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-020408ef-cf51-4dbb-af84-80fe4d69974c tempest-ProjectMemberTests-64253088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:35:26 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-020408ef-cf51-4dbb-af84-80fe4d69974c tempest-ProjectMemberTests-64253088 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:35:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1744526357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=648f6b9c-a368-4f59-9825-305b477f51f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05eb3b4eac3e4ffe97247852227f9ffa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:35:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:35:26Z,use_quota=True,user_id='ecf77e3a2be443e28cffe6ba02afc5e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:35:26 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-020408ef-cf51-4dbb-af84-80fe4d69974c tempest-ProjectMemberTests-64253088 None] Creating volume 648f6b9c-a368-4f59-9825-305b477f51f6 {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:35:26 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-020408ef-cf51-4dbb-af84-80fe4d69974c tempest-ProjectMemberTests-64253088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:35:26 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-020408ef-cf51-4dbb-af84-80fe4d69974c tempest-ProjectMemberTests-64253088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:35:26 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-020408ef-cf51-4dbb-af84-80fe4d69974c tempest-ProjectMemberTests-64253088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:35:26 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-020408ef-cf51-4dbb-af84-80fe4d69974c tempest-ProjectMemberTests-64253088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:35:26 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-020408ef-cf51-4dbb-af84-80fe4d69974c tempest-ProjectMemberTests-64253088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:35:26 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-020408ef-cf51-4dbb-af84-80fe4d69974c tempest-ProjectMemberTests-64253088 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:35:26 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-020408ef-cf51-4dbb-af84-80fe4d69974c tempest-ProjectMemberTests-64253088 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:35:26 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-020408ef-cf51-4dbb-af84-80fe4d69974c tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-648f6b9c-a368-4f59-9825-305b477f51f6 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:26 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-7db2217f-f715-4311-8a56-84a3b43f743b tempest-ProjectReaderTests-483930896 None] Lock "cinder-quobyte-89c805cf-49d9-47e3-93d9-ed43aa4768a3" acquired by "delete_snapshot" :: waited 0.074s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:35:26 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-7db2217f-f715-4311-8a56-84a3b43f743b tempest-ProjectReaderTests-483930896 None] Acquiring lock "cinder-quobyte-2cc3825f-c03a-4c5a-8b80-b92a7b903804" by "_delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:35:26 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-7db2217f-f715-4311-8a56-84a3b43f743b tempest-ProjectReaderTests-483930896 None] Lock "cinder-quobyte-2cc3825f-c03a-4c5a-8b80-b92a7b903804" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:35:26 devstack sudo[106268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-648f6b9c-a368-4f59-9825-305b477f51f6 1073741824 Jul 22 03:35:26 devstack sudo[106268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:26 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-7db2217f-f715-4311-8a56-84a3b43f743b tempest-ProjectReaderTests-483930896 None] Deleting offline snapshot 2cc3825f-c03a-4c5a-8b80-b92a7b903804 of volume 89c805cf-49d9-47e3-93d9-ed43aa4768a3 {{(pid=87747) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 03:35:26 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-7db2217f-f715-4311-8a56-84a3b43f743b tempest-ProjectReaderTests-483930896 None] snapshot_file for this snap is: volume-89c805cf-49d9-47e3-93d9-ed43aa4768a3.2cc3825f-c03a-4c5a-8b80-b92a7b903804 {{(pid=87747) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 03:35:26 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b39ddc3-ae07-4252-91b9-41c69e3463ab]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:35:26 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-7db2217f-f715-4311-8a56-84a3b43f743b tempest-ProjectReaderTests-483930896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-89c805cf-49d9-47e3-93d9-ed43aa4768a3.2cc3825f-c03a-4c5a-8b80-b92a7b903804 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:26 devstack sudo[106270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-89c805cf-49d9-47e3-93d9-ed43aa4768a3.2cc3825f-c03a-4c5a-8b80-b92a7b903804 Jul 22 03:35:26 devstack sudo[106270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:26 devstack sudo[106268]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:26 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-020408ef-cf51-4dbb-af84-80fe4d69974c tempest-ProjectMemberTests-64253088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-648f6b9c-a368-4f59-9825-305b477f51f6 1073741824" returned: 0 in 0.431s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:26 devstack sudo[106270]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:26 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-7db2217f-f715-4311-8a56-84a3b43f743b tempest-ProjectReaderTests-483930896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-89c805cf-49d9-47e3-93d9-ed43aa4768a3.2cc3825f-c03a-4c5a-8b80-b92a7b903804" returned: 0 in 0.380s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:26 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-7db2217f-f715-4311-8a56-84a3b43f743b tempest-ProjectReaderTests-483930896 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-89c805cf-49d9-47e3-93d9-ed43aa4768a3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87747) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 03:35:26 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9ba7a11-0643-488a-9b5f-0a870d3a3858]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:35:26 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-7db2217f-f715-4311-8a56-84a3b43f743b tempest-ProjectReaderTests-483930896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-89c805cf-49d9-47e3-93d9-ed43aa4768a3 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:26 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-020408ef-cf51-4dbb-af84-80fe4d69974c tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-648f6b9c-a368-4f59-9825-305b477f51f6 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:26 devstack sudo[106279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-648f6b9c-a368-4f59-9825-305b477f51f6 Jul 22 03:35:26 devstack sudo[106279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:26 devstack sudo[106278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-89c805cf-49d9-47e3-93d9-ed43aa4768a3 Jul 22 03:35:26 devstack sudo[106278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:26 devstack sudo[106279]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:26 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-020408ef-cf51-4dbb-af84-80fe4d69974c tempest-ProjectMemberTests-64253088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-648f6b9c-a368-4f59-9825-305b477f51f6" returned: 0 in 0.260s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:26 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-020408ef-cf51-4dbb-af84-80fe4d69974c tempest-ProjectMemberTests-64253088 None] <== create_volume: return (765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:35:26 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-020408ef-cf51-4dbb-af84-80fe4d69974c tempest-ProjectMemberTests-64253088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.768s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:35:26 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-020408ef-cf51-4dbb-af84-80fe4d69974c tempest-ProjectMemberTests-64253088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e27db8f-0681-4f5a-9814-8ed358c6acba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-648f6b9c-a368-4f59-9825-305b477f51f6', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:35:26 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-020408ef-cf51-4dbb-af84-80fe4d69974c tempest-ProjectMemberTests-64253088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6062453-0439-4c84-bdf1-26c506a76f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:35:26 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-020408ef-cf51-4dbb-af84-80fe4d69974c tempest-ProjectMemberTests-64253088 None] Volume volume-648f6b9c-a368-4f59-9825-305b477f51f6 (648f6b9c-a368-4f59-9825-305b477f51f6): created successfully Jul 22 03:35:26 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-020408ef-cf51-4dbb-af84-80fe4d69974c tempest-ProjectMemberTests-64253088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6062453-0439-4c84-bdf1-26c506a76f01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:35:26 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-020408ef-cf51-4dbb-af84-80fe4d69974c tempest-ProjectMemberTests-64253088 None] Flow 'volume_create_manager' (ebc777c7-6131-410e-882f-98d00b72baa5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:35:26 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-020408ef-cf51-4dbb-af84-80fe4d69974c tempest-ProjectMemberTests-64253088 None] Created volume successfully. Jul 22 03:35:26 devstack sudo[106278]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:26 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-7db2217f-f715-4311-8a56-84a3b43f743b tempest-ProjectReaderTests-483930896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-89c805cf-49d9-47e3-93d9-ed43aa4768a3" returned: 0 in 0.385s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:26 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-7db2217f-f715-4311-8a56-84a3b43f743b tempest-ProjectReaderTests-483930896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-89c805cf-49d9-47e3-93d9-ed43aa4768a3.2cc3825f-c03a-4c5a-8b80-b92a7b903804 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:27 devstack sudo[106286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-89c805cf-49d9-47e3-93d9-ed43aa4768a3.2cc3825f-c03a-4c5a-8b80-b92a7b903804 Jul 22 03:35:27 devstack sudo[106286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:27 devstack sudo[106286]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:27 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-7db2217f-f715-4311-8a56-84a3b43f743b tempest-ProjectReaderTests-483930896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-89c805cf-49d9-47e3-93d9-ed43aa4768a3.2cc3825f-c03a-4c5a-8b80-b92a7b903804" returned: 0 in 0.319s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:27 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-7db2217f-f715-4311-8a56-84a3b43f743b tempest-ProjectReaderTests-483930896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-89c805cf-49d9-47e3-93d9-ed43aa4768a3.2cc3825f-c03a-4c5a-8b80-b92a7b903804 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:27 devstack sudo[106291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-89c805cf-49d9-47e3-93d9-ed43aa4768a3.2cc3825f-c03a-4c5a-8b80-b92a7b903804 Jul 22 03:35:27 devstack sudo[106291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:27 devstack sudo[106291]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:27 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-7db2217f-f715-4311-8a56-84a3b43f743b tempest-ProjectReaderTests-483930896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-89c805cf-49d9-47e3-93d9-ed43aa4768a3.2cc3825f-c03a-4c5a-8b80-b92a7b903804" returned: 0 in 0.245s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:27 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-7db2217f-f715-4311-8a56-84a3b43f743b tempest-ProjectReaderTests-483930896 None] Lock "cinder-quobyte-2cc3825f-c03a-4c5a-8b80-b92a7b903804" released by "_delete_snapshot" :: held 1.426s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:35:27 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-7db2217f-f715-4311-8a56-84a3b43f743b tempest-ProjectReaderTests-483930896 None] Lock "cinder-quobyte-89c805cf-49d9-47e3-93d9-ed43aa4768a3" released by "delete_snapshot" :: held 1.451s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:35:27 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-7db2217f-f715-4311-8a56-84a3b43f743b tempest-ProjectReaderTests-483930896 None] Created reservations ['8d63d8f0-e109-445f-8647-276222b0a676', 'a86becc2-9bba-4c07-ac6c-b0e4ad9c2480', '384595a8-73e6-4517-b443-30570d7e4b9b', 'ee440523-a656-480a-a875-6a89f6cfa07d'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:35:27 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-7db2217f-f715-4311-8a56-84a3b43f743b tempest-ProjectReaderTests-483930896 None] Delete snapshot completed successfully. Jul 22 03:35:27 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-7db2217f-f715-4311-8a56-84a3b43f743b tempest-ProjectReaderTests-483930896 None] Lock "cinder-2cc3825f-c03a-4c5a-8b80-b92a7b903804-delete_snapshot" released by "delete_snapshot" :: held 1.630s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:35:28 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-e65bb413-d09b-45a8-93ac-194d989aa753 tempest-ProjectReaderTests-483930896 None] Acquiring lock "cinder-89c805cf-49d9-47e3-93d9-ed43aa4768a3-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:35:28 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-e65bb413-d09b-45a8-93ac-194d989aa753 tempest-ProjectReaderTests-483930896 None] Lock "cinder-89c805cf-49d9-47e3-93d9-ed43aa4768a3-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:35:28 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-e65bb413-d09b-45a8-93ac-194d989aa753 tempest-ProjectReaderTests-483930896 None] Acquiring lock "cinder-quobyte-89c805cf-49d9-47e3-93d9-ed43aa4768a3" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:35:28 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-e65bb413-d09b-45a8-93ac-194d989aa753 tempest-ProjectReaderTests-483930896 None] Lock "cinder-quobyte-89c805cf-49d9-47e3-93d9-ed43aa4768a3" acquired by "delete_volume" :: waited 0.020s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:35:28 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f8ad0e-a4cf-49ba-beef-d1e040bfe245]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:35:28 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-e65bb413-d09b-45a8-93ac-194d989aa753 tempest-ProjectReaderTests-483930896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-89c805cf-49d9-47e3-93d9-ed43aa4768a3 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:28 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-4ca60697-485e-465a-8f4d-4358d009d899 tempest-ProjectMemberTests-64253088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:35:28 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-4ca60697-485e-465a-8f4d-4358d009d899 tempest-ProjectMemberTests-64253088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:35:28 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-4ca60697-485e-465a-8f4d-4358d009d899 tempest-ProjectMemberTests-64253088 None] Creating offline snapshot d6c20186-db87-499c-b2b9-5119ec4aab50 of volume 648f6b9c-a368-4f59-9825-305b477f51f6 {{(pid=87747) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 03:35:28 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[582fd72e-086b-44d1-a55b-d7875e5f247d]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:35:28 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-4ca60697-485e-465a-8f4d-4358d009d899 tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-648f6b9c-a368-4f59-9825-305b477f51f6 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:28 devstack sudo[106295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-89c805cf-49d9-47e3-93d9-ed43aa4768a3 Jul 22 03:35:28 devstack sudo[106295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:28 devstack sudo[106296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-648f6b9c-a368-4f59-9825-305b477f51f6 Jul 22 03:35:28 devstack sudo[106296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:28 devstack sudo[106295]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:28 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-e65bb413-d09b-45a8-93ac-194d989aa753 tempest-ProjectReaderTests-483930896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-89c805cf-49d9-47e3-93d9-ed43aa4768a3" returned: 0 in 0.372s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:28 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-e65bb413-d09b-45a8-93ac-194d989aa753 tempest-ProjectReaderTests-483930896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-89c805cf-49d9-47e3-93d9-ed43aa4768a3 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:28 devstack sudo[106305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-89c805cf-49d9-47e3-93d9-ed43aa4768a3 Jul 22 03:35:28 devstack sudo[106305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:28 devstack sudo[106296]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:28 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-4ca60697-485e-465a-8f4d-4358d009d899 tempest-ProjectMemberTests-64253088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-648f6b9c-a368-4f59-9825-305b477f51f6" returned: 0 in 0.361s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:28 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-4ca60697-485e-465a-8f4d-4358d009d899 tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-648f6b9c-a368-4f59-9825-305b477f51f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-648f6b9c-a368-4f59-9825-305b477f51f6.d6c20186-db87-499c-b2b9-5119ec4aab50 1G {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:28 devstack sudo[106307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-648f6b9c-a368-4f59-9825-305b477f51f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-648f6b9c-a368-4f59-9825-305b477f51f6.d6c20186-db87-499c-b2b9-5119ec4aab50 1G Jul 22 03:35:28 devstack sudo[106307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:28 devstack sudo[106305]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:28 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-e65bb413-d09b-45a8-93ac-194d989aa753 tempest-ProjectReaderTests-483930896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-89c805cf-49d9-47e3-93d9-ed43aa4768a3" returned: 0 in 0.248s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:28 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-e65bb413-d09b-45a8-93ac-194d989aa753 tempest-ProjectReaderTests-483930896 None] Lock "cinder-quobyte-89c805cf-49d9-47e3-93d9-ed43aa4768a3" released by "delete_volume" :: held 0.695s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:35:29 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-e65bb413-d09b-45a8-93ac-194d989aa753 tempest-ProjectReaderTests-483930896 None] Created reservations ['a1905e66-62af-439d-a472-57ef689920b7', 'a38880f1-9c52-44af-ad79-1c8a0bbaf0d2', '8d35f922-0961-4191-84f6-92aee3b9b73d', '38bab1a4-d265-4f1b-abb1-ec23e70eda6c'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:35:29 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-e65bb413-d09b-45a8-93ac-194d989aa753 tempest-ProjectReaderTests-483930896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:35:29 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-e65bb413-d09b-45a8-93ac-194d989aa753 tempest-ProjectReaderTests-483930896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:35:29 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-e65bb413-d09b-45a8-93ac-194d989aa753 tempest-ProjectReaderTests-483930896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:35:29 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-e65bb413-d09b-45a8-93ac-194d989aa753 tempest-ProjectReaderTests-483930896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:35:29 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-e65bb413-d09b-45a8-93ac-194d989aa753 tempest-ProjectReaderTests-483930896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:35:29 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-e65bb413-d09b-45a8-93ac-194d989aa753 tempest-ProjectReaderTests-483930896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:29 devstack sudo[106313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:35:29 devstack sudo[106313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:29 devstack sudo[106307]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:29 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-4ca60697-485e-465a-8f4d-4358d009d899 tempest-ProjectMemberTests-64253088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-648f6b9c-a368-4f59-9825-305b477f51f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-648f6b9c-a368-4f59-9825-305b477f51f6.d6c20186-db87-499c-b2b9-5119ec4aab50 1G" returned: 0 in 0.441s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:29 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-4ca60697-485e-465a-8f4d-4358d009d899 tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-648f6b9c-a368-4f59-9825-305b477f51f6 -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-648f6b9c-a368-4f59-9825-305b477f51f6.d6c20186-db87-499c-b2b9-5119ec4aab50 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:29 devstack sudo[106317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-648f6b9c-a368-4f59-9825-305b477f51f6 -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-648f6b9c-a368-4f59-9825-305b477f51f6.d6c20186-db87-499c-b2b9-5119ec4aab50 Jul 22 03:35:29 devstack sudo[106317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:29 devstack sudo[106313]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:29 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-e65bb413-d09b-45a8-93ac-194d989aa753 tempest-ProjectReaderTests-483930896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.259s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:29 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-e65bb413-d09b-45a8-93ac-194d989aa753 tempest-ProjectReaderTests-483930896 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:35:29 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-e65bb413-d09b-45a8-93ac-194d989aa753 tempest-ProjectReaderTests-483930896 None] Deleted volume successfully. Jul 22 03:35:29 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-e65bb413-d09b-45a8-93ac-194d989aa753 tempest-ProjectReaderTests-483930896 None] Lock "cinder-89c805cf-49d9-47e3-93d9-ed43aa4768a3-delete_volume" released by "delete_volume" :: held 1.176s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:35:29 devstack sudo[106317]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:29 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-4ca60697-485e-465a-8f4d-4358d009d899 tempest-ProjectMemberTests-64253088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-648f6b9c-a368-4f59-9825-305b477f51f6 -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-648f6b9c-a368-4f59-9825-305b477f51f6.d6c20186-db87-499c-b2b9-5119ec4aab50" returned: 0 in 0.301s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:29 devstack cinder-volume[87747]: WARNING cinder.volume.drivers.remotefs [None req-4ca60697-485e-465a-8f4d-4358d009d899 tempest-ProjectMemberTests-64253088 None] /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-648f6b9c-a368-4f59-9825-305b477f51f6.d6c20186-db87-499c-b2b9-5119ec4aab50 is being set with open permissions: ugo+rw Jul 22 03:35:29 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-4ca60697-485e-465a-8f4d-4358d009d899 tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-648f6b9c-a368-4f59-9825-305b477f51f6.d6c20186-db87-499c-b2b9-5119ec4aab50 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:29 devstack sudo[106323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-648f6b9c-a368-4f59-9825-305b477f51f6.d6c20186-db87-499c-b2b9-5119ec4aab50 Jul 22 03:35:29 devstack sudo[106323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:29 devstack sudo[106323]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:29 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-4ca60697-485e-465a-8f4d-4358d009d899 tempest-ProjectMemberTests-64253088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-648f6b9c-a368-4f59-9825-305b477f51f6.d6c20186-db87-499c-b2b9-5119ec4aab50" returned: 0 in 0.251s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:29 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-4ca60697-485e-465a-8f4d-4358d009d899 tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-648f6b9c-a368-4f59-9825-305b477f51f6.info {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:29 devstack sudo[106326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-648f6b9c-a368-4f59-9825-305b477f51f6.info Jul 22 03:35:29 devstack sudo[106326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:29 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ee1657c-cc14-4041-b24f-3b0df998d644 tempest-ProjectReaderTests-483930896 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:35:29 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-7ee1657c-cc14-4041-b24f-3b0df998d644 tempest-ProjectReaderTests-483930896 None] Flow 'volume_create_manager' (a5291ca8-4723-4a48-acef-2421f4f94b5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:35:29 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-7ee1657c-cc14-4041-b24f-3b0df998d644 tempest-ProjectReaderTests-483930896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (685be047-d722-4fd3-a56b-ece45eaf372a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:35:29 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-7ee1657c-cc14-4041-b24f-3b0df998d644 tempest-ProjectReaderTests-483930896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (685be047-d722-4fd3-a56b-ece45eaf372a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:35:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-765484794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f5d3083-cf58-4e0e-af3c-e7d250cf9df7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd45f1aa7e184c4599e74792f6f4b497',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:35:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:35:30Z,use_quota=True,user_id='222bb0de5f274a1db76ea74beb58d4b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:35:29 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-7ee1657c-cc14-4041-b24f-3b0df998d644 tempest-ProjectReaderTests-483930896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7657f90d-e891-4062-bb06-e3149254177a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:35:29 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-7ee1657c-cc14-4041-b24f-3b0df998d644 tempest-ProjectReaderTests-483930896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7657f90d-e891-4062-bb06-e3149254177a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:35:29 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-7ee1657c-cc14-4041-b24f-3b0df998d644 tempest-ProjectReaderTests-483930896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54b50f23-225b-470a-8a49-ef17d0c8bdad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:35:29 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-7ee1657c-cc14-4041-b24f-3b0df998d644 tempest-ProjectReaderTests-483930896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54b50f23-225b-470a-8a49-ef17d0c8bdad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f5d3083-cf58-4e0e-af3c-e7d250cf9df7', 'volume_name': 'volume-9f5d3083-cf58-4e0e-af3c-e7d250cf9df7', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:35:29 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-7ee1657c-cc14-4041-b24f-3b0df998d644 tempest-ProjectReaderTests-483930896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcff0577-456d-42d8-9193-5fcaad580b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:35:29 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-7ee1657c-cc14-4041-b24f-3b0df998d644 tempest-ProjectReaderTests-483930896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcff0577-456d-42d8-9193-5fcaad580b1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:35:29 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-7ee1657c-cc14-4041-b24f-3b0df998d644 tempest-ProjectReaderTests-483930896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07da0f24-0e59-4cf7-8988-78c3e28364cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:35:29 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-7ee1657c-cc14-4041-b24f-3b0df998d644 tempest-ProjectReaderTests-483930896 None] Volume 9f5d3083-cf58-4e0e-af3c-e7d250cf9df7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f5d3083-cf58-4e0e-af3c-e7d250cf9df7', 'volume_size': 1} Jul 22 03:35:29 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-7ee1657c-cc14-4041-b24f-3b0df998d644 tempest-ProjectReaderTests-483930896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:35:30 devstack sudo[106326]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:30 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-4ca60697-485e-465a-8f4d-4358d009d899 tempest-ProjectMemberTests-64253088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-648f6b9c-a368-4f59-9825-305b477f51f6.info" returned: 0 in 0.268s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:30 devstack cinder-volume[87747]: WARNING cinder.volume.drivers.remotefs [None req-4ca60697-485e-465a-8f4d-4358d009d899 tempest-ProjectMemberTests-64253088 None] /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-648f6b9c-a368-4f59-9825-305b477f51f6.info is being set with open permissions: ugo+rw Jul 22 03:35:30 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-4ca60697-485e-465a-8f4d-4358d009d899 tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-648f6b9c-a368-4f59-9825-305b477f51f6.info {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:30 devstack sudo[106329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-648f6b9c-a368-4f59-9825-305b477f51f6.info Jul 22 03:35:30 devstack sudo[106329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:30 devstack sudo[106329]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:30 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-4ca60697-485e-465a-8f4d-4358d009d899 tempest-ProjectMemberTests-64253088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-648f6b9c-a368-4f59-9825-305b477f51f6.info" returned: 0 in 0.232s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:30 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-4ca60697-485e-465a-8f4d-4358d009d899 tempest-ProjectMemberTests-64253088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.937s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:35:30 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-7ee1657c-cc14-4041-b24f-3b0df998d644 tempest-ProjectReaderTests-483930896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.382s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:35:30 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-7ee1657c-cc14-4041-b24f-3b0df998d644 tempest-ProjectReaderTests-483930896 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:35:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-765484794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f5d3083-cf58-4e0e-af3c-e7d250cf9df7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd45f1aa7e184c4599e74792f6f4b497',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:35:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:35:30Z,use_quota=True,user_id='222bb0de5f274a1db76ea74beb58d4b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:35:30 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-7ee1657c-cc14-4041-b24f-3b0df998d644 tempest-ProjectReaderTests-483930896 None] Creating volume 9f5d3083-cf58-4e0e-af3c-e7d250cf9df7 {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:35:30 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-7ee1657c-cc14-4041-b24f-3b0df998d644 tempest-ProjectReaderTests-483930896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:35:30 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-7ee1657c-cc14-4041-b24f-3b0df998d644 tempest-ProjectReaderTests-483930896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:35:30 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-7ee1657c-cc14-4041-b24f-3b0df998d644 tempest-ProjectReaderTests-483930896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:35:30 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-7ee1657c-cc14-4041-b24f-3b0df998d644 tempest-ProjectReaderTests-483930896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:35:30 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-7ee1657c-cc14-4041-b24f-3b0df998d644 tempest-ProjectReaderTests-483930896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:35:30 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-7ee1657c-cc14-4041-b24f-3b0df998d644 tempest-ProjectReaderTests-483930896 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:35:30 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-7ee1657c-cc14-4041-b24f-3b0df998d644 tempest-ProjectReaderTests-483930896 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:35:30 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-7ee1657c-cc14-4041-b24f-3b0df998d644 tempest-ProjectReaderTests-483930896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9f5d3083-cf58-4e0e-af3c-e7d250cf9df7 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:30 devstack sudo[106332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9f5d3083-cf58-4e0e-af3c-e7d250cf9df7 1073741824 Jul 22 03:35:30 devstack sudo[106332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:30 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-4ca60697-485e-465a-8f4d-4358d009d899 tempest-ProjectMemberTests-64253088 None] Create snapshot completed successfully Jul 22 03:35:30 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-cf9b39c0-89de-4727-b2ce-150e39421bb5 tempest-ProjectMemberTests-64253088 None] Acquiring lock "cinder-d6c20186-db87-499c-b2b9-5119ec4aab50-delete_snapshot" by "delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:35:30 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-cf9b39c0-89de-4727-b2ce-150e39421bb5 tempest-ProjectMemberTests-64253088 None] Lock "cinder-d6c20186-db87-499c-b2b9-5119ec4aab50-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:35:30 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-cf9b39c0-89de-4727-b2ce-150e39421bb5 tempest-ProjectMemberTests-64253088 None] Acquiring lock "cinder-quobyte-648f6b9c-a368-4f59-9825-305b477f51f6" by "delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:35:30 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-cf9b39c0-89de-4727-b2ce-150e39421bb5 tempest-ProjectMemberTests-64253088 None] Lock "cinder-quobyte-648f6b9c-a368-4f59-9825-305b477f51f6" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:35:30 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-cf9b39c0-89de-4727-b2ce-150e39421bb5 tempest-ProjectMemberTests-64253088 None] Acquiring lock "cinder-quobyte-d6c20186-db87-499c-b2b9-5119ec4aab50" by "_delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:35:30 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-cf9b39c0-89de-4727-b2ce-150e39421bb5 tempest-ProjectMemberTests-64253088 None] Lock "cinder-quobyte-d6c20186-db87-499c-b2b9-5119ec4aab50" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:35:30 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-cf9b39c0-89de-4727-b2ce-150e39421bb5 tempest-ProjectMemberTests-64253088 None] Deleting offline snapshot d6c20186-db87-499c-b2b9-5119ec4aab50 of volume 648f6b9c-a368-4f59-9825-305b477f51f6 {{(pid=87747) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 03:35:30 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-cf9b39c0-89de-4727-b2ce-150e39421bb5 tempest-ProjectMemberTests-64253088 None] snapshot_file for this snap is: volume-648f6b9c-a368-4f59-9825-305b477f51f6.d6c20186-db87-499c-b2b9-5119ec4aab50 {{(pid=87747) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 03:35:30 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[47bd3851-6efe-4a95-8297-2781a84564a6]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:35:30 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-cf9b39c0-89de-4727-b2ce-150e39421bb5 tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-648f6b9c-a368-4f59-9825-305b477f51f6.d6c20186-db87-499c-b2b9-5119ec4aab50 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:30 devstack sudo[106337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-648f6b9c-a368-4f59-9825-305b477f51f6.d6c20186-db87-499c-b2b9-5119ec4aab50 Jul 22 03:35:30 devstack sudo[106337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:30 devstack sudo[106332]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:30 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-7ee1657c-cc14-4041-b24f-3b0df998d644 tempest-ProjectReaderTests-483930896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9f5d3083-cf58-4e0e-af3c-e7d250cf9df7 1073741824" returned: 0 in 0.421s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:30 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-7ee1657c-cc14-4041-b24f-3b0df998d644 tempest-ProjectReaderTests-483930896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9f5d3083-cf58-4e0e-af3c-e7d250cf9df7 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:30 devstack sudo[106340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9f5d3083-cf58-4e0e-af3c-e7d250cf9df7 Jul 22 03:35:30 devstack sudo[106340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:30 devstack sudo[106337]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:30 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-cf9b39c0-89de-4727-b2ce-150e39421bb5 tempest-ProjectMemberTests-64253088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-648f6b9c-a368-4f59-9825-305b477f51f6.d6c20186-db87-499c-b2b9-5119ec4aab50" returned: 0 in 0.386s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:30 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-cf9b39c0-89de-4727-b2ce-150e39421bb5 tempest-ProjectMemberTests-64253088 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-648f6b9c-a368-4f59-9825-305b477f51f6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87747) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 03:35:30 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f8310f6-81fe-47e1-99e0-4fbd390c5baa]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:35:30 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-cf9b39c0-89de-4727-b2ce-150e39421bb5 tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-648f6b9c-a368-4f59-9825-305b477f51f6 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:31 devstack sudo[106340]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:31 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-7ee1657c-cc14-4041-b24f-3b0df998d644 tempest-ProjectReaderTests-483930896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9f5d3083-cf58-4e0e-af3c-e7d250cf9df7" returned: 0 in 0.263s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:31 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-7ee1657c-cc14-4041-b24f-3b0df998d644 tempest-ProjectReaderTests-483930896 None] <== create_volume: return (733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:35:31 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-7ee1657c-cc14-4041-b24f-3b0df998d644 tempest-ProjectReaderTests-483930896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.736s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:35:31 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-7ee1657c-cc14-4041-b24f-3b0df998d644 tempest-ProjectReaderTests-483930896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07da0f24-0e59-4cf7-8988-78c3e28364cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f5d3083-cf58-4e0e-af3c-e7d250cf9df7', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:35:31 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-7ee1657c-cc14-4041-b24f-3b0df998d644 tempest-ProjectReaderTests-483930896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e3f9b63-3933-493c-8566-9c720c2aca23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:35:31 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-7ee1657c-cc14-4041-b24f-3b0df998d644 tempest-ProjectReaderTests-483930896 None] Volume volume-9f5d3083-cf58-4e0e-af3c-e7d250cf9df7 (9f5d3083-cf58-4e0e-af3c-e7d250cf9df7): created successfully Jul 22 03:35:31 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-7ee1657c-cc14-4041-b24f-3b0df998d644 tempest-ProjectReaderTests-483930896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e3f9b63-3933-493c-8566-9c720c2aca23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:35:31 devstack sudo[106345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-648f6b9c-a368-4f59-9825-305b477f51f6 Jul 22 03:35:31 devstack sudo[106345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:31 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-7ee1657c-cc14-4041-b24f-3b0df998d644 tempest-ProjectReaderTests-483930896 None] Flow 'volume_create_manager' (a5291ca8-4723-4a48-acef-2421f4f94b5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:35:31 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-7ee1657c-cc14-4041-b24f-3b0df998d644 tempest-ProjectReaderTests-483930896 None] Created volume successfully. Jul 22 03:35:31 devstack sudo[106345]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:31 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-cf9b39c0-89de-4727-b2ce-150e39421bb5 tempest-ProjectMemberTests-64253088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-648f6b9c-a368-4f59-9825-305b477f51f6" returned: 0 in 0.352s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:31 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-cf9b39c0-89de-4727-b2ce-150e39421bb5 tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-648f6b9c-a368-4f59-9825-305b477f51f6.d6c20186-db87-499c-b2b9-5119ec4aab50 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:31 devstack sudo[106351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-648f6b9c-a368-4f59-9825-305b477f51f6.d6c20186-db87-499c-b2b9-5119ec4aab50 Jul 22 03:35:31 devstack sudo[106351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:31 devstack sudo[106351]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:31 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-cf9b39c0-89de-4727-b2ce-150e39421bb5 tempest-ProjectMemberTests-64253088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-648f6b9c-a368-4f59-9825-305b477f51f6.d6c20186-db87-499c-b2b9-5119ec4aab50" returned: 0 in 0.317s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:31 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-cf9b39c0-89de-4727-b2ce-150e39421bb5 tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-648f6b9c-a368-4f59-9825-305b477f51f6.d6c20186-db87-499c-b2b9-5119ec4aab50 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:31 devstack sudo[106356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-648f6b9c-a368-4f59-9825-305b477f51f6.d6c20186-db87-499c-b2b9-5119ec4aab50 Jul 22 03:35:31 devstack sudo[106356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:31 devstack sudo[106356]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:31 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-cf9b39c0-89de-4727-b2ce-150e39421bb5 tempest-ProjectMemberTests-64253088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-648f6b9c-a368-4f59-9825-305b477f51f6.d6c20186-db87-499c-b2b9-5119ec4aab50" returned: 0 in 0.257s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:31 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-cf9b39c0-89de-4727-b2ce-150e39421bb5 tempest-ProjectMemberTests-64253088 None] Lock "cinder-quobyte-d6c20186-db87-499c-b2b9-5119ec4aab50" released by "_delete_snapshot" :: held 1.400s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:35:31 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-cf9b39c0-89de-4727-b2ce-150e39421bb5 tempest-ProjectMemberTests-64253088 None] Lock "cinder-quobyte-648f6b9c-a368-4f59-9825-305b477f51f6" released by "delete_snapshot" :: held 1.424s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:35:31 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-cf9b39c0-89de-4727-b2ce-150e39421bb5 tempest-ProjectMemberTests-64253088 None] Created reservations ['f963efdd-dfa0-4d8d-85b8-9612292a6827', 'f45880c8-7922-4003-9b09-b64dd4261654', '321eb846-c534-4d2d-971f-d2c34cf69390', 'e1425312-080d-47e9-97a4-ea6f25fb6920'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:35:32 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-4dec76ec-b20a-46c7-9fdc-fe5f6a34e3cd tempest-ProjectReaderTests-483930896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:35:32 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-4dec76ec-b20a-46c7-9fdc-fe5f6a34e3cd tempest-ProjectReaderTests-483930896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:35:32 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-cf9b39c0-89de-4727-b2ce-150e39421bb5 tempest-ProjectMemberTests-64253088 None] Delete snapshot completed successfully. Jul 22 03:35:32 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-4dec76ec-b20a-46c7-9fdc-fe5f6a34e3cd tempest-ProjectReaderTests-483930896 None] Creating offline snapshot 772877c7-406c-4a01-b8ad-7efb5aac9181 of volume 9f5d3083-cf58-4e0e-af3c-e7d250cf9df7 {{(pid=87747) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 03:35:32 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-cf9b39c0-89de-4727-b2ce-150e39421bb5 tempest-ProjectMemberTests-64253088 None] Lock "cinder-d6c20186-db87-499c-b2b9-5119ec4aab50-delete_snapshot" released by "delete_snapshot" :: held 1.605s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:35:32 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8a33520-b854-4ad9-bfed-59f48c75123d]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:35:32 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-4dec76ec-b20a-46c7-9fdc-fe5f6a34e3cd tempest-ProjectReaderTests-483930896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9f5d3083-cf58-4e0e-af3c-e7d250cf9df7 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:32 devstack sudo[106359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9f5d3083-cf58-4e0e-af3c-e7d250cf9df7 Jul 22 03:35:32 devstack sudo[106359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:32 devstack sudo[106359]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:32 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-4dec76ec-b20a-46c7-9fdc-fe5f6a34e3cd tempest-ProjectReaderTests-483930896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9f5d3083-cf58-4e0e-af3c-e7d250cf9df7" returned: 0 in 0.344s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:32 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-4dec76ec-b20a-46c7-9fdc-fe5f6a34e3cd tempest-ProjectReaderTests-483930896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9f5d3083-cf58-4e0e-af3c-e7d250cf9df7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9f5d3083-cf58-4e0e-af3c-e7d250cf9df7.772877c7-406c-4a01-b8ad-7efb5aac9181 1G {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:32 devstack sudo[106364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9f5d3083-cf58-4e0e-af3c-e7d250cf9df7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9f5d3083-cf58-4e0e-af3c-e7d250cf9df7.772877c7-406c-4a01-b8ad-7efb5aac9181 1G Jul 22 03:35:32 devstack sudo[106364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:32 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-e7668e0f-5f53-42fb-ae8a-7e004c07960e tempest-ProjectMemberTests-64253088 None] Acquiring lock "cinder-648f6b9c-a368-4f59-9825-305b477f51f6-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:35:32 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-e7668e0f-5f53-42fb-ae8a-7e004c07960e tempest-ProjectMemberTests-64253088 None] Lock "cinder-648f6b9c-a368-4f59-9825-305b477f51f6-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:35:32 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-e7668e0f-5f53-42fb-ae8a-7e004c07960e tempest-ProjectMemberTests-64253088 None] Acquiring lock "cinder-quobyte-648f6b9c-a368-4f59-9825-305b477f51f6" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:35:32 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-e7668e0f-5f53-42fb-ae8a-7e004c07960e tempest-ProjectMemberTests-64253088 None] Lock "cinder-quobyte-648f6b9c-a368-4f59-9825-305b477f51f6" acquired by "delete_volume" :: waited 0.018s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:35:32 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[15c73cf8-a475-49dc-8b55-c7dfd218450b]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:35:32 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-e7668e0f-5f53-42fb-ae8a-7e004c07960e tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-648f6b9c-a368-4f59-9825-305b477f51f6 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:32 devstack sudo[106364]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:32 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-4dec76ec-b20a-46c7-9fdc-fe5f6a34e3cd tempest-ProjectReaderTests-483930896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9f5d3083-cf58-4e0e-af3c-e7d250cf9df7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9f5d3083-cf58-4e0e-af3c-e7d250cf9df7.772877c7-406c-4a01-b8ad-7efb5aac9181 1G" returned: 0 in 0.418s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:32 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-4dec76ec-b20a-46c7-9fdc-fe5f6a34e3cd tempest-ProjectReaderTests-483930896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f5d3083-cf58-4e0e-af3c-e7d250cf9df7 -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9f5d3083-cf58-4e0e-af3c-e7d250cf9df7.772877c7-406c-4a01-b8ad-7efb5aac9181 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:32 devstack sudo[106369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-648f6b9c-a368-4f59-9825-305b477f51f6 Jul 22 03:35:32 devstack sudo[106369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:32 devstack sudo[106372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f5d3083-cf58-4e0e-af3c-e7d250cf9df7 -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9f5d3083-cf58-4e0e-af3c-e7d250cf9df7.772877c7-406c-4a01-b8ad-7efb5aac9181 Jul 22 03:35:32 devstack sudo[106372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:33 devstack sudo[106369]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:33 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-e7668e0f-5f53-42fb-ae8a-7e004c07960e tempest-ProjectMemberTests-64253088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-648f6b9c-a368-4f59-9825-305b477f51f6" returned: 0 in 0.368s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:33 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-e7668e0f-5f53-42fb-ae8a-7e004c07960e tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-648f6b9c-a368-4f59-9825-305b477f51f6 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:33 devstack sudo[106380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-648f6b9c-a368-4f59-9825-305b477f51f6 Jul 22 03:35:33 devstack sudo[106380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:33 devstack sudo[106372]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:33 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-4dec76ec-b20a-46c7-9fdc-fe5f6a34e3cd tempest-ProjectReaderTests-483930896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f5d3083-cf58-4e0e-af3c-e7d250cf9df7 -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9f5d3083-cf58-4e0e-af3c-e7d250cf9df7.772877c7-406c-4a01-b8ad-7efb5aac9181" returned: 0 in 0.297s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:33 devstack cinder-volume[87747]: WARNING cinder.volume.drivers.remotefs [None req-4dec76ec-b20a-46c7-9fdc-fe5f6a34e3cd tempest-ProjectReaderTests-483930896 None] /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9f5d3083-cf58-4e0e-af3c-e7d250cf9df7.772877c7-406c-4a01-b8ad-7efb5aac9181 is being set with open permissions: ugo+rw Jul 22 03:35:33 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-4dec76ec-b20a-46c7-9fdc-fe5f6a34e3cd tempest-ProjectReaderTests-483930896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9f5d3083-cf58-4e0e-af3c-e7d250cf9df7.772877c7-406c-4a01-b8ad-7efb5aac9181 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:33 devstack sudo[106382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9f5d3083-cf58-4e0e-af3c-e7d250cf9df7.772877c7-406c-4a01-b8ad-7efb5aac9181 Jul 22 03:35:33 devstack sudo[106382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:33 devstack sudo[106380]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:33 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-e7668e0f-5f53-42fb-ae8a-7e004c07960e tempest-ProjectMemberTests-64253088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-648f6b9c-a368-4f59-9825-305b477f51f6" returned: 0 in 0.241s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:33 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-e7668e0f-5f53-42fb-ae8a-7e004c07960e tempest-ProjectMemberTests-64253088 None] Lock "cinder-quobyte-648f6b9c-a368-4f59-9825-305b477f51f6" released by "delete_volume" :: held 0.663s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:35:33 devstack sudo[106382]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:33 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-4dec76ec-b20a-46c7-9fdc-fe5f6a34e3cd tempest-ProjectReaderTests-483930896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9f5d3083-cf58-4e0e-af3c-e7d250cf9df7.772877c7-406c-4a01-b8ad-7efb5aac9181" returned: 0 in 0.251s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:33 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-4dec76ec-b20a-46c7-9fdc-fe5f6a34e3cd tempest-ProjectReaderTests-483930896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9f5d3083-cf58-4e0e-af3c-e7d250cf9df7.info {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:33 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-e7668e0f-5f53-42fb-ae8a-7e004c07960e tempest-ProjectMemberTests-64253088 None] Created reservations ['5a35a527-ed7e-4f8f-9101-9bd5bc11eee5', '9512eb15-f7ec-47e1-9c62-16e87a92009c', 'd7442ae2-8705-4bf6-a7d9-386943e4b4c0', '1a0517ba-15d0-4c7d-93a4-987b1d6639f6'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:35:33 devstack sudo[106386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9f5d3083-cf58-4e0e-af3c-e7d250cf9df7.info Jul 22 03:35:33 devstack sudo[106386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:33 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-e7668e0f-5f53-42fb-ae8a-7e004c07960e tempest-ProjectMemberTests-64253088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:35:33 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-e7668e0f-5f53-42fb-ae8a-7e004c07960e tempest-ProjectMemberTests-64253088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:35:33 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-e7668e0f-5f53-42fb-ae8a-7e004c07960e tempest-ProjectMemberTests-64253088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:35:33 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-e7668e0f-5f53-42fb-ae8a-7e004c07960e tempest-ProjectMemberTests-64253088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:35:33 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-e7668e0f-5f53-42fb-ae8a-7e004c07960e tempest-ProjectMemberTests-64253088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:35:33 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-e7668e0f-5f53-42fb-ae8a-7e004c07960e tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:33 devstack sudo[106389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:35:33 devstack sudo[106389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:33 devstack sudo[106386]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:33 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-4dec76ec-b20a-46c7-9fdc-fe5f6a34e3cd tempest-ProjectReaderTests-483930896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9f5d3083-cf58-4e0e-af3c-e7d250cf9df7.info" returned: 0 in 0.255s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:33 devstack cinder-volume[87747]: WARNING cinder.volume.drivers.remotefs [None req-4dec76ec-b20a-46c7-9fdc-fe5f6a34e3cd tempest-ProjectReaderTests-483930896 None] /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9f5d3083-cf58-4e0e-af3c-e7d250cf9df7.info is being set with open permissions: ugo+rw Jul 22 03:35:33 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-4dec76ec-b20a-46c7-9fdc-fe5f6a34e3cd tempest-ProjectReaderTests-483930896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9f5d3083-cf58-4e0e-af3c-e7d250cf9df7.info {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:33 devstack sudo[106392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9f5d3083-cf58-4e0e-af3c-e7d250cf9df7.info Jul 22 03:35:33 devstack sudo[106392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:33 devstack sudo[106389]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:33 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-e7668e0f-5f53-42fb-ae8a-7e004c07960e tempest-ProjectMemberTests-64253088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.274s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:33 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-e7668e0f-5f53-42fb-ae8a-7e004c07960e tempest-ProjectMemberTests-64253088 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:35:33 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-e7668e0f-5f53-42fb-ae8a-7e004c07960e tempest-ProjectMemberTests-64253088 None] Deleted volume successfully. Jul 22 03:35:33 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-e7668e0f-5f53-42fb-ae8a-7e004c07960e tempest-ProjectMemberTests-64253088 None] Lock "cinder-648f6b9c-a368-4f59-9825-305b477f51f6-delete_volume" released by "delete_volume" :: held 1.194s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:35:33 devstack sudo[106392]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:33 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-4dec76ec-b20a-46c7-9fdc-fe5f6a34e3cd tempest-ProjectReaderTests-483930896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9f5d3083-cf58-4e0e-af3c-e7d250cf9df7.info" returned: 0 in 0.274s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:33 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-4dec76ec-b20a-46c7-9fdc-fe5f6a34e3cd tempest-ProjectReaderTests-483930896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.918s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:35:34 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-4dec76ec-b20a-46c7-9fdc-fe5f6a34e3cd tempest-ProjectReaderTests-483930896 None] Create snapshot completed successfully Jul 22 03:35:34 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-da8536cb-e152-4985-8e04-1e729bdc3d96 tempest-ProjectReaderTests-483930896 None] Acquiring lock "cinder-772877c7-406c-4a01-b8ad-7efb5aac9181-delete_snapshot" by "delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:35:34 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-da8536cb-e152-4985-8e04-1e729bdc3d96 tempest-ProjectReaderTests-483930896 None] Lock "cinder-772877c7-406c-4a01-b8ad-7efb5aac9181-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:35:34 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-da8536cb-e152-4985-8e04-1e729bdc3d96 tempest-ProjectReaderTests-483930896 None] Acquiring lock "cinder-quobyte-9f5d3083-cf58-4e0e-af3c-e7d250cf9df7" by "delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:35:34 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-da8536cb-e152-4985-8e04-1e729bdc3d96 tempest-ProjectReaderTests-483930896 None] Lock "cinder-quobyte-9f5d3083-cf58-4e0e-af3c-e7d250cf9df7" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:35:34 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-da8536cb-e152-4985-8e04-1e729bdc3d96 tempest-ProjectReaderTests-483930896 None] Acquiring lock "cinder-quobyte-772877c7-406c-4a01-b8ad-7efb5aac9181" by "_delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:35:34 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-da8536cb-e152-4985-8e04-1e729bdc3d96 tempest-ProjectReaderTests-483930896 None] Lock "cinder-quobyte-772877c7-406c-4a01-b8ad-7efb5aac9181" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:35:34 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-da8536cb-e152-4985-8e04-1e729bdc3d96 tempest-ProjectReaderTests-483930896 None] Deleting offline snapshot 772877c7-406c-4a01-b8ad-7efb5aac9181 of volume 9f5d3083-cf58-4e0e-af3c-e7d250cf9df7 {{(pid=87747) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 03:35:34 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-da8536cb-e152-4985-8e04-1e729bdc3d96 tempest-ProjectReaderTests-483930896 None] snapshot_file for this snap is: volume-9f5d3083-cf58-4e0e-af3c-e7d250cf9df7.772877c7-406c-4a01-b8ad-7efb5aac9181 {{(pid=87747) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 03:35:34 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[291f3a7c-31d1-4861-ad6f-858fdb801572]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:35:34 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-da8536cb-e152-4985-8e04-1e729bdc3d96 tempest-ProjectReaderTests-483930896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9f5d3083-cf58-4e0e-af3c-e7d250cf9df7.772877c7-406c-4a01-b8ad-7efb5aac9181 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:34 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-27d7c9ba-8b6e-4e32-bc18-8a8399fadedd tempest-ProjectMemberTests-64253088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:35:34 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-27d7c9ba-8b6e-4e32-bc18-8a8399fadedd tempest-ProjectMemberTests-64253088 None] Flow 'volume_create_manager' (503d87b1-f737-45ec-855e-c494fb24ee15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:35:34 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-27d7c9ba-8b6e-4e32-bc18-8a8399fadedd tempest-ProjectMemberTests-64253088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb57788f-a4e9-4a87-acf9-0520118779e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:35:34 devstack sudo[106396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9f5d3083-cf58-4e0e-af3c-e7d250cf9df7.772877c7-406c-4a01-b8ad-7efb5aac9181 Jul 22 03:35:34 devstack sudo[106396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:34 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-27d7c9ba-8b6e-4e32-bc18-8a8399fadedd tempest-ProjectMemberTests-64253088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb57788f-a4e9-4a87-acf9-0520118779e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:35:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-993397119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b238aec1-6da0-4321-81f4-cf0fe31fbe86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05eb3b4eac3e4ffe97247852227f9ffa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:35:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:35:34Z,use_quota=True,user_id='ecf77e3a2be443e28cffe6ba02afc5e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:35:34 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-27d7c9ba-8b6e-4e32-bc18-8a8399fadedd tempest-ProjectMemberTests-64253088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9090a001-5b71-4bcd-bb6b-63bfe242af84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:35:34 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-27d7c9ba-8b6e-4e32-bc18-8a8399fadedd tempest-ProjectMemberTests-64253088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9090a001-5b71-4bcd-bb6b-63bfe242af84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:35:34 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-27d7c9ba-8b6e-4e32-bc18-8a8399fadedd tempest-ProjectMemberTests-64253088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (286fbfb7-1197-4cca-8e20-0e6ed3007ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:35:34 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-27d7c9ba-8b6e-4e32-bc18-8a8399fadedd tempest-ProjectMemberTests-64253088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (286fbfb7-1197-4cca-8e20-0e6ed3007ec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b238aec1-6da0-4321-81f4-cf0fe31fbe86', 'volume_name': 'volume-b238aec1-6da0-4321-81f4-cf0fe31fbe86', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:35:34 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-27d7c9ba-8b6e-4e32-bc18-8a8399fadedd tempest-ProjectMemberTests-64253088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6d63dd3-e024-40c8-aeba-4f6031991189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:35:34 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-27d7c9ba-8b6e-4e32-bc18-8a8399fadedd tempest-ProjectMemberTests-64253088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6d63dd3-e024-40c8-aeba-4f6031991189) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:35:34 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-27d7c9ba-8b6e-4e32-bc18-8a8399fadedd tempest-ProjectMemberTests-64253088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ac68b1a-5d29-4cf6-88fb-23fa57286788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:35:34 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-27d7c9ba-8b6e-4e32-bc18-8a8399fadedd tempest-ProjectMemberTests-64253088 None] Volume b238aec1-6da0-4321-81f4-cf0fe31fbe86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b238aec1-6da0-4321-81f4-cf0fe31fbe86', 'volume_size': 1} Jul 22 03:35:34 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-27d7c9ba-8b6e-4e32-bc18-8a8399fadedd tempest-ProjectMemberTests-64253088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:35:34 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-27d7c9ba-8b6e-4e32-bc18-8a8399fadedd tempest-ProjectMemberTests-64253088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:35:34 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-27d7c9ba-8b6e-4e32-bc18-8a8399fadedd tempest-ProjectMemberTests-64253088 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:35:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-993397119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b238aec1-6da0-4321-81f4-cf0fe31fbe86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05eb3b4eac3e4ffe97247852227f9ffa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:35:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:35:34Z,use_quota=True,user_id='ecf77e3a2be443e28cffe6ba02afc5e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:35:34 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-27d7c9ba-8b6e-4e32-bc18-8a8399fadedd tempest-ProjectMemberTests-64253088 None] Creating volume b238aec1-6da0-4321-81f4-cf0fe31fbe86 {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:35:34 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-27d7c9ba-8b6e-4e32-bc18-8a8399fadedd tempest-ProjectMemberTests-64253088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:35:34 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-27d7c9ba-8b6e-4e32-bc18-8a8399fadedd tempest-ProjectMemberTests-64253088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:35:34 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-27d7c9ba-8b6e-4e32-bc18-8a8399fadedd tempest-ProjectMemberTests-64253088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:35:34 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-27d7c9ba-8b6e-4e32-bc18-8a8399fadedd tempest-ProjectMemberTests-64253088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:35:34 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-27d7c9ba-8b6e-4e32-bc18-8a8399fadedd tempest-ProjectMemberTests-64253088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:35:34 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-27d7c9ba-8b6e-4e32-bc18-8a8399fadedd tempest-ProjectMemberTests-64253088 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:35:34 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-27d7c9ba-8b6e-4e32-bc18-8a8399fadedd tempest-ProjectMemberTests-64253088 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:35:34 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-27d7c9ba-8b6e-4e32-bc18-8a8399fadedd tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b238aec1-6da0-4321-81f4-cf0fe31fbe86 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:34 devstack sudo[106398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b238aec1-6da0-4321-81f4-cf0fe31fbe86 1073741824 Jul 22 03:35:34 devstack sudo[106398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:34 devstack sudo[106396]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:34 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-da8536cb-e152-4985-8e04-1e729bdc3d96 tempest-ProjectReaderTests-483930896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9f5d3083-cf58-4e0e-af3c-e7d250cf9df7.772877c7-406c-4a01-b8ad-7efb5aac9181" returned: 0 in 0.361s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:34 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-da8536cb-e152-4985-8e04-1e729bdc3d96 tempest-ProjectReaderTests-483930896 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9f5d3083-cf58-4e0e-af3c-e7d250cf9df7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87747) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 03:35:34 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[a901d9c6-f536-49d0-9c57-665e89cb9e46]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:35:34 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-da8536cb-e152-4985-8e04-1e729bdc3d96 tempest-ProjectReaderTests-483930896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9f5d3083-cf58-4e0e-af3c-e7d250cf9df7 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:34 devstack sudo[106405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9f5d3083-cf58-4e0e-af3c-e7d250cf9df7 Jul 22 03:35:34 devstack sudo[106405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:34 devstack sudo[106398]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:34 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-27d7c9ba-8b6e-4e32-bc18-8a8399fadedd tempest-ProjectMemberTests-64253088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b238aec1-6da0-4321-81f4-cf0fe31fbe86 1073741824" returned: 0 in 0.410s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:34 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-27d7c9ba-8b6e-4e32-bc18-8a8399fadedd tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b238aec1-6da0-4321-81f4-cf0fe31fbe86 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:34 devstack sudo[106409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b238aec1-6da0-4321-81f4-cf0fe31fbe86 Jul 22 03:35:34 devstack sudo[106409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:35 devstack sudo[106405]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:35 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-da8536cb-e152-4985-8e04-1e729bdc3d96 tempest-ProjectReaderTests-483930896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9f5d3083-cf58-4e0e-af3c-e7d250cf9df7" returned: 0 in 0.366s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:35 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-da8536cb-e152-4985-8e04-1e729bdc3d96 tempest-ProjectReaderTests-483930896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9f5d3083-cf58-4e0e-af3c-e7d250cf9df7.772877c7-406c-4a01-b8ad-7efb5aac9181 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:35 devstack sudo[106414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9f5d3083-cf58-4e0e-af3c-e7d250cf9df7.772877c7-406c-4a01-b8ad-7efb5aac9181 Jul 22 03:35:35 devstack sudo[106414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:35 devstack sudo[106409]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:35 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-27d7c9ba-8b6e-4e32-bc18-8a8399fadedd tempest-ProjectMemberTests-64253088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b238aec1-6da0-4321-81f4-cf0fe31fbe86" returned: 0 in 0.241s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:35 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-27d7c9ba-8b6e-4e32-bc18-8a8399fadedd tempest-ProjectMemberTests-64253088 None] <== create_volume: return (693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:35:35 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-27d7c9ba-8b6e-4e32-bc18-8a8399fadedd tempest-ProjectMemberTests-64253088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.697s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:35:35 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-27d7c9ba-8b6e-4e32-bc18-8a8399fadedd tempest-ProjectMemberTests-64253088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ac68b1a-5d29-4cf6-88fb-23fa57286788) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b238aec1-6da0-4321-81f4-cf0fe31fbe86', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:35:35 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-27d7c9ba-8b6e-4e32-bc18-8a8399fadedd tempest-ProjectMemberTests-64253088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be58a94b-8604-4261-901d-b27ab22879ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:35:35 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-27d7c9ba-8b6e-4e32-bc18-8a8399fadedd tempest-ProjectMemberTests-64253088 None] Volume volume-b238aec1-6da0-4321-81f4-cf0fe31fbe86 (b238aec1-6da0-4321-81f4-cf0fe31fbe86): created successfully Jul 22 03:35:35 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-27d7c9ba-8b6e-4e32-bc18-8a8399fadedd tempest-ProjectMemberTests-64253088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be58a94b-8604-4261-901d-b27ab22879ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:35:35 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-27d7c9ba-8b6e-4e32-bc18-8a8399fadedd tempest-ProjectMemberTests-64253088 None] Flow 'volume_create_manager' (503d87b1-f737-45ec-855e-c494fb24ee15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:35:35 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-27d7c9ba-8b6e-4e32-bc18-8a8399fadedd tempest-ProjectMemberTests-64253088 None] Created volume successfully. Jul 22 03:35:35 devstack sudo[106414]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:35 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-da8536cb-e152-4985-8e04-1e729bdc3d96 tempest-ProjectReaderTests-483930896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9f5d3083-cf58-4e0e-af3c-e7d250cf9df7.772877c7-406c-4a01-b8ad-7efb5aac9181" returned: 0 in 0.351s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:35 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-da8536cb-e152-4985-8e04-1e729bdc3d96 tempest-ProjectReaderTests-483930896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9f5d3083-cf58-4e0e-af3c-e7d250cf9df7.772877c7-406c-4a01-b8ad-7efb5aac9181 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:35 devstack sudo[106420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9f5d3083-cf58-4e0e-af3c-e7d250cf9df7.772877c7-406c-4a01-b8ad-7efb5aac9181 Jul 22 03:35:35 devstack sudo[106420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:35 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-afa4bf9c-d14d-45d8-afda-b49c7eed7933 tempest-ProjectMemberTests-64253088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:35:35 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-afa4bf9c-d14d-45d8-afda-b49c7eed7933 tempest-ProjectMemberTests-64253088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:35:35 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-afa4bf9c-d14d-45d8-afda-b49c7eed7933 tempest-ProjectMemberTests-64253088 None] Creating offline snapshot 78d0afb8-ec03-4484-8113-2a08247c2741 of volume b238aec1-6da0-4321-81f4-cf0fe31fbe86 {{(pid=87747) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 03:35:35 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9bb32b9-58a5-48e3-8caf-859699b3511a]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:35:35 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-afa4bf9c-d14d-45d8-afda-b49c7eed7933 tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b238aec1-6da0-4321-81f4-cf0fe31fbe86 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:35 devstack sudo[106422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b238aec1-6da0-4321-81f4-cf0fe31fbe86 Jul 22 03:35:35 devstack sudo[106422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:35 devstack sudo[106420]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:35 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-da8536cb-e152-4985-8e04-1e729bdc3d96 tempest-ProjectReaderTests-483930896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9f5d3083-cf58-4e0e-af3c-e7d250cf9df7.772877c7-406c-4a01-b8ad-7efb5aac9181" returned: 0 in 0.265s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:35 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-da8536cb-e152-4985-8e04-1e729bdc3d96 tempest-ProjectReaderTests-483930896 None] Lock "cinder-quobyte-772877c7-406c-4a01-b8ad-7efb5aac9181" released by "_delete_snapshot" :: held 1.439s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:35:35 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-da8536cb-e152-4985-8e04-1e729bdc3d96 tempest-ProjectReaderTests-483930896 None] Lock "cinder-quobyte-9f5d3083-cf58-4e0e-af3c-e7d250cf9df7" released by "delete_snapshot" :: held 1.469s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:35:35 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-da8536cb-e152-4985-8e04-1e729bdc3d96 tempest-ProjectReaderTests-483930896 None] Created reservations ['a4d7dbcc-4698-4f28-a6e5-77336d568d24', '3b3d9b8b-d739-4e2b-b8a0-574bfaefb3b4', 'f3fe778d-b072-474c-825d-91693d448a03', '859921b8-f11b-4423-a77e-842037b0d2fc'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:35:35 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-da8536cb-e152-4985-8e04-1e729bdc3d96 tempest-ProjectReaderTests-483930896 None] Delete snapshot completed successfully. Jul 22 03:35:35 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-da8536cb-e152-4985-8e04-1e729bdc3d96 tempest-ProjectReaderTests-483930896 None] Lock "cinder-772877c7-406c-4a01-b8ad-7efb5aac9181-delete_snapshot" released by "delete_snapshot" :: held 1.605s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:35:35 devstack sudo[106422]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:35 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-afa4bf9c-d14d-45d8-afda-b49c7eed7933 tempest-ProjectMemberTests-64253088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b238aec1-6da0-4321-81f4-cf0fe31fbe86" returned: 0 in 0.371s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:35 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-afa4bf9c-d14d-45d8-afda-b49c7eed7933 tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b238aec1-6da0-4321-81f4-cf0fe31fbe86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b238aec1-6da0-4321-81f4-cf0fe31fbe86.78d0afb8-ec03-4484-8113-2a08247c2741 1G {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:35 devstack sudo[106428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b238aec1-6da0-4321-81f4-cf0fe31fbe86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b238aec1-6da0-4321-81f4-cf0fe31fbe86.78d0afb8-ec03-4484-8113-2a08247c2741 1G Jul 22 03:35:35 devstack sudo[106428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:36 devstack sudo[106428]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:36 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-afa4bf9c-d14d-45d8-afda-b49c7eed7933 tempest-ProjectMemberTests-64253088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b238aec1-6da0-4321-81f4-cf0fe31fbe86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b238aec1-6da0-4321-81f4-cf0fe31fbe86.78d0afb8-ec03-4484-8113-2a08247c2741 1G" returned: 0 in 0.384s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:36 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-afa4bf9c-d14d-45d8-afda-b49c7eed7933 tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b238aec1-6da0-4321-81f4-cf0fe31fbe86 -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b238aec1-6da0-4321-81f4-cf0fe31fbe86.78d0afb8-ec03-4484-8113-2a08247c2741 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:36 devstack sudo[106433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b238aec1-6da0-4321-81f4-cf0fe31fbe86 -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b238aec1-6da0-4321-81f4-cf0fe31fbe86.78d0afb8-ec03-4484-8113-2a08247c2741 Jul 22 03:35:36 devstack sudo[106433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:36 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-62c737fd-9c94-4a71-88cd-5168bf289b4a tempest-ProjectReaderTests-483930896 None] Acquiring lock "cinder-9f5d3083-cf58-4e0e-af3c-e7d250cf9df7-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:35:36 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-62c737fd-9c94-4a71-88cd-5168bf289b4a tempest-ProjectReaderTests-483930896 None] Lock "cinder-9f5d3083-cf58-4e0e-af3c-e7d250cf9df7-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:35:36 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-62c737fd-9c94-4a71-88cd-5168bf289b4a tempest-ProjectReaderTests-483930896 None] Acquiring lock "cinder-quobyte-9f5d3083-cf58-4e0e-af3c-e7d250cf9df7" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:35:36 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-62c737fd-9c94-4a71-88cd-5168bf289b4a tempest-ProjectReaderTests-483930896 None] Lock "cinder-quobyte-9f5d3083-cf58-4e0e-af3c-e7d250cf9df7" acquired by "delete_volume" :: waited 0.023s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:35:36 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c4e0155-4226-4c9a-b74f-d261a6b745a1]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:35:36 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-62c737fd-9c94-4a71-88cd-5168bf289b4a tempest-ProjectReaderTests-483930896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9f5d3083-cf58-4e0e-af3c-e7d250cf9df7 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:36 devstack sudo[106433]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:36 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-afa4bf9c-d14d-45d8-afda-b49c7eed7933 tempest-ProjectMemberTests-64253088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b238aec1-6da0-4321-81f4-cf0fe31fbe86 -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b238aec1-6da0-4321-81f4-cf0fe31fbe86.78d0afb8-ec03-4484-8113-2a08247c2741" returned: 0 in 0.313s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:36 devstack cinder-volume[87747]: WARNING cinder.volume.drivers.remotefs [None req-afa4bf9c-d14d-45d8-afda-b49c7eed7933 tempest-ProjectMemberTests-64253088 None] /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b238aec1-6da0-4321-81f4-cf0fe31fbe86.78d0afb8-ec03-4484-8113-2a08247c2741 is being set with open permissions: ugo+rw Jul 22 03:35:36 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-afa4bf9c-d14d-45d8-afda-b49c7eed7933 tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b238aec1-6da0-4321-81f4-cf0fe31fbe86.78d0afb8-ec03-4484-8113-2a08247c2741 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:36 devstack sudo[106435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9f5d3083-cf58-4e0e-af3c-e7d250cf9df7 Jul 22 03:35:36 devstack sudo[106435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:36 devstack sudo[106439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b238aec1-6da0-4321-81f4-cf0fe31fbe86.78d0afb8-ec03-4484-8113-2a08247c2741 Jul 22 03:35:36 devstack sudo[106439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:36 devstack sudo[106439]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:36 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-afa4bf9c-d14d-45d8-afda-b49c7eed7933 tempest-ProjectMemberTests-64253088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b238aec1-6da0-4321-81f4-cf0fe31fbe86.78d0afb8-ec03-4484-8113-2a08247c2741" returned: 0 in 0.253s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:36 devstack sudo[106435]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:36 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-62c737fd-9c94-4a71-88cd-5168bf289b4a tempest-ProjectReaderTests-483930896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9f5d3083-cf58-4e0e-af3c-e7d250cf9df7" returned: 0 in 0.373s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:36 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-62c737fd-9c94-4a71-88cd-5168bf289b4a tempest-ProjectReaderTests-483930896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9f5d3083-cf58-4e0e-af3c-e7d250cf9df7 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:36 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-afa4bf9c-d14d-45d8-afda-b49c7eed7933 tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b238aec1-6da0-4321-81f4-cf0fe31fbe86.info {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:36 devstack sudo[106446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9f5d3083-cf58-4e0e-af3c-e7d250cf9df7 Jul 22 03:35:36 devstack sudo[106446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:36 devstack sudo[106447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b238aec1-6da0-4321-81f4-cf0fe31fbe86.info Jul 22 03:35:36 devstack sudo[106447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:37 devstack sudo[106446]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:37 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-62c737fd-9c94-4a71-88cd-5168bf289b4a tempest-ProjectReaderTests-483930896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-9f5d3083-cf58-4e0e-af3c-e7d250cf9df7" returned: 0 in 0.250s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:37 devstack sudo[106447]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:37 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-afa4bf9c-d14d-45d8-afda-b49c7eed7933 tempest-ProjectMemberTests-64253088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b238aec1-6da0-4321-81f4-cf0fe31fbe86.info" returned: 0 in 0.247s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:37 devstack cinder-volume[87747]: WARNING cinder.volume.drivers.remotefs [None req-afa4bf9c-d14d-45d8-afda-b49c7eed7933 tempest-ProjectMemberTests-64253088 None] /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b238aec1-6da0-4321-81f4-cf0fe31fbe86.info is being set with open permissions: ugo+rw Jul 22 03:35:37 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-afa4bf9c-d14d-45d8-afda-b49c7eed7933 tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b238aec1-6da0-4321-81f4-cf0fe31fbe86.info {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:37 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-62c737fd-9c94-4a71-88cd-5168bf289b4a tempest-ProjectReaderTests-483930896 None] Lock "cinder-quobyte-9f5d3083-cf58-4e0e-af3c-e7d250cf9df7" released by "delete_volume" :: held 0.694s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:35:37 devstack sudo[106452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b238aec1-6da0-4321-81f4-cf0fe31fbe86.info Jul 22 03:35:37 devstack sudo[106452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:37 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-62c737fd-9c94-4a71-88cd-5168bf289b4a tempest-ProjectReaderTests-483930896 None] Created reservations ['bf684f96-53e9-4f22-9f14-566334e979f9', 'c060c8e3-ac82-4e68-b1cc-17a79584793c', '6a61e739-01cc-4312-9b6d-63c4df53035e', 'e4564d0f-6249-42b0-9ce4-0328196d3e9c'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:35:37 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-62c737fd-9c94-4a71-88cd-5168bf289b4a tempest-ProjectReaderTests-483930896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:35:37 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-62c737fd-9c94-4a71-88cd-5168bf289b4a tempest-ProjectReaderTests-483930896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:35:37 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-62c737fd-9c94-4a71-88cd-5168bf289b4a tempest-ProjectReaderTests-483930896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:35:37 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-62c737fd-9c94-4a71-88cd-5168bf289b4a tempest-ProjectReaderTests-483930896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:35:37 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-62c737fd-9c94-4a71-88cd-5168bf289b4a tempest-ProjectReaderTests-483930896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:35:37 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-62c737fd-9c94-4a71-88cd-5168bf289b4a tempest-ProjectReaderTests-483930896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:37 devstack sudo[106454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:35:37 devstack sudo[106454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:37 devstack sudo[106452]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:37 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-afa4bf9c-d14d-45d8-afda-b49c7eed7933 tempest-ProjectMemberTests-64253088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b238aec1-6da0-4321-81f4-cf0fe31fbe86.info" returned: 0 in 0.239s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:37 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-afa4bf9c-d14d-45d8-afda-b49c7eed7933 tempest-ProjectMemberTests-64253088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.900s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:35:37 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-afa4bf9c-d14d-45d8-afda-b49c7eed7933 tempest-ProjectMemberTests-64253088 None] Create snapshot completed successfully Jul 22 03:35:37 devstack sudo[106454]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:37 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-62c737fd-9c94-4a71-88cd-5168bf289b4a tempest-ProjectReaderTests-483930896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.257s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:37 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-62c737fd-9c94-4a71-88cd-5168bf289b4a tempest-ProjectReaderTests-483930896 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:35:37 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-62c737fd-9c94-4a71-88cd-5168bf289b4a tempest-ProjectReaderTests-483930896 None] Deleted volume successfully. Jul 22 03:35:37 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-62c737fd-9c94-4a71-88cd-5168bf289b4a tempest-ProjectReaderTests-483930896 None] Lock "cinder-9f5d3083-cf58-4e0e-af3c-e7d250cf9df7-delete_volume" released by "delete_volume" :: held 1.164s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:35:37 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-cef854c1-e851-4d14-9785-e8108e51bbfd tempest-ProjectMemberTests-64253088 None] Acquiring lock "cinder-78d0afb8-ec03-4484-8113-2a08247c2741-delete_snapshot" by "delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:35:37 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-cef854c1-e851-4d14-9785-e8108e51bbfd tempest-ProjectMemberTests-64253088 None] Lock "cinder-78d0afb8-ec03-4484-8113-2a08247c2741-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:35:37 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-cef854c1-e851-4d14-9785-e8108e51bbfd tempest-ProjectMemberTests-64253088 None] Acquiring lock "cinder-quobyte-b238aec1-6da0-4321-81f4-cf0fe31fbe86" by "delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:35:37 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-cef854c1-e851-4d14-9785-e8108e51bbfd tempest-ProjectMemberTests-64253088 None] Lock "cinder-quobyte-b238aec1-6da0-4321-81f4-cf0fe31fbe86" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:35:37 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-cef854c1-e851-4d14-9785-e8108e51bbfd tempest-ProjectMemberTests-64253088 None] Acquiring lock "cinder-quobyte-78d0afb8-ec03-4484-8113-2a08247c2741" by "_delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:35:37 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-cef854c1-e851-4d14-9785-e8108e51bbfd tempest-ProjectMemberTests-64253088 None] Lock "cinder-quobyte-78d0afb8-ec03-4484-8113-2a08247c2741" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:35:37 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-cef854c1-e851-4d14-9785-e8108e51bbfd tempest-ProjectMemberTests-64253088 None] Deleting offline snapshot 78d0afb8-ec03-4484-8113-2a08247c2741 of volume b238aec1-6da0-4321-81f4-cf0fe31fbe86 {{(pid=87747) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 03:35:37 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-cef854c1-e851-4d14-9785-e8108e51bbfd tempest-ProjectMemberTests-64253088 None] snapshot_file for this snap is: volume-b238aec1-6da0-4321-81f4-cf0fe31fbe86.78d0afb8-ec03-4484-8113-2a08247c2741 {{(pid=87747) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 03:35:37 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2e74143-b608-4902-b21d-2950356fc944]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:35:37 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-cef854c1-e851-4d14-9785-e8108e51bbfd tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b238aec1-6da0-4321-81f4-cf0fe31fbe86.78d0afb8-ec03-4484-8113-2a08247c2741 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:37 devstack sudo[106458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b238aec1-6da0-4321-81f4-cf0fe31fbe86.78d0afb8-ec03-4484-8113-2a08247c2741 Jul 22 03:35:37 devstack sudo[106458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:38 devstack sudo[106458]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:38 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-cef854c1-e851-4d14-9785-e8108e51bbfd tempest-ProjectMemberTests-64253088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b238aec1-6da0-4321-81f4-cf0fe31fbe86.78d0afb8-ec03-4484-8113-2a08247c2741" returned: 0 in 0.381s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:38 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-cef854c1-e851-4d14-9785-e8108e51bbfd tempest-ProjectMemberTests-64253088 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b238aec1-6da0-4321-81f4-cf0fe31fbe86(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87747) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 03:35:38 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[399c0ccb-de65-48ad-9c9f-6ed4ee02f235]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:35:38 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-cef854c1-e851-4d14-9785-e8108e51bbfd tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b238aec1-6da0-4321-81f4-cf0fe31fbe86 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:38 devstack sudo[106463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b238aec1-6da0-4321-81f4-cf0fe31fbe86 Jul 22 03:35:38 devstack sudo[106463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:38 devstack sudo[106463]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:38 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-cef854c1-e851-4d14-9785-e8108e51bbfd tempest-ProjectMemberTests-64253088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b238aec1-6da0-4321-81f4-cf0fe31fbe86" returned: 0 in 0.373s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:38 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-cef854c1-e851-4d14-9785-e8108e51bbfd tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b238aec1-6da0-4321-81f4-cf0fe31fbe86.78d0afb8-ec03-4484-8113-2a08247c2741 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:38 devstack sudo[106468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b238aec1-6da0-4321-81f4-cf0fe31fbe86.78d0afb8-ec03-4484-8113-2a08247c2741 Jul 22 03:35:38 devstack sudo[106468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:38 devstack sudo[106468]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:38 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-cef854c1-e851-4d14-9785-e8108e51bbfd tempest-ProjectMemberTests-64253088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b238aec1-6da0-4321-81f4-cf0fe31fbe86.78d0afb8-ec03-4484-8113-2a08247c2741" returned: 0 in 0.389s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:38 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-cef854c1-e851-4d14-9785-e8108e51bbfd tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b238aec1-6da0-4321-81f4-cf0fe31fbe86.78d0afb8-ec03-4484-8113-2a08247c2741 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:38 devstack sudo[106474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b238aec1-6da0-4321-81f4-cf0fe31fbe86.78d0afb8-ec03-4484-8113-2a08247c2741 Jul 22 03:35:38 devstack sudo[106474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:39 devstack sudo[106474]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:39 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-cef854c1-e851-4d14-9785-e8108e51bbfd tempest-ProjectMemberTests-64253088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b238aec1-6da0-4321-81f4-cf0fe31fbe86.78d0afb8-ec03-4484-8113-2a08247c2741" returned: 0 in 0.275s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:39 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-cef854c1-e851-4d14-9785-e8108e51bbfd tempest-ProjectMemberTests-64253088 None] Lock "cinder-quobyte-78d0afb8-ec03-4484-8113-2a08247c2741" released by "_delete_snapshot" :: held 1.516s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:35:39 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-cef854c1-e851-4d14-9785-e8108e51bbfd tempest-ProjectMemberTests-64253088 None] Lock "cinder-quobyte-b238aec1-6da0-4321-81f4-cf0fe31fbe86" released by "delete_snapshot" :: held 1.544s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:35:39 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-cef854c1-e851-4d14-9785-e8108e51bbfd tempest-ProjectMemberTests-64253088 None] Created reservations ['dc520d92-3fd1-41a9-bc93-6a713901f0aa', '983f140e-c418-4140-96cd-77b4cc3e4501', '7502fbd5-a6c6-4bae-a22e-e40071f5ba9f', '183c755e-dec0-46ce-8950-90f5b6b46203'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:35:39 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-cef854c1-e851-4d14-9785-e8108e51bbfd tempest-ProjectMemberTests-64253088 None] Delete snapshot completed successfully. Jul 22 03:35:39 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-cef854c1-e851-4d14-9785-e8108e51bbfd tempest-ProjectMemberTests-64253088 None] Lock "cinder-78d0afb8-ec03-4484-8113-2a08247c2741-delete_snapshot" released by "delete_snapshot" :: held 1.690s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:35:39 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-ec8eddac-229b-41b2-b5cd-b1f3e50e3f18 tempest-ProjectMemberTests-64253088 None] Acquiring lock "cinder-b238aec1-6da0-4321-81f4-cf0fe31fbe86-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:35:39 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-ec8eddac-229b-41b2-b5cd-b1f3e50e3f18 tempest-ProjectMemberTests-64253088 None] Lock "cinder-b238aec1-6da0-4321-81f4-cf0fe31fbe86-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:35:39 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-ec8eddac-229b-41b2-b5cd-b1f3e50e3f18 tempest-ProjectMemberTests-64253088 None] Acquiring lock "cinder-quobyte-b238aec1-6da0-4321-81f4-cf0fe31fbe86" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:35:39 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-ec8eddac-229b-41b2-b5cd-b1f3e50e3f18 tempest-ProjectMemberTests-64253088 None] Lock "cinder-quobyte-b238aec1-6da0-4321-81f4-cf0fe31fbe86" acquired by "delete_volume" :: waited 0.025s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:35:39 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a79df75-b868-44ae-ba73-7bc200a5dd1d]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:35:39 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ec8eddac-229b-41b2-b5cd-b1f3e50e3f18 tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b238aec1-6da0-4321-81f4-cf0fe31fbe86 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:40 devstack sudo[106513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b238aec1-6da0-4321-81f4-cf0fe31fbe86 Jul 22 03:35:40 devstack sudo[106513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:40 devstack sudo[106513]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:40 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ec8eddac-229b-41b2-b5cd-b1f3e50e3f18 tempest-ProjectMemberTests-64253088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b238aec1-6da0-4321-81f4-cf0fe31fbe86" returned: 0 in 0.387s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:40 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ec8eddac-229b-41b2-b5cd-b1f3e50e3f18 tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b238aec1-6da0-4321-81f4-cf0fe31fbe86 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:40 devstack sudo[106518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b238aec1-6da0-4321-81f4-cf0fe31fbe86 Jul 22 03:35:40 devstack sudo[106518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:40 devstack sudo[106518]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:40 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ec8eddac-229b-41b2-b5cd-b1f3e50e3f18 tempest-ProjectMemberTests-64253088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b238aec1-6da0-4321-81f4-cf0fe31fbe86" returned: 0 in 0.248s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:40 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-ec8eddac-229b-41b2-b5cd-b1f3e50e3f18 tempest-ProjectMemberTests-64253088 None] Lock "cinder-quobyte-b238aec1-6da0-4321-81f4-cf0fe31fbe86" released by "delete_volume" :: held 0.700s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:35:40 devstack cinder-volume[87747]: DEBUG dbcounter [-] [87747] Writing DB stats cinder:SELECT=188,cinder:INSERT=64,cinder:UPDATE=224,cinder:DELETE=22 {{(pid=87747) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 03:35:40 devstack cinder-volume[87747]: DEBUG dbcounter [-] [87747] Writing DB stats cinder:UPDATE=251,cinder:SELECT=187,cinder:INSERT=65,cinder:DELETE=18 {{(pid=87747) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 03:35:40 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-ec8eddac-229b-41b2-b5cd-b1f3e50e3f18 tempest-ProjectMemberTests-64253088 None] Created reservations ['7e3065a7-4891-44e1-b443-dfd0283291e5', '62ce85ee-9f1c-4da7-a7f6-15d592664eae', '1b657b4b-77dd-4ff4-8bee-4c29609f04f0', '53ea98dd-76e6-4e8d-a773-e72e478f3aac'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:35:40 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-ec8eddac-229b-41b2-b5cd-b1f3e50e3f18 tempest-ProjectMemberTests-64253088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:35:40 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-ec8eddac-229b-41b2-b5cd-b1f3e50e3f18 tempest-ProjectMemberTests-64253088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:35:40 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-ec8eddac-229b-41b2-b5cd-b1f3e50e3f18 tempest-ProjectMemberTests-64253088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:35:40 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-ec8eddac-229b-41b2-b5cd-b1f3e50e3f18 tempest-ProjectMemberTests-64253088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:35:40 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-ec8eddac-229b-41b2-b5cd-b1f3e50e3f18 tempest-ProjectMemberTests-64253088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:35:40 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ec8eddac-229b-41b2-b5cd-b1f3e50e3f18 tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:40 devstack sudo[106521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:35:40 devstack sudo[106521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:41 devstack sudo[106521]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:41 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-ec8eddac-229b-41b2-b5cd-b1f3e50e3f18 tempest-ProjectMemberTests-64253088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.261s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:41 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-ec8eddac-229b-41b2-b5cd-b1f3e50e3f18 tempest-ProjectMemberTests-64253088 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:35:41 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-ec8eddac-229b-41b2-b5cd-b1f3e50e3f18 tempest-ProjectMemberTests-64253088 None] Deleted volume successfully. Jul 22 03:35:41 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-ec8eddac-229b-41b2-b5cd-b1f3e50e3f18 tempest-ProjectMemberTests-64253088 None] Lock "cinder-b238aec1-6da0-4321-81f4-cf0fe31fbe86-delete_volume" released by "delete_volume" :: held 1.210s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:35:41 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-750559e7-6395-4a11-a227-8a1f70a7d3ef tempest-ProjectMemberTests-64253088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:35:41 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-750559e7-6395-4a11-a227-8a1f70a7d3ef tempest-ProjectMemberTests-64253088 None] Flow 'volume_create_manager' (d190f77c-8b29-4815-ac14-7937ad300cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:35:41 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-750559e7-6395-4a11-a227-8a1f70a7d3ef tempest-ProjectMemberTests-64253088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23c3589c-aaef-47c5-a4a0-fbc87ccdf8ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:35:41 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-750559e7-6395-4a11-a227-8a1f70a7d3ef tempest-ProjectMemberTests-64253088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23c3589c-aaef-47c5-a4a0-fbc87ccdf8ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:35:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-358562786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e91c203-e39e-47ed-84a8-b4a9a16e78ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05eb3b4eac3e4ffe97247852227f9ffa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:35:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:35:41Z,use_quota=True,user_id='ecf77e3a2be443e28cffe6ba02afc5e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:35:41 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-750559e7-6395-4a11-a227-8a1f70a7d3ef tempest-ProjectMemberTests-64253088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d0681fd-a92e-4cba-bea6-f1c684842084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:35:41 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-750559e7-6395-4a11-a227-8a1f70a7d3ef tempest-ProjectMemberTests-64253088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d0681fd-a92e-4cba-bea6-f1c684842084) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:35:41 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-750559e7-6395-4a11-a227-8a1f70a7d3ef tempest-ProjectMemberTests-64253088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a75066c6-6dc8-459a-9e46-3aa9c93daf3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:35:41 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-750559e7-6395-4a11-a227-8a1f70a7d3ef tempest-ProjectMemberTests-64253088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a75066c6-6dc8-459a-9e46-3aa9c93daf3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e91c203-e39e-47ed-84a8-b4a9a16e78ae', 'volume_name': 'volume-3e91c203-e39e-47ed-84a8-b4a9a16e78ae', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:35:41 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-750559e7-6395-4a11-a227-8a1f70a7d3ef tempest-ProjectMemberTests-64253088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19b385b7-64f4-42e3-be06-44abe11b9e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:35:41 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-750559e7-6395-4a11-a227-8a1f70a7d3ef tempest-ProjectMemberTests-64253088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19b385b7-64f4-42e3-be06-44abe11b9e2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:35:41 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-750559e7-6395-4a11-a227-8a1f70a7d3ef tempest-ProjectMemberTests-64253088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ffc586d-f61d-4203-9509-f7692356d52c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:35:41 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-750559e7-6395-4a11-a227-8a1f70a7d3ef tempest-ProjectMemberTests-64253088 None] Volume 3e91c203-e39e-47ed-84a8-b4a9a16e78ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e91c203-e39e-47ed-84a8-b4a9a16e78ae', 'volume_size': 1} Jul 22 03:35:41 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-750559e7-6395-4a11-a227-8a1f70a7d3ef tempest-ProjectMemberTests-64253088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:35:41 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-750559e7-6395-4a11-a227-8a1f70a7d3ef tempest-ProjectMemberTests-64253088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:35:41 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-750559e7-6395-4a11-a227-8a1f70a7d3ef tempest-ProjectMemberTests-64253088 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:35:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-358562786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e91c203-e39e-47ed-84a8-b4a9a16e78ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05eb3b4eac3e4ffe97247852227f9ffa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:35:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:35:41Z,use_quota=True,user_id='ecf77e3a2be443e28cffe6ba02afc5e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:35:41 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-750559e7-6395-4a11-a227-8a1f70a7d3ef tempest-ProjectMemberTests-64253088 None] Creating volume 3e91c203-e39e-47ed-84a8-b4a9a16e78ae {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:35:41 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-750559e7-6395-4a11-a227-8a1f70a7d3ef tempest-ProjectMemberTests-64253088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:35:41 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-750559e7-6395-4a11-a227-8a1f70a7d3ef tempest-ProjectMemberTests-64253088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:35:41 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-750559e7-6395-4a11-a227-8a1f70a7d3ef tempest-ProjectMemberTests-64253088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:35:41 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-750559e7-6395-4a11-a227-8a1f70a7d3ef tempest-ProjectMemberTests-64253088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:35:41 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-750559e7-6395-4a11-a227-8a1f70a7d3ef tempest-ProjectMemberTests-64253088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:35:41 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-750559e7-6395-4a11-a227-8a1f70a7d3ef tempest-ProjectMemberTests-64253088 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:35:41 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-750559e7-6395-4a11-a227-8a1f70a7d3ef tempest-ProjectMemberTests-64253088 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:35:41 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-750559e7-6395-4a11-a227-8a1f70a7d3ef tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3e91c203-e39e-47ed-84a8-b4a9a16e78ae 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:41 devstack sudo[106524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3e91c203-e39e-47ed-84a8-b4a9a16e78ae 1073741824 Jul 22 03:35:41 devstack sudo[106524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:42 devstack sudo[106524]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:42 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-750559e7-6395-4a11-a227-8a1f70a7d3ef tempest-ProjectMemberTests-64253088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3e91c203-e39e-47ed-84a8-b4a9a16e78ae 1073741824" returned: 0 in 0.457s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:42 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-750559e7-6395-4a11-a227-8a1f70a7d3ef tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3e91c203-e39e-47ed-84a8-b4a9a16e78ae {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:42 devstack sudo[106530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3e91c203-e39e-47ed-84a8-b4a9a16e78ae Jul 22 03:35:42 devstack sudo[106530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:42 devstack sudo[106530]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:42 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-750559e7-6395-4a11-a227-8a1f70a7d3ef tempest-ProjectMemberTests-64253088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3e91c203-e39e-47ed-84a8-b4a9a16e78ae" returned: 0 in 0.257s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:42 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-750559e7-6395-4a11-a227-8a1f70a7d3ef tempest-ProjectMemberTests-64253088 None] <== create_volume: return (757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:35:42 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-750559e7-6395-4a11-a227-8a1f70a7d3ef tempest-ProjectMemberTests-64253088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.759s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:35:42 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-750559e7-6395-4a11-a227-8a1f70a7d3ef tempest-ProjectMemberTests-64253088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ffc586d-f61d-4203-9509-f7692356d52c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e91c203-e39e-47ed-84a8-b4a9a16e78ae', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:35:42 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-750559e7-6395-4a11-a227-8a1f70a7d3ef tempest-ProjectMemberTests-64253088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (717e82c3-e137-41b3-a96b-5510afa68720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:35:42 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-750559e7-6395-4a11-a227-8a1f70a7d3ef tempest-ProjectMemberTests-64253088 None] Volume volume-3e91c203-e39e-47ed-84a8-b4a9a16e78ae (3e91c203-e39e-47ed-84a8-b4a9a16e78ae): created successfully Jul 22 03:35:42 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-750559e7-6395-4a11-a227-8a1f70a7d3ef tempest-ProjectMemberTests-64253088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (717e82c3-e137-41b3-a96b-5510afa68720) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:35:42 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-750559e7-6395-4a11-a227-8a1f70a7d3ef tempest-ProjectMemberTests-64253088 None] Flow 'volume_create_manager' (d190f77c-8b29-4815-ac14-7937ad300cdb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:35:42 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-750559e7-6395-4a11-a227-8a1f70a7d3ef tempest-ProjectMemberTests-64253088 None] Created volume successfully. Jul 22 03:35:42 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-81e8ece2-650c-4238-8300-5866a811abb6 tempest-ProjectMemberTests-64253088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:35:42 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-81e8ece2-650c-4238-8300-5866a811abb6 tempest-ProjectMemberTests-64253088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:35:42 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-81e8ece2-650c-4238-8300-5866a811abb6 tempest-ProjectMemberTests-64253088 None] Creating offline snapshot ef6788f5-2dec-4fe2-b2cc-d1663ab52c21 of volume 3e91c203-e39e-47ed-84a8-b4a9a16e78ae {{(pid=87747) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 03:35:42 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[e341a030-73de-480c-9eee-9d488666baca]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:35:42 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-81e8ece2-650c-4238-8300-5866a811abb6 tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3e91c203-e39e-47ed-84a8-b4a9a16e78ae {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:42 devstack sudo[106533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3e91c203-e39e-47ed-84a8-b4a9a16e78ae Jul 22 03:35:42 devstack sudo[106533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:43 devstack sudo[106533]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:43 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-81e8ece2-650c-4238-8300-5866a811abb6 tempest-ProjectMemberTests-64253088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3e91c203-e39e-47ed-84a8-b4a9a16e78ae" returned: 0 in 0.391s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:43 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-81e8ece2-650c-4238-8300-5866a811abb6 tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3e91c203-e39e-47ed-84a8-b4a9a16e78ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3e91c203-e39e-47ed-84a8-b4a9a16e78ae.ef6788f5-2dec-4fe2-b2cc-d1663ab52c21 1G {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:43 devstack sudo[106538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3e91c203-e39e-47ed-84a8-b4a9a16e78ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3e91c203-e39e-47ed-84a8-b4a9a16e78ae.ef6788f5-2dec-4fe2-b2cc-d1663ab52c21 1G Jul 22 03:35:43 devstack sudo[106538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:43 devstack sudo[106538]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:43 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-81e8ece2-650c-4238-8300-5866a811abb6 tempest-ProjectMemberTests-64253088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3e91c203-e39e-47ed-84a8-b4a9a16e78ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3e91c203-e39e-47ed-84a8-b4a9a16e78ae.ef6788f5-2dec-4fe2-b2cc-d1663ab52c21 1G" returned: 0 in 0.401s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:43 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-81e8ece2-650c-4238-8300-5866a811abb6 tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e91c203-e39e-47ed-84a8-b4a9a16e78ae -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3e91c203-e39e-47ed-84a8-b4a9a16e78ae.ef6788f5-2dec-4fe2-b2cc-d1663ab52c21 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:43 devstack sudo[106545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e91c203-e39e-47ed-84a8-b4a9a16e78ae -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3e91c203-e39e-47ed-84a8-b4a9a16e78ae.ef6788f5-2dec-4fe2-b2cc-d1663ab52c21 Jul 22 03:35:43 devstack sudo[106545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:43 devstack sudo[106545]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:43 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-81e8ece2-650c-4238-8300-5866a811abb6 tempest-ProjectMemberTests-64253088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e91c203-e39e-47ed-84a8-b4a9a16e78ae -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3e91c203-e39e-47ed-84a8-b4a9a16e78ae.ef6788f5-2dec-4fe2-b2cc-d1663ab52c21" returned: 0 in 0.302s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:43 devstack cinder-volume[87747]: WARNING cinder.volume.drivers.remotefs [None req-81e8ece2-650c-4238-8300-5866a811abb6 tempest-ProjectMemberTests-64253088 None] /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3e91c203-e39e-47ed-84a8-b4a9a16e78ae.ef6788f5-2dec-4fe2-b2cc-d1663ab52c21 is being set with open permissions: ugo+rw Jul 22 03:35:43 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-81e8ece2-650c-4238-8300-5866a811abb6 tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3e91c203-e39e-47ed-84a8-b4a9a16e78ae.ef6788f5-2dec-4fe2-b2cc-d1663ab52c21 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:43 devstack sudo[106550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3e91c203-e39e-47ed-84a8-b4a9a16e78ae.ef6788f5-2dec-4fe2-b2cc-d1663ab52c21 Jul 22 03:35:43 devstack sudo[106550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:44 devstack sudo[106550]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:44 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-81e8ece2-650c-4238-8300-5866a811abb6 tempest-ProjectMemberTests-64253088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3e91c203-e39e-47ed-84a8-b4a9a16e78ae.ef6788f5-2dec-4fe2-b2cc-d1663ab52c21" returned: 0 in 0.240s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:44 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-81e8ece2-650c-4238-8300-5866a811abb6 tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3e91c203-e39e-47ed-84a8-b4a9a16e78ae.info {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:44 devstack sudo[106553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3e91c203-e39e-47ed-84a8-b4a9a16e78ae.info Jul 22 03:35:44 devstack sudo[106553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:44 devstack sudo[106553]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:44 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-81e8ece2-650c-4238-8300-5866a811abb6 tempest-ProjectMemberTests-64253088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3e91c203-e39e-47ed-84a8-b4a9a16e78ae.info" returned: 0 in 0.250s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:44 devstack cinder-volume[87747]: WARNING cinder.volume.drivers.remotefs [None req-81e8ece2-650c-4238-8300-5866a811abb6 tempest-ProjectMemberTests-64253088 None] /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3e91c203-e39e-47ed-84a8-b4a9a16e78ae.info is being set with open permissions: ugo+rw Jul 22 03:35:44 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-81e8ece2-650c-4238-8300-5866a811abb6 tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3e91c203-e39e-47ed-84a8-b4a9a16e78ae.info {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:44 devstack sudo[106556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3e91c203-e39e-47ed-84a8-b4a9a16e78ae.info Jul 22 03:35:44 devstack sudo[106556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:44 devstack sudo[106556]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:44 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-81e8ece2-650c-4238-8300-5866a811abb6 tempest-ProjectMemberTests-64253088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3e91c203-e39e-47ed-84a8-b4a9a16e78ae.info" returned: 0 in 0.237s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:44 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-81e8ece2-650c-4238-8300-5866a811abb6 tempest-ProjectMemberTests-64253088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.912s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:35:44 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-81e8ece2-650c-4238-8300-5866a811abb6 tempest-ProjectMemberTests-64253088 None] Create snapshot completed successfully Jul 22 03:35:44 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-5edfee48-8272-4c92-aed1-9ea68d5dae24 tempest-ProjectMemberTests-64253088 None] Acquiring lock "cinder-ef6788f5-2dec-4fe2-b2cc-d1663ab52c21-delete_snapshot" by "delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:35:44 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-5edfee48-8272-4c92-aed1-9ea68d5dae24 tempest-ProjectMemberTests-64253088 None] Lock "cinder-ef6788f5-2dec-4fe2-b2cc-d1663ab52c21-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:35:44 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-5edfee48-8272-4c92-aed1-9ea68d5dae24 tempest-ProjectMemberTests-64253088 None] Acquiring lock "cinder-quobyte-3e91c203-e39e-47ed-84a8-b4a9a16e78ae" by "delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:35:44 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-5edfee48-8272-4c92-aed1-9ea68d5dae24 tempest-ProjectMemberTests-64253088 None] Lock "cinder-quobyte-3e91c203-e39e-47ed-84a8-b4a9a16e78ae" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:35:44 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-5edfee48-8272-4c92-aed1-9ea68d5dae24 tempest-ProjectMemberTests-64253088 None] Acquiring lock "cinder-quobyte-ef6788f5-2dec-4fe2-b2cc-d1663ab52c21" by "_delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:35:44 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-5edfee48-8272-4c92-aed1-9ea68d5dae24 tempest-ProjectMemberTests-64253088 None] Lock "cinder-quobyte-ef6788f5-2dec-4fe2-b2cc-d1663ab52c21" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:35:44 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-5edfee48-8272-4c92-aed1-9ea68d5dae24 tempest-ProjectMemberTests-64253088 None] Deleting offline snapshot ef6788f5-2dec-4fe2-b2cc-d1663ab52c21 of volume 3e91c203-e39e-47ed-84a8-b4a9a16e78ae {{(pid=87747) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 03:35:44 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-5edfee48-8272-4c92-aed1-9ea68d5dae24 tempest-ProjectMemberTests-64253088 None] snapshot_file for this snap is: volume-3e91c203-e39e-47ed-84a8-b4a9a16e78ae.ef6788f5-2dec-4fe2-b2cc-d1663ab52c21 {{(pid=87747) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 03:35:44 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5ae2c1f-a6bd-457c-bcc6-657534f3bb62]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:35:44 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5edfee48-8272-4c92-aed1-9ea68d5dae24 tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3e91c203-e39e-47ed-84a8-b4a9a16e78ae.ef6788f5-2dec-4fe2-b2cc-d1663ab52c21 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:45 devstack sudo[106559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3e91c203-e39e-47ed-84a8-b4a9a16e78ae.ef6788f5-2dec-4fe2-b2cc-d1663ab52c21 Jul 22 03:35:45 devstack sudo[106559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:45 devstack sudo[106559]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:45 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5edfee48-8272-4c92-aed1-9ea68d5dae24 tempest-ProjectMemberTests-64253088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3e91c203-e39e-47ed-84a8-b4a9a16e78ae.ef6788f5-2dec-4fe2-b2cc-d1663ab52c21" returned: 0 in 0.370s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:45 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-5edfee48-8272-4c92-aed1-9ea68d5dae24 tempest-ProjectMemberTests-64253088 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e91c203-e39e-47ed-84a8-b4a9a16e78ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87747) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 03:35:45 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[78cc8a3d-1c91-49de-8dff-bb13239647b6]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:35:45 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5edfee48-8272-4c92-aed1-9ea68d5dae24 tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3e91c203-e39e-47ed-84a8-b4a9a16e78ae {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:45 devstack sudo[106565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3e91c203-e39e-47ed-84a8-b4a9a16e78ae Jul 22 03:35:45 devstack sudo[106565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:45 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e0279f2-f5e3-457a-ba7a-f959ed62d11c tempest-ProjectReaderTests-1282741293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:35:45 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-0e0279f2-f5e3-457a-ba7a-f959ed62d11c tempest-ProjectReaderTests-1282741293 None] Flow 'volume_create_manager' (ed6c8137-6688-4d01-a905-bbd7fd1be9b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:35:45 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-0e0279f2-f5e3-457a-ba7a-f959ed62d11c tempest-ProjectReaderTests-1282741293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (592005c3-3697-443a-a8e1-643c9d179910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:35:45 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-0e0279f2-f5e3-457a-ba7a-f959ed62d11c tempest-ProjectReaderTests-1282741293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (592005c3-3697-443a-a8e1-643c9d179910) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:35:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1172558829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=193ffcd8-6d5d-4310-9f5c-f7ce81daac4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7136d33fbff44dd58bcb5c13580df340',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:35:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:35:46Z,use_quota=True,user_id='d95cad1d40d14453904bb8e8981fb1d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:35:45 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-0e0279f2-f5e3-457a-ba7a-f959ed62d11c tempest-ProjectReaderTests-1282741293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8970c23c-ab17-4e0f-b2d5-5aca88ca21b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:35:45 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-0e0279f2-f5e3-457a-ba7a-f959ed62d11c tempest-ProjectReaderTests-1282741293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8970c23c-ab17-4e0f-b2d5-5aca88ca21b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:35:45 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-0e0279f2-f5e3-457a-ba7a-f959ed62d11c tempest-ProjectReaderTests-1282741293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d35fb34-fd9f-45dd-9574-299c21b0ce83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:35:45 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-0e0279f2-f5e3-457a-ba7a-f959ed62d11c tempest-ProjectReaderTests-1282741293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d35fb34-fd9f-45dd-9574-299c21b0ce83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '193ffcd8-6d5d-4310-9f5c-f7ce81daac4b', 'volume_name': 'volume-193ffcd8-6d5d-4310-9f5c-f7ce81daac4b', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:35:45 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-0e0279f2-f5e3-457a-ba7a-f959ed62d11c tempest-ProjectReaderTests-1282741293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e26c94ad-3a53-4149-8a48-766940c8f8aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:35:45 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-0e0279f2-f5e3-457a-ba7a-f959ed62d11c tempest-ProjectReaderTests-1282741293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e26c94ad-3a53-4149-8a48-766940c8f8aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:35:45 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-0e0279f2-f5e3-457a-ba7a-f959ed62d11c tempest-ProjectReaderTests-1282741293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09765755-559a-4a9f-ab02-b47d82699df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:35:45 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-0e0279f2-f5e3-457a-ba7a-f959ed62d11c tempest-ProjectReaderTests-1282741293 None] Volume 193ffcd8-6d5d-4310-9f5c-f7ce81daac4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-193ffcd8-6d5d-4310-9f5c-f7ce81daac4b', 'volume_size': 1} Jul 22 03:35:45 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-0e0279f2-f5e3-457a-ba7a-f959ed62d11c tempest-ProjectReaderTests-1282741293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:35:45 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-0e0279f2-f5e3-457a-ba7a-f959ed62d11c tempest-ProjectReaderTests-1282741293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:35:45 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-0e0279f2-f5e3-457a-ba7a-f959ed62d11c tempest-ProjectReaderTests-1282741293 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:35:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1172558829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=193ffcd8-6d5d-4310-9f5c-f7ce81daac4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7136d33fbff44dd58bcb5c13580df340',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:35:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:35:46Z,use_quota=True,user_id='d95cad1d40d14453904bb8e8981fb1d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:35:45 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-0e0279f2-f5e3-457a-ba7a-f959ed62d11c tempest-ProjectReaderTests-1282741293 None] Creating volume 193ffcd8-6d5d-4310-9f5c-f7ce81daac4b {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:35:45 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-0e0279f2-f5e3-457a-ba7a-f959ed62d11c tempest-ProjectReaderTests-1282741293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:35:45 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-0e0279f2-f5e3-457a-ba7a-f959ed62d11c tempest-ProjectReaderTests-1282741293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:35:45 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-0e0279f2-f5e3-457a-ba7a-f959ed62d11c tempest-ProjectReaderTests-1282741293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:35:45 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-0e0279f2-f5e3-457a-ba7a-f959ed62d11c tempest-ProjectReaderTests-1282741293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:35:45 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-0e0279f2-f5e3-457a-ba7a-f959ed62d11c tempest-ProjectReaderTests-1282741293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:35:45 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-0e0279f2-f5e3-457a-ba7a-f959ed62d11c tempest-ProjectReaderTests-1282741293 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:35:45 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-0e0279f2-f5e3-457a-ba7a-f959ed62d11c tempest-ProjectReaderTests-1282741293 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:35:45 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-0e0279f2-f5e3-457a-ba7a-f959ed62d11c tempest-ProjectReaderTests-1282741293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-193ffcd8-6d5d-4310-9f5c-f7ce81daac4b 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:45 devstack sudo[106575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-193ffcd8-6d5d-4310-9f5c-f7ce81daac4b 1073741824 Jul 22 03:35:45 devstack sudo[106575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:45 devstack sudo[106565]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:45 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5edfee48-8272-4c92-aed1-9ea68d5dae24 tempest-ProjectMemberTests-64253088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3e91c203-e39e-47ed-84a8-b4a9a16e78ae" returned: 0 in 0.394s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:45 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5edfee48-8272-4c92-aed1-9ea68d5dae24 tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3e91c203-e39e-47ed-84a8-b4a9a16e78ae.ef6788f5-2dec-4fe2-b2cc-d1663ab52c21 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:45 devstack sudo[106578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3e91c203-e39e-47ed-84a8-b4a9a16e78ae.ef6788f5-2dec-4fe2-b2cc-d1663ab52c21 Jul 22 03:35:45 devstack sudo[106578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:46 devstack sudo[106578]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:46 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5edfee48-8272-4c92-aed1-9ea68d5dae24 tempest-ProjectMemberTests-64253088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3e91c203-e39e-47ed-84a8-b4a9a16e78ae.ef6788f5-2dec-4fe2-b2cc-d1663ab52c21" returned: 0 in 0.371s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:46 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5edfee48-8272-4c92-aed1-9ea68d5dae24 tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3e91c203-e39e-47ed-84a8-b4a9a16e78ae.ef6788f5-2dec-4fe2-b2cc-d1663ab52c21 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:46 devstack sudo[106575]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:46 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-0e0279f2-f5e3-457a-ba7a-f959ed62d11c tempest-ProjectReaderTests-1282741293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-193ffcd8-6d5d-4310-9f5c-f7ce81daac4b 1073741824" returned: 0 in 0.451s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:46 devstack sudo[106588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3e91c203-e39e-47ed-84a8-b4a9a16e78ae.ef6788f5-2dec-4fe2-b2cc-d1663ab52c21 Jul 22 03:35:46 devstack sudo[106588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:46 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-0e0279f2-f5e3-457a-ba7a-f959ed62d11c tempest-ProjectReaderTests-1282741293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-193ffcd8-6d5d-4310-9f5c-f7ce81daac4b {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:46 devstack sudo[106590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-193ffcd8-6d5d-4310-9f5c-f7ce81daac4b Jul 22 03:35:46 devstack sudo[106590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:46 devstack sudo[106588]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:46 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5edfee48-8272-4c92-aed1-9ea68d5dae24 tempest-ProjectMemberTests-64253088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3e91c203-e39e-47ed-84a8-b4a9a16e78ae.ef6788f5-2dec-4fe2-b2cc-d1663ab52c21" returned: 0 in 0.262s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:46 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-5edfee48-8272-4c92-aed1-9ea68d5dae24 tempest-ProjectMemberTests-64253088 None] Lock "cinder-quobyte-ef6788f5-2dec-4fe2-b2cc-d1663ab52c21" released by "_delete_snapshot" :: held 1.499s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:35:46 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-5edfee48-8272-4c92-aed1-9ea68d5dae24 tempest-ProjectMemberTests-64253088 None] Lock "cinder-quobyte-3e91c203-e39e-47ed-84a8-b4a9a16e78ae" released by "delete_snapshot" :: held 1.527s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:35:46 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-5edfee48-8272-4c92-aed1-9ea68d5dae24 tempest-ProjectMemberTests-64253088 None] Created reservations ['3740c5a5-0994-477d-9414-0cfed4b2b47b', '7729e38a-aeee-4a3b-9b3d-d16025bf1e3b', '00d3051b-5b45-4e7c-b1ae-2907ced35943', 'ab5795d2-8124-483b-bc5c-abc7d71fd6ae'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:35:46 devstack sudo[106590]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:46 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-0e0279f2-f5e3-457a-ba7a-f959ed62d11c tempest-ProjectReaderTests-1282741293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-193ffcd8-6d5d-4310-9f5c-f7ce81daac4b" returned: 0 in 0.273s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:46 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-0e0279f2-f5e3-457a-ba7a-f959ed62d11c tempest-ProjectReaderTests-1282741293 None] <== create_volume: return (849ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:35:46 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-0e0279f2-f5e3-457a-ba7a-f959ed62d11c tempest-ProjectReaderTests-1282741293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.852s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:35:46 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-0e0279f2-f5e3-457a-ba7a-f959ed62d11c tempest-ProjectReaderTests-1282741293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09765755-559a-4a9f-ab02-b47d82699df2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-193ffcd8-6d5d-4310-9f5c-f7ce81daac4b', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:35:46 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-0e0279f2-f5e3-457a-ba7a-f959ed62d11c tempest-ProjectReaderTests-1282741293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c38b184b-fc2f-4cea-98ad-24e71bcceb41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:35:46 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-5edfee48-8272-4c92-aed1-9ea68d5dae24 tempest-ProjectMemberTests-64253088 None] Delete snapshot completed successfully. Jul 22 03:35:46 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-5edfee48-8272-4c92-aed1-9ea68d5dae24 tempest-ProjectMemberTests-64253088 None] Lock "cinder-ef6788f5-2dec-4fe2-b2cc-d1663ab52c21-delete_snapshot" released by "delete_snapshot" :: held 1.687s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:35:46 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-0e0279f2-f5e3-457a-ba7a-f959ed62d11c tempest-ProjectReaderTests-1282741293 None] Volume volume-193ffcd8-6d5d-4310-9f5c-f7ce81daac4b (193ffcd8-6d5d-4310-9f5c-f7ce81daac4b): created successfully Jul 22 03:35:46 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-0e0279f2-f5e3-457a-ba7a-f959ed62d11c tempest-ProjectReaderTests-1282741293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c38b184b-fc2f-4cea-98ad-24e71bcceb41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:35:46 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-0e0279f2-f5e3-457a-ba7a-f959ed62d11c tempest-ProjectReaderTests-1282741293 None] Flow 'volume_create_manager' (ed6c8137-6688-4d01-a905-bbd7fd1be9b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:35:46 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-0e0279f2-f5e3-457a-ba7a-f959ed62d11c tempest-ProjectReaderTests-1282741293 None] Created volume successfully. Jul 22 03:35:46 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-6a9b8abe-6a54-432b-bf02-bb0d92b73cd7 tempest-ProjectMemberTests-64253088 None] Acquiring lock "cinder-3e91c203-e39e-47ed-84a8-b4a9a16e78ae-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:35:47 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-6a9b8abe-6a54-432b-bf02-bb0d92b73cd7 tempest-ProjectMemberTests-64253088 None] Lock "cinder-3e91c203-e39e-47ed-84a8-b4a9a16e78ae-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:35:47 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-6a9b8abe-6a54-432b-bf02-bb0d92b73cd7 tempest-ProjectMemberTests-64253088 None] Acquiring lock "cinder-quobyte-3e91c203-e39e-47ed-84a8-b4a9a16e78ae" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:35:47 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-6a9b8abe-6a54-432b-bf02-bb0d92b73cd7 tempest-ProjectMemberTests-64253088 None] Lock "cinder-quobyte-3e91c203-e39e-47ed-84a8-b4a9a16e78ae" acquired by "delete_volume" :: waited 0.015s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:35:47 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[23983239-7902-406f-8533-807f9aefbd12]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:35:47 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-6a9b8abe-6a54-432b-bf02-bb0d92b73cd7 tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3e91c203-e39e-47ed-84a8-b4a9a16e78ae {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:47 devstack sudo[106594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3e91c203-e39e-47ed-84a8-b4a9a16e78ae Jul 22 03:35:47 devstack sudo[106594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:47 devstack sudo[106594]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:47 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-6a9b8abe-6a54-432b-bf02-bb0d92b73cd7 tempest-ProjectMemberTests-64253088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3e91c203-e39e-47ed-84a8-b4a9a16e78ae" returned: 0 in 0.345s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:47 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-6a9b8abe-6a54-432b-bf02-bb0d92b73cd7 tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3e91c203-e39e-47ed-84a8-b4a9a16e78ae {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:47 devstack sudo[106599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3e91c203-e39e-47ed-84a8-b4a9a16e78ae Jul 22 03:35:47 devstack sudo[106599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:47 devstack sudo[106599]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:47 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-6a9b8abe-6a54-432b-bf02-bb0d92b73cd7 tempest-ProjectMemberTests-64253088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-3e91c203-e39e-47ed-84a8-b4a9a16e78ae" returned: 0 in 0.250s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:47 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-6a9b8abe-6a54-432b-bf02-bb0d92b73cd7 tempest-ProjectMemberTests-64253088 None] Lock "cinder-quobyte-3e91c203-e39e-47ed-84a8-b4a9a16e78ae" released by "delete_volume" :: held 0.652s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:35:47 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-6a9b8abe-6a54-432b-bf02-bb0d92b73cd7 tempest-ProjectMemberTests-64253088 None] Created reservations ['c61b8844-9f7b-4509-9cbc-f8da4d69fc2e', 'e4b58a5a-d28d-48b0-8261-4d11ec3289b9', 'bcadb83a-aac3-4068-8f3a-72b061e8e901', '7edca1da-349c-4e81-a2dd-12675e3865a1'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:35:47 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-11d4f1e5-f872-4888-89e8-bbbfec04cf1c tempest-ProjectReaderTests-1282741293 None] Acquiring lock "cinder-193ffcd8-6d5d-4310-9f5c-f7ce81daac4b-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:35:47 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-11d4f1e5-f872-4888-89e8-bbbfec04cf1c tempest-ProjectReaderTests-1282741293 None] Lock "cinder-193ffcd8-6d5d-4310-9f5c-f7ce81daac4b-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:35:47 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-6a9b8abe-6a54-432b-bf02-bb0d92b73cd7 tempest-ProjectMemberTests-64253088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:35:47 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-6a9b8abe-6a54-432b-bf02-bb0d92b73cd7 tempest-ProjectMemberTests-64253088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:35:47 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-6a9b8abe-6a54-432b-bf02-bb0d92b73cd7 tempest-ProjectMemberTests-64253088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:35:47 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-6a9b8abe-6a54-432b-bf02-bb0d92b73cd7 tempest-ProjectMemberTests-64253088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:35:47 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-6a9b8abe-6a54-432b-bf02-bb0d92b73cd7 tempest-ProjectMemberTests-64253088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:35:47 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-6a9b8abe-6a54-432b-bf02-bb0d92b73cd7 tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:47 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-11d4f1e5-f872-4888-89e8-bbbfec04cf1c tempest-ProjectReaderTests-1282741293 None] Acquiring lock "cinder-quobyte-193ffcd8-6d5d-4310-9f5c-f7ce81daac4b" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:35:47 devstack sudo[106602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:35:47 devstack sudo[106602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:47 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-11d4f1e5-f872-4888-89e8-bbbfec04cf1c tempest-ProjectReaderTests-1282741293 None] Lock "cinder-quobyte-193ffcd8-6d5d-4310-9f5c-f7ce81daac4b" acquired by "delete_volume" :: waited 0.015s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:35:47 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0771bd8-6c82-442f-b415-77afd3e28653]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:35:47 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-11d4f1e5-f872-4888-89e8-bbbfec04cf1c tempest-ProjectReaderTests-1282741293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-193ffcd8-6d5d-4310-9f5c-f7ce81daac4b {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:48 devstack sudo[106604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-193ffcd8-6d5d-4310-9f5c-f7ce81daac4b Jul 22 03:35:48 devstack sudo[106604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:48 devstack sudo[106602]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:48 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-6a9b8abe-6a54-432b-bf02-bb0d92b73cd7 tempest-ProjectMemberTests-64253088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.255s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:48 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-6a9b8abe-6a54-432b-bf02-bb0d92b73cd7 tempest-ProjectMemberTests-64253088 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:35:48 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-6a9b8abe-6a54-432b-bf02-bb0d92b73cd7 tempest-ProjectMemberTests-64253088 None] Deleted volume successfully. Jul 22 03:35:48 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-6a9b8abe-6a54-432b-bf02-bb0d92b73cd7 tempest-ProjectMemberTests-64253088 None] Lock "cinder-3e91c203-e39e-47ed-84a8-b4a9a16e78ae-delete_volume" released by "delete_volume" :: held 1.149s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:35:48 devstack sudo[106604]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:48 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-11d4f1e5-f872-4888-89e8-bbbfec04cf1c tempest-ProjectReaderTests-1282741293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-193ffcd8-6d5d-4310-9f5c-f7ce81daac4b" returned: 0 in 0.384s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:48 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-11d4f1e5-f872-4888-89e8-bbbfec04cf1c tempest-ProjectReaderTests-1282741293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-193ffcd8-6d5d-4310-9f5c-f7ce81daac4b {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:48 devstack sudo[106611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-193ffcd8-6d5d-4310-9f5c-f7ce81daac4b Jul 22 03:35:48 devstack sudo[106611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:48 devstack sudo[106611]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:48 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-11d4f1e5-f872-4888-89e8-bbbfec04cf1c tempest-ProjectReaderTests-1282741293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-193ffcd8-6d5d-4310-9f5c-f7ce81daac4b" returned: 0 in 0.278s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:48 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-11d4f1e5-f872-4888-89e8-bbbfec04cf1c tempest-ProjectReaderTests-1282741293 None] Lock "cinder-quobyte-193ffcd8-6d5d-4310-9f5c-f7ce81daac4b" released by "delete_volume" :: held 0.704s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:35:48 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-f65db4d4-f5f4-487b-adf0-b3b339397305 tempest-ProjectMemberTests-64253088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:35:48 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f65db4d4-f5f4-487b-adf0-b3b339397305 tempest-ProjectMemberTests-64253088 None] Flow 'volume_create_manager' (66454ea9-cd78-45c1-88d2-6a3a950cc7a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:35:48 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f65db4d4-f5f4-487b-adf0-b3b339397305 tempest-ProjectMemberTests-64253088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (500913df-9f02-46fa-9977-141b0704d0ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:35:48 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f65db4d4-f5f4-487b-adf0-b3b339397305 tempest-ProjectMemberTests-64253088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (500913df-9f02-46fa-9977-141b0704d0ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:35:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-789389852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b534b6b5-eff7-4b6f-bcc4-9b2f76395a4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05eb3b4eac3e4ffe97247852227f9ffa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:35:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:35:49Z,use_quota=True,user_id='ecf77e3a2be443e28cffe6ba02afc5e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:35:48 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f65db4d4-f5f4-487b-adf0-b3b339397305 tempest-ProjectMemberTests-64253088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (263f0a8c-5b02-429b-84cc-2fd1d660aad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:35:48 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f65db4d4-f5f4-487b-adf0-b3b339397305 tempest-ProjectMemberTests-64253088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (263f0a8c-5b02-429b-84cc-2fd1d660aad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:35:48 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f65db4d4-f5f4-487b-adf0-b3b339397305 tempest-ProjectMemberTests-64253088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84a33984-4c46-4576-8b0e-87695de8d38d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:35:48 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f65db4d4-f5f4-487b-adf0-b3b339397305 tempest-ProjectMemberTests-64253088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84a33984-4c46-4576-8b0e-87695de8d38d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b534b6b5-eff7-4b6f-bcc4-9b2f76395a4e', 'volume_name': 'volume-b534b6b5-eff7-4b6f-bcc4-9b2f76395a4e', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:35:48 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f65db4d4-f5f4-487b-adf0-b3b339397305 tempest-ProjectMemberTests-64253088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f23d613-1014-4651-915c-58615615f363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:35:48 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f65db4d4-f5f4-487b-adf0-b3b339397305 tempest-ProjectMemberTests-64253088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f23d613-1014-4651-915c-58615615f363) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:35:48 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f65db4d4-f5f4-487b-adf0-b3b339397305 tempest-ProjectMemberTests-64253088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc12d112-6311-4c49-86a0-d9aff8dbddb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:35:48 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-f65db4d4-f5f4-487b-adf0-b3b339397305 tempest-ProjectMemberTests-64253088 None] Volume b534b6b5-eff7-4b6f-bcc4-9b2f76395a4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b534b6b5-eff7-4b6f-bcc4-9b2f76395a4e', 'volume_size': 1} Jul 22 03:35:48 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-f65db4d4-f5f4-487b-adf0-b3b339397305 tempest-ProjectMemberTests-64253088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:35:48 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-f65db4d4-f5f4-487b-adf0-b3b339397305 tempest-ProjectMemberTests-64253088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:35:48 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-f65db4d4-f5f4-487b-adf0-b3b339397305 tempest-ProjectMemberTests-64253088 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:35:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-789389852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b534b6b5-eff7-4b6f-bcc4-9b2f76395a4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05eb3b4eac3e4ffe97247852227f9ffa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:35:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:35:49Z,use_quota=True,user_id='ecf77e3a2be443e28cffe6ba02afc5e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:35:48 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-f65db4d4-f5f4-487b-adf0-b3b339397305 tempest-ProjectMemberTests-64253088 None] Creating volume b534b6b5-eff7-4b6f-bcc4-9b2f76395a4e {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:35:48 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-f65db4d4-f5f4-487b-adf0-b3b339397305 tempest-ProjectMemberTests-64253088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:35:48 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-f65db4d4-f5f4-487b-adf0-b3b339397305 tempest-ProjectMemberTests-64253088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:35:48 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-f65db4d4-f5f4-487b-adf0-b3b339397305 tempest-ProjectMemberTests-64253088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:35:48 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-f65db4d4-f5f4-487b-adf0-b3b339397305 tempest-ProjectMemberTests-64253088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:35:48 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-f65db4d4-f5f4-487b-adf0-b3b339397305 tempest-ProjectMemberTests-64253088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:35:48 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-f65db4d4-f5f4-487b-adf0-b3b339397305 tempest-ProjectMemberTests-64253088 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:35:48 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-f65db4d4-f5f4-487b-adf0-b3b339397305 tempest-ProjectMemberTests-64253088 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:35:48 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f65db4d4-f5f4-487b-adf0-b3b339397305 tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b534b6b5-eff7-4b6f-bcc4-9b2f76395a4e 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:48 devstack sudo[106614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b534b6b5-eff7-4b6f-bcc4-9b2f76395a4e 1073741824 Jul 22 03:35:48 devstack sudo[106614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:48 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-11d4f1e5-f872-4888-89e8-bbbfec04cf1c tempest-ProjectReaderTests-1282741293 None] Created reservations ['88e00190-ec9f-47c7-9c6d-97eb6ff8e65a', '11a3a656-c7d2-4088-97c3-ec0fcfd5e13c', '16f8b67b-b45e-4f4d-943f-cf6312ac4483', '855d47d4-1cff-42e6-a5d1-355f08c190d1'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:35:48 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-11d4f1e5-f872-4888-89e8-bbbfec04cf1c tempest-ProjectReaderTests-1282741293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:35:48 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-11d4f1e5-f872-4888-89e8-bbbfec04cf1c tempest-ProjectReaderTests-1282741293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:35:48 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-11d4f1e5-f872-4888-89e8-bbbfec04cf1c tempest-ProjectReaderTests-1282741293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:35:48 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-11d4f1e5-f872-4888-89e8-bbbfec04cf1c tempest-ProjectReaderTests-1282741293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:35:48 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-11d4f1e5-f872-4888-89e8-bbbfec04cf1c tempest-ProjectReaderTests-1282741293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:35:48 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-11d4f1e5-f872-4888-89e8-bbbfec04cf1c tempest-ProjectReaderTests-1282741293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:48 devstack sudo[106616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:35:48 devstack sudo[106616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:49 devstack sudo[106616]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:49 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-11d4f1e5-f872-4888-89e8-bbbfec04cf1c tempest-ProjectReaderTests-1282741293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.258s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:49 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-11d4f1e5-f872-4888-89e8-bbbfec04cf1c tempest-ProjectReaderTests-1282741293 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:35:49 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-11d4f1e5-f872-4888-89e8-bbbfec04cf1c tempest-ProjectReaderTests-1282741293 None] Deleted volume successfully. Jul 22 03:35:49 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-11d4f1e5-f872-4888-89e8-bbbfec04cf1c tempest-ProjectReaderTests-1282741293 None] Lock "cinder-193ffcd8-6d5d-4310-9f5c-f7ce81daac4b-delete_volume" released by "delete_volume" :: held 1.286s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:35:49 devstack sudo[106614]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:49 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f65db4d4-f5f4-487b-adf0-b3b339397305 tempest-ProjectMemberTests-64253088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b534b6b5-eff7-4b6f-bcc4-9b2f76395a4e 1073741824" returned: 0 in 0.480s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:49 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f65db4d4-f5f4-487b-adf0-b3b339397305 tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b534b6b5-eff7-4b6f-bcc4-9b2f76395a4e {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:49 devstack sudo[106622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b534b6b5-eff7-4b6f-bcc4-9b2f76395a4e Jul 22 03:35:49 devstack sudo[106622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:49 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc31e250-cc3d-48d1-8658-6ce802c612ce tempest-ProjectReaderTests-1282741293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:35:49 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-fc31e250-cc3d-48d1-8658-6ce802c612ce tempest-ProjectReaderTests-1282741293 None] Flow 'volume_create_manager' (0bac5b69-03f0-47eb-a38a-feb09c16b78c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:35:49 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-fc31e250-cc3d-48d1-8658-6ce802c612ce tempest-ProjectReaderTests-1282741293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1b37889-22f3-4952-a4a8-99a9ba79ed32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:35:49 devstack sudo[106622]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:49 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-fc31e250-cc3d-48d1-8658-6ce802c612ce tempest-ProjectReaderTests-1282741293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1b37889-22f3-4952-a4a8-99a9ba79ed32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:35:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1115156795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d300459-c119-494b-b3be-092fe1f11d68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7136d33fbff44dd58bcb5c13580df340',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:35:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:35:49Z,use_quota=True,user_id='d95cad1d40d14453904bb8e8981fb1d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:35:49 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-fc31e250-cc3d-48d1-8658-6ce802c612ce tempest-ProjectReaderTests-1282741293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad4bc154-7c02-48a6-bc33-04b409daa134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:35:49 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-fc31e250-cc3d-48d1-8658-6ce802c612ce tempest-ProjectReaderTests-1282741293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad4bc154-7c02-48a6-bc33-04b409daa134) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:35:49 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-fc31e250-cc3d-48d1-8658-6ce802c612ce tempest-ProjectReaderTests-1282741293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36a4eb17-a429-4fdc-b1a0-92a10df4889d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:35:49 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-fc31e250-cc3d-48d1-8658-6ce802c612ce tempest-ProjectReaderTests-1282741293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36a4eb17-a429-4fdc-b1a0-92a10df4889d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d300459-c119-494b-b3be-092fe1f11d68', 'volume_name': 'volume-5d300459-c119-494b-b3be-092fe1f11d68', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:35:49 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-fc31e250-cc3d-48d1-8658-6ce802c612ce tempest-ProjectReaderTests-1282741293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f94bec5d-537e-41ef-bf27-1fcd53f39187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:35:49 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-fc31e250-cc3d-48d1-8658-6ce802c612ce tempest-ProjectReaderTests-1282741293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f94bec5d-537e-41ef-bf27-1fcd53f39187) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:35:49 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-fc31e250-cc3d-48d1-8658-6ce802c612ce tempest-ProjectReaderTests-1282741293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c926147-1a37-4ef0-83f8-f9dcc65926e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:35:49 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-fc31e250-cc3d-48d1-8658-6ce802c612ce tempest-ProjectReaderTests-1282741293 None] Volume 5d300459-c119-494b-b3be-092fe1f11d68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d300459-c119-494b-b3be-092fe1f11d68', 'volume_size': 1} Jul 22 03:35:49 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-fc31e250-cc3d-48d1-8658-6ce802c612ce tempest-ProjectReaderTests-1282741293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:35:49 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-f65db4d4-f5f4-487b-adf0-b3b339397305 tempest-ProjectMemberTests-64253088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b534b6b5-eff7-4b6f-bcc4-9b2f76395a4e" returned: 0 in 0.280s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:49 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-f65db4d4-f5f4-487b-adf0-b3b339397305 tempest-ProjectMemberTests-64253088 None] <== create_volume: return (797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:35:49 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-f65db4d4-f5f4-487b-adf0-b3b339397305 tempest-ProjectMemberTests-64253088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:35:49 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-fc31e250-cc3d-48d1-8658-6ce802c612ce tempest-ProjectReaderTests-1282741293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:35:49 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-fc31e250-cc3d-48d1-8658-6ce802c612ce tempest-ProjectReaderTests-1282741293 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:35:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1115156795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d300459-c119-494b-b3be-092fe1f11d68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7136d33fbff44dd58bcb5c13580df340',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:35:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:35:49Z,use_quota=True,user_id='d95cad1d40d14453904bb8e8981fb1d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:35:49 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-fc31e250-cc3d-48d1-8658-6ce802c612ce tempest-ProjectReaderTests-1282741293 None] Creating volume 5d300459-c119-494b-b3be-092fe1f11d68 {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:35:49 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-fc31e250-cc3d-48d1-8658-6ce802c612ce tempest-ProjectReaderTests-1282741293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:35:49 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-fc31e250-cc3d-48d1-8658-6ce802c612ce tempest-ProjectReaderTests-1282741293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:35:49 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-fc31e250-cc3d-48d1-8658-6ce802c612ce tempest-ProjectReaderTests-1282741293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:35:49 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-fc31e250-cc3d-48d1-8658-6ce802c612ce tempest-ProjectReaderTests-1282741293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:35:49 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-fc31e250-cc3d-48d1-8658-6ce802c612ce tempest-ProjectReaderTests-1282741293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:35:49 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-fc31e250-cc3d-48d1-8658-6ce802c612ce tempest-ProjectReaderTests-1282741293 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:35:49 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-fc31e250-cc3d-48d1-8658-6ce802c612ce tempest-ProjectReaderTests-1282741293 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:35:49 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-fc31e250-cc3d-48d1-8658-6ce802c612ce tempest-ProjectReaderTests-1282741293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-5d300459-c119-494b-b3be-092fe1f11d68 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:49 devstack sudo[106625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-5d300459-c119-494b-b3be-092fe1f11d68 1073741824 Jul 22 03:35:49 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f65db4d4-f5f4-487b-adf0-b3b339397305 tempest-ProjectMemberTests-64253088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc12d112-6311-4c49-86a0-d9aff8dbddb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b534b6b5-eff7-4b6f-bcc4-9b2f76395a4e', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:35:49 devstack sudo[106625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:49 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f65db4d4-f5f4-487b-adf0-b3b339397305 tempest-ProjectMemberTests-64253088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2354418-bde7-4aa5-b315-eda233720338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:35:49 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-f65db4d4-f5f4-487b-adf0-b3b339397305 tempest-ProjectMemberTests-64253088 None] Volume volume-b534b6b5-eff7-4b6f-bcc4-9b2f76395a4e (b534b6b5-eff7-4b6f-bcc4-9b2f76395a4e): created successfully Jul 22 03:35:49 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f65db4d4-f5f4-487b-adf0-b3b339397305 tempest-ProjectMemberTests-64253088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2354418-bde7-4aa5-b315-eda233720338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:35:49 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-f65db4d4-f5f4-487b-adf0-b3b339397305 tempest-ProjectMemberTests-64253088 None] Flow 'volume_create_manager' (66454ea9-cd78-45c1-88d2-6a3a950cc7a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:35:49 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-f65db4d4-f5f4-487b-adf0-b3b339397305 tempest-ProjectMemberTests-64253088 None] Created volume successfully. Jul 22 03:35:49 devstack sudo[106625]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:49 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-fc31e250-cc3d-48d1-8658-6ce802c612ce tempest-ProjectReaderTests-1282741293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-5d300459-c119-494b-b3be-092fe1f11d68 1073741824" returned: 0 in 0.399s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:49 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-fc31e250-cc3d-48d1-8658-6ce802c612ce tempest-ProjectReaderTests-1282741293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-5d300459-c119-494b-b3be-092fe1f11d68 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:49 devstack sudo[106631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-5d300459-c119-494b-b3be-092fe1f11d68 Jul 22 03:35:49 devstack sudo[106631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:50 devstack sudo[106631]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:50 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-fc31e250-cc3d-48d1-8658-6ce802c612ce tempest-ProjectReaderTests-1282741293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-5d300459-c119-494b-b3be-092fe1f11d68" returned: 0 in 0.240s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:50 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-fc31e250-cc3d-48d1-8658-6ce802c612ce tempest-ProjectReaderTests-1282741293 None] <== create_volume: return (675ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:35:50 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-fc31e250-cc3d-48d1-8658-6ce802c612ce tempest-ProjectReaderTests-1282741293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.677s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:35:50 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-fc31e250-cc3d-48d1-8658-6ce802c612ce tempest-ProjectReaderTests-1282741293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c926147-1a37-4ef0-83f8-f9dcc65926e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d300459-c119-494b-b3be-092fe1f11d68', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:35:50 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-fc31e250-cc3d-48d1-8658-6ce802c612ce tempest-ProjectReaderTests-1282741293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76c17fd8-67fd-4623-b13d-a76df533e292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:35:50 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-fc31e250-cc3d-48d1-8658-6ce802c612ce tempest-ProjectReaderTests-1282741293 None] Volume volume-5d300459-c119-494b-b3be-092fe1f11d68 (5d300459-c119-494b-b3be-092fe1f11d68): created successfully Jul 22 03:35:50 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-fc31e250-cc3d-48d1-8658-6ce802c612ce tempest-ProjectReaderTests-1282741293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76c17fd8-67fd-4623-b13d-a76df533e292) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:35:50 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-fc31e250-cc3d-48d1-8658-6ce802c612ce tempest-ProjectReaderTests-1282741293 None] Flow 'volume_create_manager' (0bac5b69-03f0-47eb-a38a-feb09c16b78c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:35:50 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-fc31e250-cc3d-48d1-8658-6ce802c612ce tempest-ProjectReaderTests-1282741293 None] Created volume successfully. Jul 22 03:35:50 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-acce66fa-39f1-4ef9-bc53-7e35fa3cdcc9 tempest-ProjectReaderTests-1282741293 None] Acquiring lock "cinder-5d300459-c119-494b-b3be-092fe1f11d68-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:35:50 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-acce66fa-39f1-4ef9-bc53-7e35fa3cdcc9 tempest-ProjectReaderTests-1282741293 None] Lock "cinder-5d300459-c119-494b-b3be-092fe1f11d68-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:35:50 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-acce66fa-39f1-4ef9-bc53-7e35fa3cdcc9 tempest-ProjectReaderTests-1282741293 None] Acquiring lock "cinder-quobyte-5d300459-c119-494b-b3be-092fe1f11d68" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:35:50 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-acce66fa-39f1-4ef9-bc53-7e35fa3cdcc9 tempest-ProjectReaderTests-1282741293 None] Lock "cinder-quobyte-5d300459-c119-494b-b3be-092fe1f11d68" acquired by "delete_volume" :: waited 0.013s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:35:50 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[5750ce0b-a5c6-4e09-a02d-af994b4f119e]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:35:50 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-acce66fa-39f1-4ef9-bc53-7e35fa3cdcc9 tempest-ProjectReaderTests-1282741293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-5d300459-c119-494b-b3be-092fe1f11d68 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:50 devstack sudo[106634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-5d300459-c119-494b-b3be-092fe1f11d68 Jul 22 03:35:50 devstack sudo[106634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:50 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-73198c9d-3fc3-4af2-8b3f-5e4a27810942 tempest-ProjectMemberTests-64253088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:35:50 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-73198c9d-3fc3-4af2-8b3f-5e4a27810942 tempest-ProjectMemberTests-64253088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:35:50 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-73198c9d-3fc3-4af2-8b3f-5e4a27810942 tempest-ProjectMemberTests-64253088 None] Creating offline snapshot 17914fe7-0eb9-4742-b43f-e5266ebe8508 of volume b534b6b5-eff7-4b6f-bcc4-9b2f76395a4e {{(pid=87747) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 03:35:50 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[994ff095-452c-4ae9-8035-42ac73fd018e]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:35:50 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-73198c9d-3fc3-4af2-8b3f-5e4a27810942 tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b534b6b5-eff7-4b6f-bcc4-9b2f76395a4e {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:50 devstack sudo[106634]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:50 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-acce66fa-39f1-4ef9-bc53-7e35fa3cdcc9 tempest-ProjectReaderTests-1282741293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-5d300459-c119-494b-b3be-092fe1f11d68" returned: 0 in 0.380s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:50 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-acce66fa-39f1-4ef9-bc53-7e35fa3cdcc9 tempest-ProjectReaderTests-1282741293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-5d300459-c119-494b-b3be-092fe1f11d68 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:50 devstack sudo[106640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-5d300459-c119-494b-b3be-092fe1f11d68 Jul 22 03:35:50 devstack sudo[106640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:50 devstack sudo[106638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b534b6b5-eff7-4b6f-bcc4-9b2f76395a4e Jul 22 03:35:50 devstack sudo[106638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:51 devstack sudo[106640]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:51 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-acce66fa-39f1-4ef9-bc53-7e35fa3cdcc9 tempest-ProjectReaderTests-1282741293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-5d300459-c119-494b-b3be-092fe1f11d68" returned: 0 in 0.246s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:51 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-acce66fa-39f1-4ef9-bc53-7e35fa3cdcc9 tempest-ProjectReaderTests-1282741293 None] Lock "cinder-quobyte-5d300459-c119-494b-b3be-092fe1f11d68" released by "delete_volume" :: held 0.666s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:35:51 devstack sudo[106638]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:51 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-73198c9d-3fc3-4af2-8b3f-5e4a27810942 tempest-ProjectMemberTests-64253088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b534b6b5-eff7-4b6f-bcc4-9b2f76395a4e" returned: 0 in 0.370s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:51 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-73198c9d-3fc3-4af2-8b3f-5e4a27810942 tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b534b6b5-eff7-4b6f-bcc4-9b2f76395a4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b534b6b5-eff7-4b6f-bcc4-9b2f76395a4e.17914fe7-0eb9-4742-b43f-e5266ebe8508 1G {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:51 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-acce66fa-39f1-4ef9-bc53-7e35fa3cdcc9 tempest-ProjectReaderTests-1282741293 None] Created reservations ['b7d586dd-8c82-4540-8796-27886f563635', '7bb1191f-210e-4ba7-9de5-4eb236ce8b6a', '2f65808d-8828-4ef3-aa62-b7fa1dbe738f', 'e4504528-c543-4403-9468-21e010e7bc55'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:35:51 devstack sudo[106647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b534b6b5-eff7-4b6f-bcc4-9b2f76395a4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b534b6b5-eff7-4b6f-bcc4-9b2f76395a4e.17914fe7-0eb9-4742-b43f-e5266ebe8508 1G Jul 22 03:35:51 devstack sudo[106647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:51 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-acce66fa-39f1-4ef9-bc53-7e35fa3cdcc9 tempest-ProjectReaderTests-1282741293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:35:51 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-acce66fa-39f1-4ef9-bc53-7e35fa3cdcc9 tempest-ProjectReaderTests-1282741293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:35:51 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-acce66fa-39f1-4ef9-bc53-7e35fa3cdcc9 tempest-ProjectReaderTests-1282741293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:35:51 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-acce66fa-39f1-4ef9-bc53-7e35fa3cdcc9 tempest-ProjectReaderTests-1282741293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:35:51 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-acce66fa-39f1-4ef9-bc53-7e35fa3cdcc9 tempest-ProjectReaderTests-1282741293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:35:51 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-acce66fa-39f1-4ef9-bc53-7e35fa3cdcc9 tempest-ProjectReaderTests-1282741293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:51 devstack sudo[106649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:35:51 devstack sudo[106649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:51 devstack sudo[106649]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:51 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-acce66fa-39f1-4ef9-bc53-7e35fa3cdcc9 tempest-ProjectReaderTests-1282741293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.261s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:51 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-acce66fa-39f1-4ef9-bc53-7e35fa3cdcc9 tempest-ProjectReaderTests-1282741293 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:35:51 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-acce66fa-39f1-4ef9-bc53-7e35fa3cdcc9 tempest-ProjectReaderTests-1282741293 None] Deleted volume successfully. Jul 22 03:35:51 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-acce66fa-39f1-4ef9-bc53-7e35fa3cdcc9 tempest-ProjectReaderTests-1282741293 None] Lock "cinder-5d300459-c119-494b-b3be-092fe1f11d68-delete_volume" released by "delete_volume" :: held 1.133s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:35:51 devstack sudo[106647]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:51 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-73198c9d-3fc3-4af2-8b3f-5e4a27810942 tempest-ProjectMemberTests-64253088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b534b6b5-eff7-4b6f-bcc4-9b2f76395a4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b534b6b5-eff7-4b6f-bcc4-9b2f76395a4e.17914fe7-0eb9-4742-b43f-e5266ebe8508 1G" returned: 0 in 0.432s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:51 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-73198c9d-3fc3-4af2-8b3f-5e4a27810942 tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b534b6b5-eff7-4b6f-bcc4-9b2f76395a4e -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b534b6b5-eff7-4b6f-bcc4-9b2f76395a4e.17914fe7-0eb9-4742-b43f-e5266ebe8508 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:51 devstack sudo[106655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b534b6b5-eff7-4b6f-bcc4-9b2f76395a4e -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b534b6b5-eff7-4b6f-bcc4-9b2f76395a4e.17914fe7-0eb9-4742-b43f-e5266ebe8508 Jul 22 03:35:51 devstack sudo[106655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:51 devstack sudo[106655]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:51 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-73198c9d-3fc3-4af2-8b3f-5e4a27810942 tempest-ProjectMemberTests-64253088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b534b6b5-eff7-4b6f-bcc4-9b2f76395a4e -F qcow2 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b534b6b5-eff7-4b6f-bcc4-9b2f76395a4e.17914fe7-0eb9-4742-b43f-e5266ebe8508" returned: 0 in 0.330s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:51 devstack cinder-volume[87747]: WARNING cinder.volume.drivers.remotefs [None req-73198c9d-3fc3-4af2-8b3f-5e4a27810942 tempest-ProjectMemberTests-64253088 None] /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b534b6b5-eff7-4b6f-bcc4-9b2f76395a4e.17914fe7-0eb9-4742-b43f-e5266ebe8508 is being set with open permissions: ugo+rw Jul 22 03:35:51 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-73198c9d-3fc3-4af2-8b3f-5e4a27810942 tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b534b6b5-eff7-4b6f-bcc4-9b2f76395a4e.17914fe7-0eb9-4742-b43f-e5266ebe8508 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:52 devstack sudo[106660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b534b6b5-eff7-4b6f-bcc4-9b2f76395a4e.17914fe7-0eb9-4742-b43f-e5266ebe8508 Jul 22 03:35:52 devstack sudo[106660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:52 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-a87a5fdd-2eb1-4a8b-af57-599f38fe46bc tempest-ProjectReaderTests-1282741293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:35:52 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-a87a5fdd-2eb1-4a8b-af57-599f38fe46bc tempest-ProjectReaderTests-1282741293 None] Flow 'volume_create_manager' (55c3ac4e-143c-4707-b750-b9ee810d526c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:35:52 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-a87a5fdd-2eb1-4a8b-af57-599f38fe46bc tempest-ProjectReaderTests-1282741293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5325bcc8-170a-488f-bfcf-fbe368e61730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:35:52 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-a87a5fdd-2eb1-4a8b-af57-599f38fe46bc tempest-ProjectReaderTests-1282741293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5325bcc8-170a-488f-bfcf-fbe368e61730) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:35:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2070329531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=326d928a-528e-4e88-a8c3-e48c5868d871,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7136d33fbff44dd58bcb5c13580df340',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:35:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:35:52Z,use_quota=True,user_id='d95cad1d40d14453904bb8e8981fb1d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:35:52 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-a87a5fdd-2eb1-4a8b-af57-599f38fe46bc tempest-ProjectReaderTests-1282741293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69a748dd-97b2-4931-9b94-bb4a9ef3bd43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:35:52 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-a87a5fdd-2eb1-4a8b-af57-599f38fe46bc tempest-ProjectReaderTests-1282741293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69a748dd-97b2-4931-9b94-bb4a9ef3bd43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:35:52 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-a87a5fdd-2eb1-4a8b-af57-599f38fe46bc tempest-ProjectReaderTests-1282741293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (782a18be-19b5-4bca-9b6b-afe0bddf12bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:35:52 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-a87a5fdd-2eb1-4a8b-af57-599f38fe46bc tempest-ProjectReaderTests-1282741293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (782a18be-19b5-4bca-9b6b-afe0bddf12bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '326d928a-528e-4e88-a8c3-e48c5868d871', 'volume_name': 'volume-326d928a-528e-4e88-a8c3-e48c5868d871', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:35:52 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-a87a5fdd-2eb1-4a8b-af57-599f38fe46bc tempest-ProjectReaderTests-1282741293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df1ccaa9-f5f9-4678-9bf5-95757e59d4f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:35:52 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-a87a5fdd-2eb1-4a8b-af57-599f38fe46bc tempest-ProjectReaderTests-1282741293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df1ccaa9-f5f9-4678-9bf5-95757e59d4f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:35:52 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-a87a5fdd-2eb1-4a8b-af57-599f38fe46bc tempest-ProjectReaderTests-1282741293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c74541e2-6598-41d8-856b-705d21a1f324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:35:52 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-a87a5fdd-2eb1-4a8b-af57-599f38fe46bc tempest-ProjectReaderTests-1282741293 None] Volume 326d928a-528e-4e88-a8c3-e48c5868d871: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-326d928a-528e-4e88-a8c3-e48c5868d871', 'volume_size': 1} Jul 22 03:35:52 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-a87a5fdd-2eb1-4a8b-af57-599f38fe46bc tempest-ProjectReaderTests-1282741293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:35:52 devstack sudo[106660]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:52 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-73198c9d-3fc3-4af2-8b3f-5e4a27810942 tempest-ProjectMemberTests-64253088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b534b6b5-eff7-4b6f-bcc4-9b2f76395a4e.17914fe7-0eb9-4742-b43f-e5266ebe8508" returned: 0 in 0.250s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:52 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-73198c9d-3fc3-4af2-8b3f-5e4a27810942 tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b534b6b5-eff7-4b6f-bcc4-9b2f76395a4e.info {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:52 devstack sudo[106663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b534b6b5-eff7-4b6f-bcc4-9b2f76395a4e.info Jul 22 03:35:52 devstack sudo[106663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:52 devstack sudo[106663]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:52 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-73198c9d-3fc3-4af2-8b3f-5e4a27810942 tempest-ProjectMemberTests-64253088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b534b6b5-eff7-4b6f-bcc4-9b2f76395a4e.info" returned: 0 in 0.238s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:52 devstack cinder-volume[87747]: WARNING cinder.volume.drivers.remotefs [None req-73198c9d-3fc3-4af2-8b3f-5e4a27810942 tempest-ProjectMemberTests-64253088 None] /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b534b6b5-eff7-4b6f-bcc4-9b2f76395a4e.info is being set with open permissions: ugo+rw Jul 22 03:35:52 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-73198c9d-3fc3-4af2-8b3f-5e4a27810942 tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b534b6b5-eff7-4b6f-bcc4-9b2f76395a4e.info {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:52 devstack sudo[106666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b534b6b5-eff7-4b6f-bcc4-9b2f76395a4e.info Jul 22 03:35:52 devstack sudo[106666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:52 devstack sudo[106666]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:52 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-73198c9d-3fc3-4af2-8b3f-5e4a27810942 tempest-ProjectMemberTests-64253088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b534b6b5-eff7-4b6f-bcc4-9b2f76395a4e.info" returned: 0 in 0.249s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:52 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-73198c9d-3fc3-4af2-8b3f-5e4a27810942 tempest-ProjectMemberTests-64253088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.941s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:35:52 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-a87a5fdd-2eb1-4a8b-af57-599f38fe46bc tempest-ProjectReaderTests-1282741293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.618s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:35:52 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-a87a5fdd-2eb1-4a8b-af57-599f38fe46bc tempest-ProjectReaderTests-1282741293 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:35:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2070329531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=326d928a-528e-4e88-a8c3-e48c5868d871,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7136d33fbff44dd58bcb5c13580df340',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:35:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:35:52Z,use_quota=True,user_id='d95cad1d40d14453904bb8e8981fb1d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:35:52 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-a87a5fdd-2eb1-4a8b-af57-599f38fe46bc tempest-ProjectReaderTests-1282741293 None] Creating volume 326d928a-528e-4e88-a8c3-e48c5868d871 {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:35:52 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-a87a5fdd-2eb1-4a8b-af57-599f38fe46bc tempest-ProjectReaderTests-1282741293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:35:52 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-a87a5fdd-2eb1-4a8b-af57-599f38fe46bc tempest-ProjectReaderTests-1282741293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:35:52 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-a87a5fdd-2eb1-4a8b-af57-599f38fe46bc tempest-ProjectReaderTests-1282741293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:35:52 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-a87a5fdd-2eb1-4a8b-af57-599f38fe46bc tempest-ProjectReaderTests-1282741293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:35:52 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-a87a5fdd-2eb1-4a8b-af57-599f38fe46bc tempest-ProjectReaderTests-1282741293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:35:52 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-a87a5fdd-2eb1-4a8b-af57-599f38fe46bc tempest-ProjectReaderTests-1282741293 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:35:52 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-a87a5fdd-2eb1-4a8b-af57-599f38fe46bc tempest-ProjectReaderTests-1282741293 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:35:52 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-a87a5fdd-2eb1-4a8b-af57-599f38fe46bc tempest-ProjectReaderTests-1282741293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-326d928a-528e-4e88-a8c3-e48c5868d871 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:52 devstack sudo[106669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-326d928a-528e-4e88-a8c3-e48c5868d871 1073741824 Jul 22 03:35:52 devstack sudo[106669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:52 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-73198c9d-3fc3-4af2-8b3f-5e4a27810942 tempest-ProjectMemberTests-64253088 None] Create snapshot completed successfully Jul 22 03:35:53 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-5bc91df5-1644-4a7b-a742-bf1771af24de tempest-ProjectMemberTests-64253088 None] Acquiring lock "cinder-17914fe7-0eb9-4742-b43f-e5266ebe8508-delete_snapshot" by "delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:35:53 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-5bc91df5-1644-4a7b-a742-bf1771af24de tempest-ProjectMemberTests-64253088 None] Lock "cinder-17914fe7-0eb9-4742-b43f-e5266ebe8508-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:35:53 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-5bc91df5-1644-4a7b-a742-bf1771af24de tempest-ProjectMemberTests-64253088 None] Acquiring lock "cinder-quobyte-b534b6b5-eff7-4b6f-bcc4-9b2f76395a4e" by "delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:35:53 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-5bc91df5-1644-4a7b-a742-bf1771af24de tempest-ProjectMemberTests-64253088 None] Lock "cinder-quobyte-b534b6b5-eff7-4b6f-bcc4-9b2f76395a4e" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:35:53 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-5bc91df5-1644-4a7b-a742-bf1771af24de tempest-ProjectMemberTests-64253088 None] Acquiring lock "cinder-quobyte-17914fe7-0eb9-4742-b43f-e5266ebe8508" by "_delete_snapshot" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:35:53 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-5bc91df5-1644-4a7b-a742-bf1771af24de tempest-ProjectMemberTests-64253088 None] Lock "cinder-quobyte-17914fe7-0eb9-4742-b43f-e5266ebe8508" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:35:53 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-5bc91df5-1644-4a7b-a742-bf1771af24de tempest-ProjectMemberTests-64253088 None] Deleting offline snapshot 17914fe7-0eb9-4742-b43f-e5266ebe8508 of volume b534b6b5-eff7-4b6f-bcc4-9b2f76395a4e {{(pid=87747) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 03:35:53 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-5bc91df5-1644-4a7b-a742-bf1771af24de tempest-ProjectMemberTests-64253088 None] snapshot_file for this snap is: volume-b534b6b5-eff7-4b6f-bcc4-9b2f76395a4e.17914fe7-0eb9-4742-b43f-e5266ebe8508 {{(pid=87747) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 03:35:53 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[63a72d16-478b-40cb-9a21-f9492540e184]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:35:53 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5bc91df5-1644-4a7b-a742-bf1771af24de tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b534b6b5-eff7-4b6f-bcc4-9b2f76395a4e.17914fe7-0eb9-4742-b43f-e5266ebe8508 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:53 devstack sudo[106669]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:53 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-a87a5fdd-2eb1-4a8b-af57-599f38fe46bc tempest-ProjectReaderTests-1282741293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-326d928a-528e-4e88-a8c3-e48c5868d871 1073741824" returned: 0 in 0.469s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:53 devstack sudo[106675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b534b6b5-eff7-4b6f-bcc4-9b2f76395a4e.17914fe7-0eb9-4742-b43f-e5266ebe8508 Jul 22 03:35:53 devstack sudo[106675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:53 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-a87a5fdd-2eb1-4a8b-af57-599f38fe46bc tempest-ProjectReaderTests-1282741293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-326d928a-528e-4e88-a8c3-e48c5868d871 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:53 devstack sudo[106677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-326d928a-528e-4e88-a8c3-e48c5868d871 Jul 22 03:35:53 devstack sudo[106677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:53 devstack sudo[106675]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:53 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5bc91df5-1644-4a7b-a742-bf1771af24de tempest-ProjectMemberTests-64253088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b534b6b5-eff7-4b6f-bcc4-9b2f76395a4e.17914fe7-0eb9-4742-b43f-e5266ebe8508" returned: 0 in 0.358s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:53 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-5bc91df5-1644-4a7b-a742-bf1771af24de tempest-ProjectMemberTests-64253088 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b534b6b5-eff7-4b6f-bcc4-9b2f76395a4e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87747) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 03:35:53 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[8680473f-d3f2-43d7-8f57-888e1c2c095d]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:35:53 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5bc91df5-1644-4a7b-a742-bf1771af24de tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b534b6b5-eff7-4b6f-bcc4-9b2f76395a4e {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:53 devstack sudo[106677]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:53 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-a87a5fdd-2eb1-4a8b-af57-599f38fe46bc tempest-ProjectReaderTests-1282741293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-326d928a-528e-4e88-a8c3-e48c5868d871" returned: 0 in 0.250s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:53 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-a87a5fdd-2eb1-4a8b-af57-599f38fe46bc tempest-ProjectReaderTests-1282741293 None] <== create_volume: return (762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:35:53 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-a87a5fdd-2eb1-4a8b-af57-599f38fe46bc tempest-ProjectReaderTests-1282741293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:35:53 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-a87a5fdd-2eb1-4a8b-af57-599f38fe46bc tempest-ProjectReaderTests-1282741293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c74541e2-6598-41d8-856b-705d21a1f324) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-326d928a-528e-4e88-a8c3-e48c5868d871', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:35:53 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-a87a5fdd-2eb1-4a8b-af57-599f38fe46bc tempest-ProjectReaderTests-1282741293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84695d57-8575-40c9-b911-497cc7a8f06c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:35:53 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-a87a5fdd-2eb1-4a8b-af57-599f38fe46bc tempest-ProjectReaderTests-1282741293 None] Volume volume-326d928a-528e-4e88-a8c3-e48c5868d871 (326d928a-528e-4e88-a8c3-e48c5868d871): created successfully Jul 22 03:35:53 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-a87a5fdd-2eb1-4a8b-af57-599f38fe46bc tempest-ProjectReaderTests-1282741293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84695d57-8575-40c9-b911-497cc7a8f06c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:35:53 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-a87a5fdd-2eb1-4a8b-af57-599f38fe46bc tempest-ProjectReaderTests-1282741293 None] Flow 'volume_create_manager' (55c3ac4e-143c-4707-b750-b9ee810d526c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:35:53 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-a87a5fdd-2eb1-4a8b-af57-599f38fe46bc tempest-ProjectReaderTests-1282741293 None] Created volume successfully. Jul 22 03:35:53 devstack sudo[106684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b534b6b5-eff7-4b6f-bcc4-9b2f76395a4e Jul 22 03:35:53 devstack sudo[106684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:53 devstack sudo[106684]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:53 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5bc91df5-1644-4a7b-a742-bf1771af24de tempest-ProjectMemberTests-64253088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b534b6b5-eff7-4b6f-bcc4-9b2f76395a4e" returned: 0 in 0.351s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:53 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5bc91df5-1644-4a7b-a742-bf1771af24de tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b534b6b5-eff7-4b6f-bcc4-9b2f76395a4e.17914fe7-0eb9-4742-b43f-e5266ebe8508 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:53 devstack sudo[106689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b534b6b5-eff7-4b6f-bcc4-9b2f76395a4e.17914fe7-0eb9-4742-b43f-e5266ebe8508 Jul 22 03:35:53 devstack sudo[106689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:54 devstack sudo[106689]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:54 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5bc91df5-1644-4a7b-a742-bf1771af24de tempest-ProjectMemberTests-64253088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b534b6b5-eff7-4b6f-bcc4-9b2f76395a4e.17914fe7-0eb9-4742-b43f-e5266ebe8508" returned: 0 in 0.339s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:54 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5bc91df5-1644-4a7b-a742-bf1771af24de tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b534b6b5-eff7-4b6f-bcc4-9b2f76395a4e.17914fe7-0eb9-4742-b43f-e5266ebe8508 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:54 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-e64f58f6-c754-4c18-ac8a-e6f8d55a662d tempest-ProjectReaderTests-1282741293 None] Acquiring lock "cinder-326d928a-528e-4e88-a8c3-e48c5868d871-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:35:54 devstack sudo[106694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b534b6b5-eff7-4b6f-bcc4-9b2f76395a4e.17914fe7-0eb9-4742-b43f-e5266ebe8508 Jul 22 03:35:54 devstack sudo[106694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:54 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-e64f58f6-c754-4c18-ac8a-e6f8d55a662d tempest-ProjectReaderTests-1282741293 None] Lock "cinder-326d928a-528e-4e88-a8c3-e48c5868d871-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:35:54 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-e64f58f6-c754-4c18-ac8a-e6f8d55a662d tempest-ProjectReaderTests-1282741293 None] Acquiring lock "cinder-quobyte-326d928a-528e-4e88-a8c3-e48c5868d871" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:35:54 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-e64f58f6-c754-4c18-ac8a-e6f8d55a662d tempest-ProjectReaderTests-1282741293 None] Lock "cinder-quobyte-326d928a-528e-4e88-a8c3-e48c5868d871" acquired by "delete_volume" :: waited 0.015s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:35:54 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[d632d31e-a1ff-4b12-9a32-27210461e6d6]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:35:54 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-e64f58f6-c754-4c18-ac8a-e6f8d55a662d tempest-ProjectReaderTests-1282741293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-326d928a-528e-4e88-a8c3-e48c5868d871 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:54 devstack sudo[106696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-326d928a-528e-4e88-a8c3-e48c5868d871 Jul 22 03:35:54 devstack sudo[106696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:54 devstack sudo[106694]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:54 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-5bc91df5-1644-4a7b-a742-bf1771af24de tempest-ProjectMemberTests-64253088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b534b6b5-eff7-4b6f-bcc4-9b2f76395a4e.17914fe7-0eb9-4742-b43f-e5266ebe8508" returned: 0 in 0.263s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:54 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-5bc91df5-1644-4a7b-a742-bf1771af24de tempest-ProjectMemberTests-64253088 None] Lock "cinder-quobyte-17914fe7-0eb9-4742-b43f-e5266ebe8508" released by "_delete_snapshot" :: held 1.406s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:35:54 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-5bc91df5-1644-4a7b-a742-bf1771af24de tempest-ProjectMemberTests-64253088 None] Lock "cinder-quobyte-b534b6b5-eff7-4b6f-bcc4-9b2f76395a4e" released by "delete_snapshot" :: held 1.430s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:35:54 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-5bc91df5-1644-4a7b-a742-bf1771af24de tempest-ProjectMemberTests-64253088 None] Created reservations ['2950d3b4-8612-4166-9adb-0dba462b8a50', '5e692330-1154-477d-af7f-65c922a0c0dd', '34c3144d-086f-43df-a499-7f9b03acf4df', 'd1f445a0-c742-429f-9b03-20b0e7fc2509'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:35:54 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-5bc91df5-1644-4a7b-a742-bf1771af24de tempest-ProjectMemberTests-64253088 None] Delete snapshot completed successfully. Jul 22 03:35:54 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-5bc91df5-1644-4a7b-a742-bf1771af24de tempest-ProjectMemberTests-64253088 None] Lock "cinder-17914fe7-0eb9-4742-b43f-e5266ebe8508-delete_snapshot" released by "delete_snapshot" :: held 1.557s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:35:54 devstack sudo[106696]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:54 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-e64f58f6-c754-4c18-ac8a-e6f8d55a662d tempest-ProjectReaderTests-1282741293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-326d928a-528e-4e88-a8c3-e48c5868d871" returned: 0 in 0.366s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:54 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-e64f58f6-c754-4c18-ac8a-e6f8d55a662d tempest-ProjectReaderTests-1282741293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-326d928a-528e-4e88-a8c3-e48c5868d871 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:54 devstack sudo[106702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-326d928a-528e-4e88-a8c3-e48c5868d871 Jul 22 03:35:54 devstack sudo[106702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:54 devstack sudo[106702]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:54 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-e64f58f6-c754-4c18-ac8a-e6f8d55a662d tempest-ProjectReaderTests-1282741293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-326d928a-528e-4e88-a8c3-e48c5868d871" returned: 0 in 0.236s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:54 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-e64f58f6-c754-4c18-ac8a-e6f8d55a662d tempest-ProjectReaderTests-1282741293 None] Lock "cinder-quobyte-326d928a-528e-4e88-a8c3-e48c5868d871" released by "delete_volume" :: held 0.641s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:35:54 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-e64f58f6-c754-4c18-ac8a-e6f8d55a662d tempest-ProjectReaderTests-1282741293 None] Created reservations ['5fed315c-bc0f-478a-a91b-87c138fd7fd5', '1bdeebee-e936-4507-8fe1-b895eb558c05', 'bb5899e8-c52a-416c-a38c-dc87bec95538', 'ef822a68-73a8-4d60-a33e-a6bca3417456'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:35:55 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-e64f58f6-c754-4c18-ac8a-e6f8d55a662d tempest-ProjectReaderTests-1282741293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:35:55 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-e64f58f6-c754-4c18-ac8a-e6f8d55a662d tempest-ProjectReaderTests-1282741293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:35:55 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-e64f58f6-c754-4c18-ac8a-e6f8d55a662d tempest-ProjectReaderTests-1282741293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:35:55 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-e64f58f6-c754-4c18-ac8a-e6f8d55a662d tempest-ProjectReaderTests-1282741293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:35:55 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-e64f58f6-c754-4c18-ac8a-e6f8d55a662d tempest-ProjectReaderTests-1282741293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:35:55 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-e64f58f6-c754-4c18-ac8a-e6f8d55a662d tempest-ProjectReaderTests-1282741293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:55 devstack sudo[106705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:35:55 devstack sudo[106705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:55 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-1e9bdcea-22bb-4607-a107-ea2162b7398a tempest-ProjectMemberTests-64253088 None] Acquiring lock "cinder-b534b6b5-eff7-4b6f-bcc4-9b2f76395a4e-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:35:55 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-1e9bdcea-22bb-4607-a107-ea2162b7398a tempest-ProjectMemberTests-64253088 None] Lock "cinder-b534b6b5-eff7-4b6f-bcc4-9b2f76395a4e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:35:55 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-1e9bdcea-22bb-4607-a107-ea2162b7398a tempest-ProjectMemberTests-64253088 None] Acquiring lock "cinder-quobyte-b534b6b5-eff7-4b6f-bcc4-9b2f76395a4e" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:35:55 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-1e9bdcea-22bb-4607-a107-ea2162b7398a tempest-ProjectMemberTests-64253088 None] Lock "cinder-quobyte-b534b6b5-eff7-4b6f-bcc4-9b2f76395a4e" acquired by "delete_volume" :: waited 0.020s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:35:55 devstack sudo[106705]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:55 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-e64f58f6-c754-4c18-ac8a-e6f8d55a662d tempest-ProjectReaderTests-1282741293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.280s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:55 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-e64f58f6-c754-4c18-ac8a-e6f8d55a662d tempest-ProjectReaderTests-1282741293 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:35:55 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-e64f58f6-c754-4c18-ac8a-e6f8d55a662d tempest-ProjectReaderTests-1282741293 None] Deleted volume successfully. Jul 22 03:35:55 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a9dfd61-56d4-4857-9b9c-f73e7853c3b0]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:35:55 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-1e9bdcea-22bb-4607-a107-ea2162b7398a tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b534b6b5-eff7-4b6f-bcc4-9b2f76395a4e {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:55 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-e64f58f6-c754-4c18-ac8a-e6f8d55a662d tempest-ProjectReaderTests-1282741293 None] Lock "cinder-326d928a-528e-4e88-a8c3-e48c5868d871-delete_volume" released by "delete_volume" :: held 1.117s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:35:55 devstack sudo[106708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b534b6b5-eff7-4b6f-bcc4-9b2f76395a4e Jul 22 03:35:55 devstack sudo[106708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:55 devstack sudo[106708]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:55 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-1e9bdcea-22bb-4607-a107-ea2162b7398a tempest-ProjectMemberTests-64253088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b534b6b5-eff7-4b6f-bcc4-9b2f76395a4e" returned: 0 in 0.383s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:55 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-1e9bdcea-22bb-4607-a107-ea2162b7398a tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b534b6b5-eff7-4b6f-bcc4-9b2f76395a4e {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:55 devstack sudo[106713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b534b6b5-eff7-4b6f-bcc4-9b2f76395a4e Jul 22 03:35:55 devstack sudo[106713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:55 devstack cinder-volume[87747]: DEBUG cinder.volume.flows.manager.create_volume [None req-99e7538e-0657-400c-83f3-e4c5ea0f921b tempest-ProjectReaderTests-1282741293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87747) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 03:35:55 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-99e7538e-0657-400c-83f3-e4c5ea0f921b tempest-ProjectReaderTests-1282741293 None] Flow 'volume_create_manager' (57c6bba3-4461-45d8-aae1-1e33494ab8a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:35:55 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-99e7538e-0657-400c-83f3-e4c5ea0f921b tempest-ProjectReaderTests-1282741293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6288647-cb4a-47cd-b2e1-3d5e0373cbf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:35:55 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-99e7538e-0657-400c-83f3-e4c5ea0f921b tempest-ProjectReaderTests-1282741293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6288647-cb4a-47cd-b2e1-3d5e0373cbf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:35:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-696078138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17b6bbcf-c7cd-48b3-ae2c-71e257f3b8dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7136d33fbff44dd58bcb5c13580df340',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:35:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:35:56Z,use_quota=True,user_id='d95cad1d40d14453904bb8e8981fb1d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:35:55 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-99e7538e-0657-400c-83f3-e4c5ea0f921b tempest-ProjectReaderTests-1282741293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00f29f75-bec1-44f3-906b-8490c36d5c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:35:55 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-99e7538e-0657-400c-83f3-e4c5ea0f921b tempest-ProjectReaderTests-1282741293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00f29f75-bec1-44f3-906b-8490c36d5c40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:35:55 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-99e7538e-0657-400c-83f3-e4c5ea0f921b tempest-ProjectReaderTests-1282741293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f83f4a4-d937-417d-9f49-6814f2ca7221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:35:55 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-99e7538e-0657-400c-83f3-e4c5ea0f921b tempest-ProjectReaderTests-1282741293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f83f4a4-d937-417d-9f49-6814f2ca7221) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17b6bbcf-c7cd-48b3-ae2c-71e257f3b8dc', 'volume_name': 'volume-17b6bbcf-c7cd-48b3-ae2c-71e257f3b8dc', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:35:55 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-99e7538e-0657-400c-83f3-e4c5ea0f921b tempest-ProjectReaderTests-1282741293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1137d876-9ecf-478b-9bc2-f7968f25f2aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:35:55 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-99e7538e-0657-400c-83f3-e4c5ea0f921b tempest-ProjectReaderTests-1282741293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1137d876-9ecf-478b-9bc2-f7968f25f2aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:35:55 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-99e7538e-0657-400c-83f3-e4c5ea0f921b tempest-ProjectReaderTests-1282741293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (437ccf36-1cf0-4cb9-9002-0a0b5ab5ff86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:35:55 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-99e7538e-0657-400c-83f3-e4c5ea0f921b tempest-ProjectReaderTests-1282741293 None] Volume 17b6bbcf-c7cd-48b3-ae2c-71e257f3b8dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17b6bbcf-c7cd-48b3-ae2c-71e257f3b8dc', 'volume_size': 1} Jul 22 03:35:55 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-99e7538e-0657-400c-83f3-e4c5ea0f921b tempest-ProjectReaderTests-1282741293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:35:55 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-99e7538e-0657-400c-83f3-e4c5ea0f921b tempest-ProjectReaderTests-1282741293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:35:55 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-99e7538e-0657-400c-83f3-e4c5ea0f921b tempest-ProjectReaderTests-1282741293 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T01:35:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-696078138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17b6bbcf-c7cd-48b3-ae2c-71e257f3b8dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7136d33fbff44dd58bcb5c13580df340',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T01:35:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T01:35:56Z,use_quota=True,user_id='d95cad1d40d14453904bb8e8981fb1d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c1b95-879a-4e66-80ea-304bd4b98f28),volume_type_id=d55c1b95-879a-4e66-80ea-304bd4b98f28)}" {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 03:35:55 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.remotefs [None req-99e7538e-0657-400c-83f3-e4c5ea0f921b tempest-ProjectReaderTests-1282741293 None] Creating volume 17b6bbcf-c7cd-48b3-ae2c-71e257f3b8dc {{(pid=87747) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 03:35:55 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-99e7538e-0657-400c-83f3-e4c5ea0f921b tempest-ProjectReaderTests-1282741293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:35:55 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-99e7538e-0657-400c-83f3-e4c5ea0f921b tempest-ProjectReaderTests-1282741293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:35:55 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-99e7538e-0657-400c-83f3-e4c5ea0f921b tempest-ProjectReaderTests-1282741293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:35:55 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-99e7538e-0657-400c-83f3-e4c5ea0f921b tempest-ProjectReaderTests-1282741293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:35:55 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-99e7538e-0657-400c-83f3-e4c5ea0f921b tempest-ProjectReaderTests-1282741293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:35:55 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-99e7538e-0657-400c-83f3-e4c5ea0f921b tempest-ProjectReaderTests-1282741293 None] Selected osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f as target Quobyte volume. {{(pid=87747) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 03:35:55 devstack cinder-volume[87747]: INFO cinder.volume.drivers.remotefs [None req-99e7538e-0657-400c-83f3-e4c5ea0f921b tempest-ProjectReaderTests-1282741293 None] casted to osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f Jul 22 03:35:55 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-99e7538e-0657-400c-83f3-e4c5ea0f921b tempest-ProjectReaderTests-1282741293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-17b6bbcf-c7cd-48b3-ae2c-71e257f3b8dc 1073741824 {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:55 devstack sudo[106716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-17b6bbcf-c7cd-48b3-ae2c-71e257f3b8dc 1073741824 Jul 22 03:35:55 devstack sudo[106716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:55 devstack sudo[106713]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:55 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-1e9bdcea-22bb-4607-a107-ea2162b7398a tempest-ProjectMemberTests-64253088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-b534b6b5-eff7-4b6f-bcc4-9b2f76395a4e" returned: 0 in 0.243s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:55 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-1e9bdcea-22bb-4607-a107-ea2162b7398a tempest-ProjectMemberTests-64253088 None] Lock "cinder-quobyte-b534b6b5-eff7-4b6f-bcc4-9b2f76395a4e" released by "delete_volume" :: held 0.700s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:35:56 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-1e9bdcea-22bb-4607-a107-ea2162b7398a tempest-ProjectMemberTests-64253088 None] Created reservations ['83f132d2-b177-41ef-91b6-8806e95b650a', '30b45fd8-7326-4248-a715-e7574522f749', 'ba0adc77-b47c-4cf4-8a16-f672546c2398', '08f99698-9eb3-48bb-b7d7-a79e95fe740e'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:35:56 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-1e9bdcea-22bb-4607-a107-ea2162b7398a tempest-ProjectMemberTests-64253088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:35:56 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-1e9bdcea-22bb-4607-a107-ea2162b7398a tempest-ProjectMemberTests-64253088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:35:56 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-1e9bdcea-22bb-4607-a107-ea2162b7398a tempest-ProjectMemberTests-64253088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:35:56 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-1e9bdcea-22bb-4607-a107-ea2162b7398a tempest-ProjectMemberTests-64253088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:35:56 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-1e9bdcea-22bb-4607-a107-ea2162b7398a tempest-ProjectMemberTests-64253088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:35:56 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-1e9bdcea-22bb-4607-a107-ea2162b7398a tempest-ProjectMemberTests-64253088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:56 devstack sudo[106719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:35:56 devstack sudo[106719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:56 devstack sudo[106719]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:56 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-1e9bdcea-22bb-4607-a107-ea2162b7398a tempest-ProjectMemberTests-64253088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.258s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:56 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-1e9bdcea-22bb-4607-a107-ea2162b7398a tempest-ProjectMemberTests-64253088 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:35:56 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-1e9bdcea-22bb-4607-a107-ea2162b7398a tempest-ProjectMemberTests-64253088 None] Deleted volume successfully. Jul 22 03:35:56 devstack sudo[106716]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:56 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-99e7538e-0657-400c-83f3-e4c5ea0f921b tempest-ProjectReaderTests-1282741293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-17b6bbcf-c7cd-48b3-ae2c-71e257f3b8dc 1073741824" returned: 0 in 0.450s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:56 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-1e9bdcea-22bb-4607-a107-ea2162b7398a tempest-ProjectMemberTests-64253088 None] Lock "cinder-b534b6b5-eff7-4b6f-bcc4-9b2f76395a4e-delete_volume" released by "delete_volume" :: held 1.157s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:35:56 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-99e7538e-0657-400c-83f3-e4c5ea0f921b tempest-ProjectReaderTests-1282741293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-17b6bbcf-c7cd-48b3-ae2c-71e257f3b8dc {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:56 devstack sudo[106726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-17b6bbcf-c7cd-48b3-ae2c-71e257f3b8dc Jul 22 03:35:56 devstack sudo[106726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:56 devstack sudo[106726]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:56 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-99e7538e-0657-400c-83f3-e4c5ea0f921b tempest-ProjectReaderTests-1282741293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-17b6bbcf-c7cd-48b3-ae2c-71e257f3b8dc" returned: 0 in 0.247s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:56 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-99e7538e-0657-400c-83f3-e4c5ea0f921b tempest-ProjectReaderTests-1282741293 None] <== create_volume: return (736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'} {{(pid=87747) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 03:35:56 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-99e7538e-0657-400c-83f3-e4c5ea0f921b tempest-ProjectReaderTests-1282741293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.738s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:35:56 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-99e7538e-0657-400c-83f3-e4c5ea0f921b tempest-ProjectReaderTests-1282741293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (437ccf36-1cf0-4cb9-9002-0a0b5ab5ff86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17b6bbcf-c7cd-48b3-ae2c-71e257f3b8dc', 'volume_size': 1}' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:35:56 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-99e7538e-0657-400c-83f3-e4c5ea0f921b tempest-ProjectReaderTests-1282741293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2f91f12-4332-4023-a250-9a133fcee7db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 03:35:56 devstack cinder-volume[87747]: INFO cinder.volume.flows.manager.create_volume [None req-99e7538e-0657-400c-83f3-e4c5ea0f921b tempest-ProjectReaderTests-1282741293 None] Volume volume-17b6bbcf-c7cd-48b3-ae2c-71e257f3b8dc (17b6bbcf-c7cd-48b3-ae2c-71e257f3b8dc): created successfully Jul 22 03:35:56 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-99e7538e-0657-400c-83f3-e4c5ea0f921b tempest-ProjectReaderTests-1282741293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2f91f12-4332-4023-a250-9a133fcee7db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87747) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 03:35:56 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-99e7538e-0657-400c-83f3-e4c5ea0f921b tempest-ProjectReaderTests-1282741293 None] Flow 'volume_create_manager' (57c6bba3-4461-45d8-aae1-1e33494ab8a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87747) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 03:35:56 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-99e7538e-0657-400c-83f3-e4c5ea0f921b tempest-ProjectReaderTests-1282741293 None] Created volume successfully. Jul 22 03:35:56 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-84c3b08f-77e1-4659-8822-5d6651139dd6 tempest-ProjectReaderTests-1282741293 None] Acquiring lock "cinder-17b6bbcf-c7cd-48b3-ae2c-71e257f3b8dc-delete_volume" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:35:56 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-84c3b08f-77e1-4659-8822-5d6651139dd6 tempest-ProjectReaderTests-1282741293 None] Lock "cinder-17b6bbcf-c7cd-48b3-ae2c-71e257f3b8dc-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:35:56 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-84c3b08f-77e1-4659-8822-5d6651139dd6 tempest-ProjectReaderTests-1282741293 None] Acquiring lock "cinder-quobyte-17b6bbcf-c7cd-48b3-ae2c-71e257f3b8dc" by "delete_volume" {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 03:35:56 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-84c3b08f-77e1-4659-8822-5d6651139dd6 tempest-ProjectReaderTests-1282741293 None] Lock "cinder-quobyte-17b6bbcf-c7cd-48b3-ae2c-71e257f3b8dc" acquired by "delete_volume" :: waited 0.023s {{(pid=87747) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 03:35:56 devstack cinder-volume[87747]: DEBUG oslo.privsep.daemon [-] privsep: reply[32809332-fe3f-4613-b012-9ab21da5a465]: (4, 'qcow2') {{(pid=88699) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 03:35:56 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-84c3b08f-77e1-4659-8822-5d6651139dd6 tempest-ProjectReaderTests-1282741293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-17b6bbcf-c7cd-48b3-ae2c-71e257f3b8dc {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:57 devstack sudo[106729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-17b6bbcf-c7cd-48b3-ae2c-71e257f3b8dc Jul 22 03:35:57 devstack sudo[106729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:57 devstack sudo[106729]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:57 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-84c3b08f-77e1-4659-8822-5d6651139dd6 tempest-ProjectReaderTests-1282741293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-17b6bbcf-c7cd-48b3-ae2c-71e257f3b8dc" returned: 0 in 0.368s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:57 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-84c3b08f-77e1-4659-8822-5d6651139dd6 tempest-ProjectReaderTests-1282741293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-17b6bbcf-c7cd-48b3-ae2c-71e257f3b8dc {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:57 devstack sudo[106735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-17b6bbcf-c7cd-48b3-ae2c-71e257f3b8dc Jul 22 03:35:57 devstack sudo[106735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:57 devstack sudo[106735]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:57 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-84c3b08f-77e1-4659-8822-5d6651139dd6 tempest-ProjectReaderTests-1282741293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a/volume-17b6bbcf-c7cd-48b3-ae2c-71e257f3b8dc" returned: 0 in 0.242s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:57 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-84c3b08f-77e1-4659-8822-5d6651139dd6 tempest-ProjectReaderTests-1282741293 None] Lock "cinder-quobyte-17b6bbcf-c7cd-48b3-ae2c-71e257f3b8dc" released by "delete_volume" :: held 0.653s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:35:57 devstack cinder-volume[87747]: DEBUG cinder.quota [None req-84c3b08f-77e1-4659-8822-5d6651139dd6 tempest-ProjectReaderTests-1282741293 None] Created reservations ['f1ed141e-6af6-4fd0-af1d-cbabf253602c', '2fa50df0-76fa-4185-8864-1a70d9f308e6', 'b87237cb-e265-49e4-88e3-c9bd036517d2', '4cdb9be7-93fc-48a1-8626-e476c9c031b6'] {{(pid=87747) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 03:35:57 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-84c3b08f-77e1-4659-8822-5d6651139dd6 tempest-ProjectReaderTests-1282741293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:35:57 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-84c3b08f-77e1-4659-8822-5d6651139dd6 tempest-ProjectReaderTests-1282741293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:35:57 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-84c3b08f-77e1-4659-8822-5d6651139dd6 tempest-ProjectReaderTests-1282741293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:35:57 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-84c3b08f-77e1-4659-8822-5d6651139dd6 tempest-ProjectReaderTests-1282741293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:35:57 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-84c3b08f-77e1-4659-8822-5d6651139dd6 tempest-ProjectReaderTests-1282741293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:35:57 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-84c3b08f-77e1-4659-8822-5d6651139dd6 tempest-ProjectReaderTests-1282741293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:35:57 devstack sudo[106739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:35:57 devstack sudo[106739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:35:58 devstack sudo[106739]: pam_unix(sudo:session): session closed for user root Jul 22 03:35:58 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-84c3b08f-77e1-4659-8822-5d6651139dd6 tempest-ProjectReaderTests-1282741293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.284s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:35:58 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-84c3b08f-77e1-4659-8822-5d6651139dd6 tempest-ProjectReaderTests-1282741293 None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:35:58 devstack cinder-volume[87747]: INFO cinder.volume.manager [None req-84c3b08f-77e1-4659-8822-5d6651139dd6 tempest-ProjectReaderTests-1282741293 None] Deleted volume successfully. Jul 22 03:35:58 devstack cinder-volume[87747]: DEBUG cinder.coordination [None req-84c3b08f-77e1-4659-8822-5d6651139dd6 tempest-ProjectReaderTests-1282741293 None] Lock "cinder-17b6bbcf-c7cd-48b3-ae2c-71e257f3b8dc-delete_volume" released by "delete_volume" :: held 1.161s {{(pid=87747) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 03:36:07 devstack cinder-volume[87747]: DEBUG dbcounter [-] [87747] Writing DB stats cinder:UPDATE=90,cinder:SELECT=60,cinder:DELETE=8,cinder:INSERT=24 {{(pid=87747) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 03:36:08 devstack cinder-volume[87747]: DEBUG dbcounter [-] [87747] Writing DB stats cinder:SELECT=58,cinder:INSERT=20,cinder:UPDATE=85,cinder:DELETE=7 {{(pid=87747) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 03:36:22 devstack cinder-volume[87747]: DEBUG oslo_service.periodic_task [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87747) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 03:36:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 03:36:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 03:36:22 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f': None} {{(pid=87747) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 03:36:22 devstack cinder-volume[87747]: DEBUG cinder.volume.drivers.quobyte [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fd361b4c-a0e9-420e-ac56-1526a5b7a08f'] {{(pid=87747) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 03:36:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.lockutils [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87747) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 03:36:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 03:36:22 devstack sudo[106997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a Jul 22 03:36:22 devstack sudo[106997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 03:36:22 devstack sudo[106997]: pam_unix(sudo:session): session closed for user root Jul 22 03:36:22 devstack cinder-volume[87747]: DEBUG oslo_concurrency.processutils [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d669e08b4bb50133b612d4c9c50d794a" returned: 0 in 0.241s {{(pid=87747) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 03:36:22 devstack cinder-volume[87747]: DEBUG cinder.manager [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Notifying Schedulers of capabilities ... {{(pid=87747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 03:36:22 devstack cinder-volume[87747]: DEBUG oslo_service.periodic_task [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] Running periodic task VolumeManager._thread_info {{(pid=87747) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 03:36:22 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] thread count: 28 {{(pid=87747) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 22 03:36:22 devstack cinder-volume[87747]: DEBUG cinder.volume.manager [None req-b81f818d-12a9-4200-a4a5-0ebac77d63a1 None None] thread info: [<_MainThread(MainThread, started 132775275860096)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87747) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}